Transcript Mobile Platform: Technical Perspective Justin (Joon Sung) Hong Software Center, Samsung Electronics Contents  Agenda        Introduction Technical Trend Case Studies Standardization Conclusion Appendix.

Mobile Platform:
Technical Perspective
Justin (Joon Sung) Hong
Software Center, Samsung Electronics
1
Contents

Agenda







Introduction
Technical Trend
Case Studies
Standardization
Conclusion
Appendix. Subjective Recommendation
Audience


Researchers/Developers of embedded mobile software solutions
Students majoring in electrical/computer/software engineering
2
Introduction
3
Computers

Products in Samsung Electronics

Quiz



Which programming languages are
used for devices?
How many lines of codes are
inside a device?
How many mobile phones are sold
for a year? How many mobile
subscribers in the world?
4
A Secret Life of a Cellphone

Samsung SGH-D600
5
Reference Hardware Architecture
LCD
Keypad
LCD
Single or Dual CPU
RF
Modem
MCP
FIFO or DPRAM
Camera
Application
Processor
MCP
NOR
NOR
SDRAM
NAND
MUX
Audio
Memory
Card
SDRAM
6
Application
Reference Software Architecture
Native Application
3rd Party and VM
Application
Shell
Application Service Extension (Optional)
HW Platform
SW Platform
Platform Interface
Application Framework (Optional)
OS,
Security
Processor
Graphics,
Window
MMI
Data
Protocol &
Local
Connectivity
Connectivity
Audio-Visual &
Multimedia
Multimedia
Telephony
Net
Access
Peripherals
7
What is Mobile Platform?



A mobile platform describes some sort of framework, either in
hardware or software, which allows mobile applications to run.
Typical platforms include a mobile device's architecture, operating
system or middleware, and their runtime libraries.
Related terms


{Mobile|Wireless} {software|system|application|internet|} platform
Examples




Mobile software platform
Wireless internet platform
Mobile system platform
Mobile application platform
8
Why Mobile Platform?

Mobile operators
Reduced content and services management
Support of push-pull information delivery [ARPU]
Multimedia, interactivity and location based
features [ARPU]
Multitasking [ARPU]
Security




Device manufacturers





Common interfaces
Better development environment
Productive application framework
Digital convergence
Reliability (minimise crashes and bugs)




Chipset vendors


System engineering
Fast time-to-market
Application providers



Open APIs
Enhanced libraries and tools for easier and
faster development
Support of a variety of programming languages
9
Mobile Platform War

Platform by platform/application software companies









Symbian OS
Microsoft Windows for Mobile
MontaVista Mobilinux
PalmOS
Openwave PhoneSuite
Teleca Obigo
RIM BlackBerry
Nokia Symbian OS + Series 40/60/80/UIQ/90
Platform by manufacturers



Nokia Symbian OS + Series 40/60/80/UIQ/90
Motorola Synergy-2000, Linux
Samsung Mocha, Ocean
10
Mobile Platform War (Cont.)

Platform by chipset vendors





Ericsson Mobile Platform
QUALCOMM BREW
TTPCom Ajar
TI OMAP
Platform by operators





Java2 Mobile Edition
WIPI
QUALCOMM BREW
SavaJe
GVM, MAP, etc.
11
Technology Requirements & BOM
Mobile Phone Sales 2004
2004
45%
2003
57%
32%
18%
2.4%
2.6%
28%
12%
1.5%
1.5%
Technology Range
Low-end
Mid-range
High-end/rich
Feature
Low-end
Smartphone
Connected PDA/
High-end
Smartphone
Source: Future Mobile Handsets 2004
12
Market Share Estimates for Smart
Phones
35.00%
30.00%
25.00%
Ovum
20.00%
ARC-Group
15.00%
ARC-Chart
IDC
10.00%
Gartner
5.00%
0.00%
2003
2004
2005
2006
2007
Source: Public industry reports
13
Technical Trend
14
1.Processor

CPU

Core: ARM9 with MMU
ARM11~12
Multi-core

Configuration: Single chip (CPU core, baseband processing, DSP) or dual chip
(modem and application processor)
Single CPU or MCP with dual-core

DSP

Core: TI TMS, Ceva, StarCore, Samsung CalmRISC, ARM DSP, QUALCOMM QDSP,
etc.
DSP array

Software: Remote execution/wait,
emerging DSP platform
More DSP platforms, DSP virtualization
15
2.System Software

OS

Kernel: RTOS for modem (e.g. Nucleus, REX, AMX, OSE), RTOS or GPOS for
application processor (e.g. Linux, Windows Mobile), multi-tasking, single address
space, no memory protection
Multi-threading, virtual memory, memory protection for applications
Hybrid/Nano kernel for running multiple OS (e.g. Jaluna Vmware)
Energy-awareness

Storage

File system: Proprietary NAND/NOR file system
Performance/security enhancement
eXecution-In-Place (XIP), shared library

Database: Indexed file system or proprietary table data management
Public database with connectivity (e.g. JDBC), SQL-like query
16
2.System Software (Cont.)

Security

Anti-threats: Not yet covered but on going…
Code protection, secure boot, RTC, memory
Trusted computing

Acceleration: SW ECC and HW RSA acceleration
+ Package engine (e.g. IPSec)

Reliability

Bug patch: Manual w/ USB, OTA firmware upgrade
OTA firmware/component upgrade
Zero administration
17
TI Applications Processing Solutions
18
OMAP1710 Architecture


90 nanometer CMOS technology
ARM926EJ CPU core (~220MHz)





TMS320C55X DSP (~220MHz)



Secure boot-loader
Hardware acceleration for security
standards and random number
generator
Memory controller for I/F to
128MB SDRAM, 256MB Flash,
Mobile DDR
CompactFlash, SD/MMC/SDIO
ports
One/two instr. executed per cycle
Video HW accelerator for DCT,
iDCT, pixel interpolation, and
motion estimation for video
compression
Connectivity


USB OTG, UARTS, I2C, Fast IrDA
(FIR), SPI
LCD Controller, camera ports
19
Models of Trusted Computing
userland
userland
userland
userland
Better!
kernel
virtualization
kernel
userland
trusted
userland
kernel
trusted
kernel
kernel
kernel
kernel
VMM
Normal OS
Virtual Machine
(VMWare, Java VM)
Virtual Machine
Monitor
CPU with trusted
mode (MS NGSCB,
ARM TrustZone)
20
Trusted Computing Architecture
21
Microsoft Next-Generation Secure
Computing Base
Standard-Mode (LHS)
Nexus-Mode (RHS)
Agent
User
Agent
Agent
Trusted UI
Engine (TUE)
User Apps.
TSP
TSP
TSP
NCA Runtime Library
Main OS
Nexus
Kernel
USB
NexusMgr.sys
Driver
NAL
HAL
Hardware
Secure Input
Secure Video
TPM 1.2
CPU
Chipset
22
ARM TrustZone



TrustZone adds a “parallel world”
to allow trusted programs and
data to be safely separated from
the operating system and
applications
Not TPM-based TCG, but resolves
the security requirements
Similar to Intel’s.
23
3.Graphics

3D graphics

Engine: Proprietary or standard-based solutions (e.g. Hi MascotCapsule,
Superscape Swerve, Fathammer)
OpenGL-ES, Mobile 3D Graphics (JSR-184)

Acceleration: SW or 1~2M triangles/sec acceleration, OpenGL-ES/EGL 1.0
(e.g. ARM MBX, nVIDIA GeForce)
50M < triangles/sec acceleration, OpenGL-ES 2.0

Vector graphics

Engine: Standard-based solutions (e.g. Sharp SVG-T, BitBoys)
SVG Basic

Acceleration: 100~200M pixels/sec acceleration
OpenVG

Font

Font: bitmap and vector trials
Downloadable/upgradeable fonts
Vector, 3D font
24
ARM MBX 3D Graphics Accelerator


Easily integrated with ARM926EJ-S,
ARM1136J-S using AMBA
Features









Deferred texturing
Tile-based rendering
Scene manager
PVR-TC : texture compression
YUV to RGB conversion
Flat & Gouraud shading
Full-screen anti-aliasing
Optimized UMA (Unified Memory
Architecture)
ITC (Internal True Color
operations)


Two kinds of cores

MBX HR-S




Fill rate : 320-480M pixels/s
Rendering rate : 2.5M tri/s
Screen resolution : up to VGA
MBX R-S



Fill rate : 120-180M pixels/sec
Rendering rate : 1M tri/s
Screen resolution : up to QVGA
Performed on chip at 32-bpp for
superior color precision
25
4.Multimedia

A/V CODEC

Video: H.263/MPEG4, RTP/RTCP streaming (e.g. RealNetworks, PacketVideo)
H.264/WMV10, OpenMAX

Sound/Speech/Audio: Yamaha 40~64 poly, NB-AMR, MP3
MP3/AAC+, OpenMAX, WB-AMR

Image: BMP, WBMP, GIF, JPEG, PNG
+ JPEG2000, Motion JPEG

Broadcasting

Trials on Satellite-DMB, Terrestrial-DMB, DVB-Handheld/IPDC, QUALCOMM
MediaFLO
Related to policy / regulation
Interactive
26
5.Network

WAN

GSM: 3GPP release 4, WCDMA/EDGE commercialization
3GPP release 6, HSDPA

CDMA: IS-856, 1xEVDO
1xEVDV (cdma2000 Rev.D)
WAN+WiFi (seamless handover)
27
5.Network (Cont.)

MAN/LAN/PAN

802.11a/b/g commercialization

802.11n, Mobile WiMax (802.11e) vs. WiBro
IrDA, Bluetooth 1.0
More Bluetooth profiles, Bluetooth 2.0, UWB
2010+
Mobility
High
1995
2000
2005
4G
3G+
3G
( IMT2000 )
WiBro
Mobile WiMax
(802.16e)
2G
( Digital )
1G
( Analog )
AMPS
ETACS
JTACS
NMT
2.4GHz
WLAN
Low
~ 14.4 kbps
144 kbps
5GHz
WLAN
802.11b
PAN
384 kbps
High
speed
WLAN
UWB
802.11n
MANET
Bluetooth
<50 Mbps
<100 Mbps
Data
Rate
28
5.Network (Cont.)

Upper layers


Wireless-profiled TCP/IPv4, mobile IPv4
IPv6/v4
Ad-hoc networking
Emerging SIP/SDP
IP Multimedia Subsystem, VoIP, IMPS
29
QUALCOMM MSM Roadmap
30
MSM6250 Architecture
31
MSM6250 Features

Processor




NetAccess





ARM926EJ-S up to 150MHz with
MMU
Java HW acceleration
MMC/SD interface
Dual-mode WCDMA plus
GSM/GPRS
ZIF RF supports WCDMA, quadband GSM (GSM 850, 900, 1800,
1900)
gpsOne solution
RUIM/SIM Controller

Multimedia




2D/3D graphics acceleration
2 Megapixel camera interface
QDSP4000 up to 75MHz (Data
transmit rate 153Kbps)
Supports the advanced feature set
of the Launchpad suite, including
streaming video, audio, still image
and video encoding and decoding
Connectivity

Support Bluetooth baseband
32
6.Application


Browsing

Presentation (e.g. Access, Openwave, etc.): XHTML MP, WML1.3

XHTML, CSS
Protocol: WSP/HTTP dual stack
HTTP
Messaging

Multimedia messaging: OMA MMS 1.1

OMA MMS 2.0, E-mail
Instant messaging: OMA IMPS 1.1 (WirelessVillage)
IOP w/ wired IM clients

Push-To-Talk
33
6.Application (Cont.)

Security

Digital rights management: OMA DRM 1.0 (FL/CD/SD)
OMA DRM 2.0, Microsoft Janus, Apple

Java

Virtual machine: SW – Sun CLDC HI, HotSpot, HW - ARM EJ, Nazomi
Similar tech. but more hardwired

Class libraries: MIDP/CLDC, Wireless Messaging, Mobile Multimedia API
+ CDC, Mobile 3D/Vector Graphics, New Architecture

Remote service

Web service
OMA Mobile WS
34
Java2 Micro Edition
Applet
KVM / CVM
35
ARM Jazelle Java Acceleration

Jazelle bytecode partition



139 bytecodes executed directly in hardware (constant loads, variable lo
ads/stores, array load/stores, etc.)
88 bytecodes executed in software (floating point, integer division, switc
h, invoke, etc.)
ARM9EJ-S pipeline (6 stage - Java state)
Bytecode
Instruction
Stream
Java Decode Java Decode
Stack
Management
Register
Read
Thumb Decode
Instruction
Fetch
Register Register
Decode Read
Jazelle logic turns on
ALU
Control
Signals
Compute
Partial Products
Sum/Accumulate
& Saturation
Shift + ALU
Memory Access
EXECUTE
MEMORY
Register
Write
ARM Decode
Register Register
Decode Read
FETCH
DECODE
WRITEBACK
36
7.User Interaction

Man-Machine Interface

IME: Too many solutions (e.g. T9, ez, CJI, etc.)
Similar but better idea (ex. Fast tap, Q12, Virtual keypad, etc.)

Voice recognition: Used for voice dialing/phonebook lookup but not complete
(e.g. VoiceSignal, Conversay)
Voice command/browsing

Personalization

Context awareness: Trial
Preference, location-based consulting, etc.

UI customization: Color, theme, menu tree
Whole look&feel with Macromedia Flash, XML, or COM technologies
37
8.Device

Camera
1M~2M pixels, flash, optical zoom
5M < pixels, auto focus, etc.

LCD
TFT/TFD, 65K colors, 176x220 or QVGA size
OLED/3D, <= 16M color, <= SVGA size

Storage
32~64MB NAND internal flash memory
8GB < NAND flash memory card, 40GB < HDD
38
Case Studies
39
Symbian OS (+Series 60)

Symbian OS


Owned by Nokia, Ericsson, SonyEricsson, Panasonic, Siemens, and
Samsung.
Series 60

Developed and licensed by Nokia
40
v9.1 Features

Real-time


Latest CPU architectures,
peripherals and internal and
external memory types
Multimedia


Application capabilities through
certification, private protected
data stores. full encryption and
certificate management, secure
protocols (HTTPS, SSL and TLS)
and WIM framework



Direct access to screen and
keyboard, graphics accelerator API,
increased UI flexibility

WCDMA (3GPP R4 and R5 IMS),
GSM CSD and EDGE CSD, GPRS
and EDGE GPRS, IS-95 and 1xRTT,
SIM, RUIM, UICC Toolkit, CDMA
specific features
Communications protocols

Graphics
Recording, playback and
streaming, image conversion
Mobile telephony
Security


A real-time, multithreaded kernel
Hardware support



TCP/IP (dual mode IPv4/v6) and
WAP 2.0 (Connectionless WSP and
WAP Push), IrDA, Bluetooth and
USB
International support

Unicode Standard version 3.0
41
v9.1 Features (Cont.)

Device Management/OTA
provisioning


Data synchronization


PC-based/OTA synchronization, a
PC Connectivity framework
PIMS


OMA DM 1.1.2 compliant, OMA
Client provisioning v1.1

Java

MIDP 2.0, CLDC 1.1, JTWI
(JSR185), Mobile Media API
(JSR135), Java API for Bluetooth
(JSR082), Wireless Messaging
(JSR120), Mobile 3D Graphics API
(JSR184) and Personal
Information Management and
FileGCF APIs (JSR075)
Contacts, scheduling, and
messaging, OBEX for exchanging
appointments (vCalendar) and
business cards (vCard)
Messaging

Enhanced messaging (EMS) and
SMS, internet mail using POP3,
IMAP4, SMTP and MHTML,
attachments
42
Device Family Reference Design

Crystal





Peal




Feature-rich, Communicator-type
devices
Full (typically qwerty) keyboard
Landscape-oriented (horizontal)
display
Nokia 9290 Communicator
Standard smart phones
Small display & limited keyboards
Nokia 7650
Quartz



Pen-based phone similar to the
Palm PDA
Portrait-oriented (Vertical) display
SonyEricsson P802
43
Standardization
44
Standardization Bodies

OMA (Open Mobile Alliance)



www.openmobilealliance.org
All mobile application middleware
and services including browsing,
synchronization, device
management, messaging, location,
security, etc.
Multimedia

ITU-T (International
Telecommunication Union)



www.itu.int/itudoc/itu-t/
MPEG4, H.324M, JPEG2000, etc.
Khronos


www.khronos.org
Media authoring and playback
including OpenGL-ES, OpenVG,
OpenMAX, etc.
45
Standardization Bodies (Cont.)

Operating System

CELF (CE Linux Forum)



www.celinuxforum.org
Embedded Linux
Internet

W3C (World Wide Web Consortium)



IETF (Internet Engineering Task
Force)



www.w3c.org
XML, DOM, PNG, SMIL, SVG
www.ietf.org
SIP, TCP/IP, MIPv6, DNS, IPSec,
RTP/RTSP
ECMA (European Computing
Machinery Association)


www.ecma-international.org
C#, ECMAScript, etc.
46
Standardization Bodies (Cont.)

System

MIPI (Mobile Industry Processor
Interface)



TCG (Trusted Computing Group)



www.mipi.org
Mobile application processor
www.trustedcomputinggroup.org
Secure computing
Telephony

3GPP



3GPP2



www.3gpp.org
GSM/GPRS/WCDMA
www.3gpp2.org
IS95, IS2000
CDG (CDMA Development Group)

www.cdg.org
47
Standardization Bodies (Cont.)

Wireless internet

JCP (Java Community Process)



KWISF (Korea Wireless Internet
Standardization Forum)



www.jcp.org
J2ME, MMAPI, WMA, etc.
www.kwisforum.org
WIPI, LBS, MMS, etc.
Operator

OMTP (Open Mobile Terminal
Platform)


www.omtp.org
GSMA (GSM Association)

www.gsmworld.com
48
Conclusion
49
Conclusion


The mobile world is moving very fast.
Digital convergence comes true and mobile phones are at the center
of the trend.



Digital still camera, MP3 player, PDA, GPS receiver, game console, digital
video recorder, and TV have been converged.
What will be the next?
The mobile platform is the key technology.


Currently, ARM, QUALCOMM, Symbian, Nokia, TI, Openwave, Real, etc.
are winners.
Who will be the next?
50
Appendix. Subjective
Recommendation
To be a good software architect and/or
software project manager in embedded
worlds
51
Common Fallacies of Software Lovers

Software development is art.


Design and coding are most valuable skills.



Maintenance is the longest (> 40%~80%) phase of software lifecycle,
i.e. Maintenance > Testing > Design > Coding/Requirements.
Read good codes before writing your own.
Development process is the only need to know.


Computer/Software engineering is NOT computer science. Scientists
develop for learning, but engineers learn for development.
Learn various software engineering disciplines.
The knowledge of hardware and system software is none of my
business.

The development without the knowledge is to create an empire built on
sand.
52
Software Engineering Body of
Knowledge
Requirements
• Requirements
Fundamentals
• Requirements Process
• Requirements Elicitation
• Requirements
Specification
• Requirements Validation
• Requirements Analysis
• Practical Considerations
Configuration
Management
• Management of the SCM
Process
• Configuration
Identification
• Configuration Control
• Configuration Status
Accounting
• Configuration Auditing
• Release Management
and Delivery
Design
Construction
• Design Fundamentals
• Construction
Fundamentals
• Key Issues in Design
• Structure and Architecture • Managing Construction
• Practical Considerations
• Design
• Quality Analysis and
Evaluation
• Design Notations
• Design Strategies and
Methods
Engineering
Management
• Initiation and Scope
Definition
• Project Planning
• Project Enactment
• Review and Evaluation
• Closure
• Engineering
Measurement
Engineering
Process
• Process
Implementation and
Change
• Process Definition
• Process Assessment
• Process and Product
Measurement
Testing
• Testing Fundamentals
• Test Levels
• Test Techniques
• Test Related
Measures
• Test Process
Quality
Maintenance
• Maintenance
Fundamentals
• Key Issues in
Maintenance
• Maintenance Process
• Techniques for
Maintenance
Tools and
Methods
• Quality Fundamentals
• Quality Management
Related
• Processes
Disciplines
• Practical
• Computer Engineering
Considerations
• Computer Science
• Mathematics
• Software Ergonomics
• Systems Engineering
53