© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 1 Carnegie Mellon

Mobile Multimedia ApplicationsMobile Multimedia Applications

The information about The information about Nokia Mobile PhonesNokia Mobile Phonesis from the talk is from the talk

Market and Technology Market and Technology Fundamentals for Multi Media ServicesFundamentals for Multi Media Services byby Timo ToikkanenTimo Toikkanen

at the VIEW Technology Workshop, at the VIEW Technology Workshop,

Hong KongHong Kong,, August 2002 August 2002

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 2 Carnegie Mellon

Wireless FuturesWireless Futures

• Internet supports e-commerceInternet supports e-commerce

• Wireless Internet will support m-commerceWireless Internet will support m-commerce• Normal in a few yearsNormal in a few years

• M-commerce is facilitated by high-rate GSM-like serviceM-commerce is facilitated by high-rate GSM-like service• GPRS/HSCSD (Hi Speed Circuit Switched Data) with a GPRS/HSCSD (Hi Speed Circuit Switched Data) with a

of bitrate 144kbpsof bitrate 144kbps

• Need higher bitrate (4G) to avoid the World Wide WaitNeed higher bitrate (4G) to avoid the World Wide Wait

• Mobile palmtop device will be dominantMobile palmtop device will be dominant• Always internet linked, no distinction between mobile and Always internet linked, no distinction between mobile and

fixed officefixed office

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 3 Carnegie Mellon

4G Networks?4G Networks?

• Bandwidth of 100Mbit/sBandwidth of 100Mbit/s

• Due 2006 – 2010Due 2006 – 2010

• But: Too many 3G standards now, slows developmentBut: Too many 3G standards now, slows development

• Permanent internet connection (IPv6 address) while Permanent internet connection (IPv6 address) while mobilemobile

• All digital, packet switched, with tight securityAll digital, packet switched, with tight security

• Extends 3G by >10xExtends 3G by >10x

• Not backwards compatibleNot backwards compatible

• Enables full interactive video servicesEnables full interactive video services

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 4 Carnegie Mellon

Mobile Multimedia Computing RequiresMobile Multimedia Computing Requires

• Powerful multimedia handsets with fast CPUs, Powerful multimedia handsets with fast CPUs, bluetooth earpiece, camera, wireless penbluetooth earpiece, camera, wireless pen• Speech recognition, handwriting recognitionSpeech recognition, handwriting recognition

• LCD displays or projection to spectaclesLCD displays or projection to spectacles

• More battery power (longer battery life)More battery power (longer battery life)• Energy from shoe by walkingEnergy from shoe by walking• Body heat from clothingBody heat from clothing

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 5 Carnegie Mellon

Video for wireless multimediaVideo for wireless multimedia

• Quarter size video 10 fps encoded at 20 – 500 kbps Quarter size video 10 fps encoded at 20 – 500 kbps requires transmission capacity of 2 - 50 voice requires transmission capacity of 2 - 50 voice conversationsconversations

• Full size video at 30 fps requires 32 GSM channelsFull size video at 30 fps requires 32 GSM channels

• The World Wide Wait is coming!The World Wide Wait is coming!

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 7 Carnegie Mellon

Wireless & MultimediaWireless & Multimedia

• Video Transmission over wireless channels

Video Compression for wireless channels

Video Streaming over wireless channels

Pre and Post Processing techniques for Error Resiliency & Error Concealment

QoS (Quality of Service) in wireless multimedia

Media-Processors in wireless applications and IP Networks

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 9 Carnegie Mellon

Universal AccessUniversal Access

Any informationAny information

Any networkAny network

Any deviceAny device

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 10 Carnegie Mellon

What is 3G?What is 3G?

3G 3G wirelesswireless technology is a global communication technology based on packet-based technology is a global communication technology based on packet-based transmission of digitized voice, data, and video. transmission of digitized voice, data, and video.

It includes multiple competing wireless technologies likeIt includes multiple competing wireless technologies like

• Code Division Multiple Access (CDMA) 2000, Code Division Multiple Access (CDMA) 2000,

• Universal Mobile Telecommunications Service (UMTS), and Universal Mobile Telecommunications Service (UMTS), and

• wideband CDMA (WCDMA) are found. wideband CDMA (WCDMA) are found.

3G is capable of delivering data transmission speeds of 3G is capable of delivering data transmission speeds of

• 144K bit/sec144K bit/sec inside a moving vehicle, inside a moving vehicle,

• 384K bit/sec384K bit/sec standing or walking, and standing or walking, and

• 2M bit/sec2M bit/sec in a fixed location, in a fixed location, using packet-based rather than circuit switched technology and permitting global using packet-based rather than circuit switched technology and permitting global roaming.roaming.

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 11 Carnegie Mellon

All those Gs: 1G, 2G, 2.5G, 3GAll those Gs: 1G, 2G, 2.5G, 3G

1G: First generation cellular phone technology,

analog, Advanced Mobile Phone Service (AMPS)

2G: Second Generation digital technology, voice centric,

TDMA, CDMA, GSM

2.5G: Second Generation with upgrades for speed, packet focus (e.g. GPRS layered on top of GSM)

Data rates from 56 up to 114 Kbps

3G: Third generation, data centric, packet based optimized for high bandwidth, WCDMA and UMTS

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 12 Carnegie Mellon

What 3G Networks mean to the ConsumerWhat 3G Networks mean to the Consumer

• 3G is video conferencing in a taxi3G is video conferencing in a taxi

• 3G is singing karaoke in a bus3G is singing karaoke in a bus

• 3G is sending images straight from the field to headquarters 3G is sending images straight from the field to headquarters for analysisfor analysis

• 3G is sharing your Japan vocation with your friends from 3G is sharing your Japan vocation with your friends from Hong KongHong Kong

• 3G is playing a multi-user role playing game on the bus to 3G is playing a multi-user role playing game on the bus to workwork

• ……

• Imaging is the next phase of mobile communication evolution

• Magnitude of appeal parallel to that of mobile voice

• Imaging is the major catalyst for MMS

A New Language of Cell Phones- from 'listen to what I say' to 'see what I mean'

In 2003, a majority of

all new Nokia

terminals will have

MMS capability

At the end of 2002,

about half of Nokia mobile phone

delivery volumes will

be MMS enabled

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 14 Carnegie Mellon

Short Messaging Service (SMS)Short Messaging Service (SMS)SMS a service for sending messages of up to 160 characters (224 SMS a service for sending messages of up to 160 characters (224

characters if using a 5-bit mode) to mobile phones that use Global characters if using a 5-bit mode) to mobile phones that use Global System for Mobile (System for Mobile (GSMGSM) communication. ) communication.

Primarily used in Europe and Asia. Primarily used in Europe and Asia.

Can be sent to digital phones from a Web site equipped with PC Link Can be sent to digital phones from a Web site equipped with PC Link or from one digital phone to another. or from one digital phone to another.

Typical uses of SMS include: Typical uses of SMS include:

• Notifying a mobile phone owner of a voicemail message Notifying a mobile phone owner of a voicemail message

• Notifying a salesperson of an inquiry and contact to call Notifying a salesperson of an inquiry and contact to call

• Notifying a doctor of a patient with an emergency problem Notifying a doctor of a patient with an emergency problem

• Notifying a service person of the time and place of their next Notifying a service person of the time and place of their next call call

• Notifying a driver of the address of the next pickup Notifying a driver of the address of the next pickup

An An SMS gatewaySMS gateway is a Web site that lets you enter an SMS message is a Web site that lets you enter an SMS message to someone within the cell served by that gateway or that acts as to someone within the cell served by that gateway or that acts as an international gateway for users with roaming capability.an international gateway for users with roaming capability.

Multimedia Messaging ServicesMultimedia Messaging Services

All messaging services including SMS, MMS & e-mail collected under one application

Messaging interface

Pictures can be stored in the photo album

The address formats supported are global phone numbers and simple e-mail addresses

MMS message MMS deliveryPhoto album

MMS messaging can combine text, pictures and audio

Ease of Use

Learning the SMS lessonLearning the SMS lessonWhat is needed for a fast mobile service growthWhat is needed for a fast mobile service growth

Convenientcharging

model

Inter-operatordelivery

Penetration& legacysupport

Standardisedservice

Widespread adoption of a Widespread adoption of a common and easy to use common and easy to use applicationapplication

•creates a big unified creates a big unified marketmarket

•… … and a platform and a platform •feeds its own growthfeeds its own growth•everyone profitseveryone profits

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 17 Carnegie Mellon

Convenient Charging Model for MMSConvenient Charging Model for MMS

• It is predicted that MMS charging model follows It is predicted that MMS charging model follows the one of the existing SMS.the one of the existing SMS.

• This enables This enables secure, familiar and low risk secure, familiar and low risk charging from end-user perspective.charging from end-user perspective.

• Preferred billing model: Preferred billing model: "Sender pays all costs""Sender pays all costs"• However MMS supports various charging However MMS supports various charging

models, but models, but changes to SMS charging model changes to SMS charging model should be implemented only after a thorough should be implemented only after a thorough analysis of the effects on the end user analysis of the effects on the end user behavior.behavior.

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 18 Carnegie Mellon

MMS InteroperabilityMMS Interoperability

• Ensure MMS interoperability between terminals and Ensure MMS interoperability between terminals and network equipment from different manufacturersnetwork equipment from different manufacturers

• Allow smooth take-off of MMSAllow smooth take-off of MMS

• Key tasks includeKey tasks include• facilitation and co-ordination of MMS interoperability facilitation and co-ordination of MMS interoperability

testingtesting• problem solving and sharing of information problem solving and sharing of information

regarding findingsregarding findings• In addition to following the complete specifications, In addition to following the complete specifications,

agree on a minimum subset of features that MMS agree on a minimum subset of features that MMS equipment will supportequipment will support

Messaging MigrationMessaging Migration- from SMS to Mobile Multimedia- from SMS to Mobile Multimedia

MMS is capturing and sharing momentsMMS is capturing and sharing moments

MMS is capturing and sharing momentsMMS is capturing and sharing moments

3 key trends in mobile user 3 key trends in mobile user iinterfacesnterfaces

Large color screensLarge color screens – –

Evolution of mobile communication from ears Evolution of mobile communication from ears to eyes, from voice to imagingto eyes, from voice to imaging

Powerful navigation solutions – The crucial ergonomics to make advanced functionality easy to use3rd party SW and content (MMS, Java, XHTML) –Open platforms and technologies enable developers and consumers to add new functionalities to devices - and unleash collective innovation

Nokia User IntNokia User Interface erface seriesseriesAll available during 2002All available during 2002

128 x 128 176 x 20896 x 65 640 x 200

Cost drivenplatform

Size drivencolour platform

One-hand operated feature Platform

Two-hand operated feature platform

XHTMLMIDP JavaMMS

Nokia OS

XHTMLMIDP JavaMMS

Nokia OS

XHTMLMIDP JavaMMS

Symbian OS

HTMLPersonal JavaMMS

Symbian OS

Series 30Series 40Series 60Series 80

Nokia MMS enabled fones Nokia MMS enabled fones (more coming soon..)(more coming soon..)

               

Comparison of Nokia MMS PhonesComparison of Nokia MMS Phones

Product Features 3510 6610/7210 7650 Frequency Band GSM 900/1800 GSM 900/1800/1900 GSM 900/1800 Display Black & white 4096 colours 4096 colours Display size 96 x 65 (Series 30) 128 x 128 (Series 40) 176 x 208 (Series 60) Ring tone format Nokia format, SP-MIDI Nokia format, SP-MIDI Nokia format, SP-MIDI, WAV SW platform Nokia Nokia Symbian OS v6.1 Bear support CSD, GPRS (Class 6) CSD, HSCSD,

GPRS (Class 6) CSD, HSCSD,

GPRS (Class 6) MMS feature MMS receiving only

(Receive text, picture & sound)

Creating, forwarding and sending image and text

Receive text, picture & sound

Creating, forwarding and sending and receiving MMS combining text with a digital image and a voice clip

Codec support HR, FR, EFR HR, FR, EFR HR, FR, EFR, AMR Email support No No Yes (SMTP, POP3, IMAP4) Wallpaper personalization No Yes Yes J2ME applications support No Yes Yes Xpress-on cover Yes Yes No FM Radio No Yes No Bluetooth No No Yes Infrared No Yes Yes Built-in camera No No Yes Language at launch English, Chinese English, Chinese English only Footnote Allow 3rd parties

development on Symbian

High-tierMid-tierLow-tier

© Copyright 2002 Michael G. Christel and Alexander G. Hauptmann 27 Carnegie Mellon