2 Multimedia Devices

MULTIMEDIA DEVICES Magister Teknologi Informasi

FT - UGM

Agendas

Human Perception

Human Computer Interface

Trend in Multimedia devices Technology

10/20/2014

2

Multimedia MTI UGM

Human Perception

Human or biological information processing

uses senses – which include sensors for

receiving (but also for producing) signals which

encode information

Perception is a process of understanding

sensory information

10/20/2014

3

Multimedia MTI UGM

What are the Human perceptual Senses?

That should be easy: SENSE: INPUT ___ OUTPUT____ Visual Eyes - Acoustical Ears Vocal Tract Haptic Touch/Warm Motoric Smell Nose Skin/Body??? Taste Tongue -

Notice that: usually multiple senses operate at the same time.There is operation across different senses, for example motoric output can be visual, signal, like hand waving.

10/20/2014

4

Multimedia MTI UGM


But senses mean little without processing and command center wchich is brain.

Brain + Senses = Perceptual system

Human senses operate in perfectly coordinated way, they form completely integrated system

This system can receive and processes multimodal signals from external world and produce multimedia output seemingly with no effort

10/20/2014

5

Multimedia MTI UGM

10/20/2014 Multimedia MTI UGM

6

How this is done in the brain we don‟t know exactly and it would be good to know this:

The more we think about it the more we conclude that humans are fantastic multimedia “system”

We use many encoding levels of information from basic to very abstract, for example : Sound

Speech-language

Music

Gesture

Reading

writing



7

There are good reason to think that human sensory

system is optimized to produce and receive

multimodal information – but optimality is done on

many levels:

We can easily produce and receive single media

information eg. When talking on the phone

But we can also easily deal with multiple media

information eg having direct conversation and

looking to face expression


What is Multimedia from the Point Of

Human Perception?


8

Multimedia means using multimodal

information to achieve optimal stimulation

or perceptual system

Often stimulation also depends on

external conditions

Example of Cinema : conditions are

created for optimal stimulation: theater,

darkness, screen and play action + music

What Means of Optimal Stimulation?


9

It is described as

Concentration,

Full Involvement

Living experience

Cinema illustrates this. But also

playing Computer Games induces

very high stimulation.

Multimedia technology aims to provide (some)

matching of information devices to human

perception system

MULTIMEDIA

SYSTEM:

INTERFACE,

PROCESSING,

DELIVERY OF

INFORMATION

NETWORK


Human Computer Interface.

Multimedia interfaces and applications.

Vision based interfaces

Systems using vision based interfaces.

10/20/2014

11

Multimedia MTI UGM



12

Different meanings of HCI

The study of people, computer technology and the

ways they interactive with each other.

The design, evaluation and implementation of

computer systems for human use.

The research to study how to make computer

systems more useable.

Aspects of HCI


13

Design

Intuition, experiences and design principles.

Human factors

Experiments testing the perception, memory and cognition models of human being.

Devices

Physical devices such as mouse, keyboards and other fancy HCI hardware.

Software and systems

Such as windows GUI, shell commands in Unix etc.

HCI Studies


14

Computers What are they good at and bad at?

Input, output, processing, networking, etc.

People What are people good at?

What is the limitation of human abilities?

Input, output, memory, perception and cognition model.

No average answer. Must accommodate diversities.

Usability More than the size of widgets, where are the buttons and syntax

of commands.

Context Environment, physical constraints, cognition constraints, task, etc

The Quality of HCI


15

There are fives factors that affect the

design and implementation of HCI

Time to learn.

Speed of performance.

Rate of errors.

Retention over time.

Subjective satisfaction

Multimedia Interfaces

Multimedia interface

combines different sorts of

media modalities to achieve

more natural and more

efficient human computer

communication.

Speech, audio, touch, video input

(patterns, posture, gesture) etc.

“Put that there” is an example

multimedia HCI that combines

speech, gestures and

graphics.

Advantages of Multimedia Interface


17

More alternative methods.

The flexibility of combining different schemes.

More efficient for specific tasks.

Greater precision of information.

Help handicapped people to use computers.

Vision Based Interfaces

Vision based interfaces uses computer vision

techniques to achieve more effective HCI.

Vision based interfaces are based on techniques

such as:

Hand tracking,

Hand gesture,

Arm gesture

Hand Pointing

Face detection

Head tracking

Gaze

Expression

Lip reading Posture, body gesture and

action recognition

Example Systems


19

Motion

Capturing

Example Systems


20

The MIT Kidsroom

Posture recognition

Action

detection

Our Changing World


21

Changing Computers

Changing Lives

Changing Societies

Changing Computers


22

Four Computing Eras

GUIs to Gestures

VDUs to Smart Fabrics

Handsets to the World in our Hands

Simple Robots to Autonomous MachinesThat Learn

Hard Disks to Digital Footprints

Shrink-Wrapped to Mash-Ups

Four Computing Eras


23

Four Computing Eras (ctd.)


24

GUIs to Gesture


25

The Reactable: a multitouch

interface for playing

music. Performers can

simultaneously interact

with it by moving and

rotating physical objects

on its surface. Reactable

was developed by Sergi

Jordà and colleagues at

the Universitat Pompeu

Fabra, Barcelona. Icelandic

songstress Björk used one

on her 2007 tour.

GUIs to Gesture


26

The HotHand device:

a ring worn by electric

guitar players that uses

motion sensors and a

wireless transmitter to

create different kinds of

sound effects by various

hand gestures

VDUs to Smart Fabrics


27

Animated Textiles

developed by Studio

subTela at the Hexagram

Institute, Montreal, Canada.

These two jackets „synch

up‟ when the wearers hold

hands, and the message

scrolls from the back of

one person to the other.

Handsets to the World in our Hands


28

Talk to the hand…

From the first mobile

phone „brick‟ to the

latest Apple iPhone: as

the size reduces, the

potential expands.

Simple Robots to Autonomous Machines That Learn


29

Emotional kitty: a robot

hardware platform called

iCAT uses a set of logical

rules to convey emotional

states as it makes decisions,

with the goal of improving

human-robot interaction.

It looks confused if it‟s in

trouble, smiles if it gets

something right…

Simple Robots to Autonomous Machines That Learn


30

The Rovio robotic

webcam is wirelessly

connected to the Internet.

It roams around the home

providing an audio and

video link to keep an eye

on family or pets when

you‟re out.

Hard Disks to Digital Footprints


31

Hard Disk

Thumb Drive

Flash Memory Devices

Sony Microvault

Tiny Drive

Shrink-Wrapped to Mash-Ups


32

It used to be that only the most highly skilled software developers could write applications, and only professionalcontent producers could provide us with digital data or content that we could use. In the early days of the PC, we all bought our software in shrink-wrapped boxes, spending more money every few years for a new updated version of our operating system, word processor, or spreadsheet application.

Today „New data sources are available to us all the time. We are all fast becoming content producers, publishers and developers as much as we are consumers‟

Changing Lives


33

Learning Differently

Ubi-learning in the

Ambient Wood

(University of Sussex):

a boy using a digitally

augmented probe

tool that shows realtime

measurements

of light and moisture

on an accompanying

mobile device.

Changing Lives


34

Audiovox‟s Digital

Message Center is

designed to be attached

to the refrigerator, letting

families scribble digital

notes and leave audio

and video messages for

each other

Changing Societies


35

A man in Cape Town,

South Africa, selling mobile

phones. In 2007, 77% of

Africans had a mobile

phone, while only 11% had

computer access.

Learning Activity of C-Generation Teacher Task, short Materials,

discussion

Youtube

Blog

Videos

Slideshare

Presentation and

Full Materials

Ziddu (File

Sharing)

Online Journals

Google Books

Material Enrichment

Students

Facebook

Discussion

Display Technology


37

Flexible Display


38

3 D Printer


39


40

Exercise


41

Make a paper and presentation about the recent

progress of Multimedia Devices:

Camera

Scanners

Display

Printer

Date post:	26-Jan-2016
Category:	Documents
Upload:	khairullsani
View:	15 times
Download:	2 times

2 Multimedia Devices

Documents