of 15
8/3/2019 Mult 1- Introduction
1/15
1 Introduction to Multimedia1 Introduction to Multimedia
1.1 What is Multimedia?1.1 What is Multimedia?
1.2 Multimedia and Hypermedia1.2 Multimedia and Hypermedia
1.3 World Wide Web1.3 World Wide Web
1.4 Overview of Multimedia Software Tools1.4 Overview of Multimedia Software Tools
8/3/2019 Mult 1- Introduction
2/15
What Is Multimedia?
8/3/2019 Mult 1- Introduction
3/15
33
What is Multimedia?What is Multimedia?
When different people mention the termWhen different people mention the term multimediamultimedia , they, they
often have quite different, or even opposing, viewpoints.often have quite different, or even opposing, viewpoints.
--A PC vendor: a PC that has sound capability, a DVD-ROM drive,A PC vendor: a PC that has sound capability, a DVD-ROM drive,
and perhaps the superiority of multimedia-enabled microprocessorsand perhaps the superiority of multimedia-enabled microprocessors
that understand additional multimedia instructions.that understand additional multimedia instructions.
- A consumer entertainment vendor: interactive cable TV with hundreds of digital channels- A consumer entertainment vendor: interactive cable TV with hundreds of digital channelsavailable, or a cable TV-like service deliveredavailable, or a cable TV-like service delivered
over a high-speed Internet connection.over a high-speed Internet connection.
- A Computer Science (CS) student: applications that use multiple- A Computer Science (CS) student: applications that use multiple
modalities, including text, images, drawings (graphics), animation,modalities, including text, images, drawings (graphics), animation,video, sound including speech, andvideo, sound including speech, and interactivityinteractivity..
Multimedia and Computer Science:Multimedia and Computer Science:
-- Graphics, HCI, visualization, computer vision, data compression, graphGraphics, HCI, visualization, computer vision, data compression, graph
theory, networking, database systems.theory, networking, database systems.
8/3/2019 Mult 1- Introduction
4/15
What Is MultimediaWhat Is Multimedia
MultimediaMultimedia is any combination of text, graphic, sound,is any combination of text, graphic, sound,
animation and video that is delivered by computer.animation and video that is delivered by computer.
When you allow the user to control what and when theseWhen you allow the user to control what and when these
elements are delivered, it iselements are delivered, it is interactive multimediainteractive multimedia..
8/3/2019 Mult 1- Introduction
5/15
55
Components of MultimediaComponents of Multimedia
Multimedia involves multiple modalities of text, audio, images,Multimedia involves multiple modalities of text, audio, images,drawings, animation, and video. Examples of how thesedrawings, animation, and video. Examples of how these
modalities are put to use:modalities are put to use:
1. Video teleconferencing.1. Video teleconferencing.
2. Distributed lectures for higher education.2. Distributed lectures for higher education.
3. Tele-medicine.3. Tele-medicine.
4. Co-operative work environments.4. Co-operative work environments.
5. Searching in (very) large video and image databases for5. Searching in (very) large video and image databases for
target visual objects.target visual objects.6. Augmented reality: placing real-appearing computer6. Augmented reality: placing real-appearing computer
graphics and video objects into scenes.graphics and video objects into scenes.
8/3/2019 Mult 1- Introduction
6/15
66
7. Including audio cues for where video-conference7. Including audio cues for where video-conferenceparticipants are located.participants are located.
8. Building searchable features into new video, and enabling8. Building searchable features into new video, and enablingvery high- to very low-bit-rate use of new, scalable multi-very high- to very low-bit-rate use of new, scalable multi-
media products.media products.
9. Making multimedia components9. Making multimedia components editableeditable..
10. Building inverse-Hollywood applications that can re-10. Building inverse-Hollywood applications that can re-
create the process by which a video was made.create the process by which a video was made.
11. Using voice-recognition to build an interactive11. Using voice-recognition to build an interactiveenvironment, say a kitchen-wall web browser.environment, say a kitchen-wall web browser.
8/3/2019 Mult 1- Introduction
7/15
77
Multimedia Research Topics and ProjectsMultimedia Research Topics and Projects
To the computer science researcher, multimedia consists ofTo the computer science researcher, multimedia consists of
a wide variety of topics:a wide variety of topics:
1.1. Multimedia processing and codingMultimedia processing and coding: multimedia content: multimedia content
analysis, content-based multimedia retrieval, multimediaanalysis, content-based multimedia retrieval, multimedia
security, audio/image/video processing, compression, etc.security, audio/image/video processing, compression, etc.
2.2. Multimedia system support and networkingMultimedia system support and networking: network: network
protocols, Internet, operating systems, servers and clients,protocols, Internet, operating systems, servers and clients,
quality of service (QoS), and databases.quality of service (QoS), and databases.
3.3. Multimedia tools, end-systems and applicationsMultimedia tools, end-systems and applications: hypermedia: hypermediasystems, user interfaces, authoring systems.systems, user interfaces, authoring systems.
4.4. Multi-modal interaction and integrationMulti-modal interaction and integration: ubiquity: ubiquityweb-everywhere devices, multimedia education including Computerweb-everywhere devices, multimedia education including ComputerSupported Collaborative Learning, and design and applications ofSupported Collaborative Learning, and design and applications ofvirtual environments.virtual environments.
8/3/2019 Mult 1- Introduction
8/15
88
Current Multimedia ProjectsCurrent Multimedia Projects
Many exciting research projects are currently underway. HereMany exciting research projects are currently underway. Here
are a few of them:are a few of them:
1.1. Camera-based object tracking technologyCamera-based object tracking technology: tracking of: tracking of
the control objects provides user control of the process.the control objects provides user control of the process.
2.2. 3D motion capture3D motion capture: used for multiple actor capture so: used for multiple actor capture so
that multiplethat multiple realrealactors in aactors in a virtualvirtualstudio can be usedstudio can be used
to automatically produce realisticto automatically produce realistic animatedanimatedmodels withmodels with
natural movement.natural movement.
3.3. Multiple viewsMultiple views: allowing photo-realistic (video-quality): allowing photo-realistic (video-quality)
synthesis of virtual actors from several cameras or from asynthesis of virtual actors from several cameras or from a
single camera under differing lighting.single camera under differing lighting.4.4. 3D capture technology3D capture technology: allow synthesis of highly realistic facial: allow synthesis of highly realistic facial
animation from speech.animation from speech.
8/3/2019 Mult 1- Introduction
9/15
99
5.5. Specific multimedia applicationsSpecific multimedia applications: aimed at handicapped: aimed at handicappedpersons with low vision capability and the elderly - a richpersons with low vision capability and the elderly - a richfield of endeavour.field of endeavour.
6.6. Digital fashionDigital fashion: aims to develop smart clothing that can: aims to develop smart clothing that cancommunicate with other such enhanced clothing usingcommunicate with other such enhanced clothing usingwireless communication, so as to artificially enhancewireless communication, so as to artificially enhancehuman interaction in a social setting.human interaction in a social setting.
7.7. Electronic Housecall systemElectronic Housecall system: an initiative for providing: an initiative for providing
interactive health monitoring services to patients in theirinteractive health monitoring services to patients in their
homeshomes
8.8. Augmented Interaction applicationsAugmented Interaction applications: used to develop: used to develop
interfaces between real and virtual humans for tasks suchinterfaces between real and virtual humans for tasks suchas augmented storytelling.as augmented storytelling.
8/3/2019 Mult 1- Introduction
10/15
1010
Hypermedia and MultimediaHypermedia and Multimedia
AA hypertexthypertext system: meant to be read nonlinearly, by following linkssystem: meant to be read nonlinearly, by following linksthat point to other parts of the document, or to other documentsthat point to other parts of the document, or to other documents
(Figure 1.1)(Figure 1.1)
HyperMediaHyperMedia: not constrained to be text-based, can include: not constrained to be text-based, can include
other media, e.g. graphics, images and especially the continuousother media, e.g. graphics, images and especially the continuousmedia - sound and video.media - sound and video.
-- The World Wide Web (WWW) - the best example of a hypermediaThe World Wide Web (WWW) - the best example of a hypermediaapplication.application.
MultimediaMultimedia means that computer information can be representedmeans that computer information can be representedthrough audio, graphics, images, video, and animation in addition tothrough audio, graphics, images, video, and animation in addition totraditional media.traditional media.
8/3/2019 Mult 1- Introduction
11/15
1111
8/3/2019 Mult 1- Introduction
12/15
HyperMedia
8/3/2019 Mult 1- Introduction
13/15
1313
Examples of typical present multimedia applicationsExamples of typical present multimedia applicationsinclude:include:
Digital video editing and production systems.Digital video editing and production systems.
Electronic newspapers/magazines.Electronic newspapers/magazines.
World Wide Web.World Wide Web.
On-line reference works: e.g. encyclopedias, games, etc.On-line reference works: e.g. encyclopedias, games, etc. Home shopping.Home shopping.
Interactive TV.Interactive TV.
Multimedia courseware.Multimedia courseware.
Video conferencing.Video conferencing. Video-on-demand.Video-on-demand.
Interactive movies.Interactive movies.
8/3/2019 Mult 1- Introduction
14/15
1414
1.3 World Wide Web1.3 World Wide Web
The W3C has listed the following goals forThe W3C has listed the following goals for
the WWW:the WWW:
1. Universal access of web resources (by1. Universal access of web resources (byeveryone everywhere).everyone everywhere).
2. Effectiveness of navigating available2. Effectiveness of navigating available
information.information.
3. Responsible use of posted material.3. Responsible use of posted material.
History of the WWW (1960s-today)History of the WWW (1960s-today)
8/3/2019 Mult 1- Introduction
15/15
1515
1.4 Overview of Multimedia Software Tools1.4 Overview of Multimedia Software Tools
The categories of software tools briefly examined here are:The categories of software tools briefly examined here are:
1.1. Music Sequencing and NotationMusic Sequencing and Notation (Cakewalk, Cubase, Macromedia Soundedit)(Cakewalk, Cubase, Macromedia Soundedit)
2.2. Digital AudioDigital Audio (Cool Edit, Sound Forge, Pro Tools)(Cool Edit, Sound Forge, Pro Tools)
3.3. Graphics and Image EditingGraphics and Image Editing (Adobe Illustrator, Adobe Photoshop, Macromedia(Adobe Illustrator, Adobe Photoshop, MacromediaFireworks, Macromedia Freehand)Fireworks, Macromedia Freehand)
4.4. Video EditingVideo Editing (Adobe Premiere, Adobe After Effects, Final Cut Pro)(Adobe Premiere, Adobe After Effects, Final Cut Pro)
5.5. AnimationAnimation (Java3D, DirectX, OpenGL, 3DStudio Max, Softimage XSI, Maya,(Java3D, DirectX, OpenGL, 3DStudio Max, Softimage XSI, Maya,RenderMan)RenderMan)
6.6. Multimedia AuthoringMultimedia Authoring (Macromedia Flash, Macromedia Director, Authorware, Quest)(Macromedia Flash, Macromedia Director, Authorware, Quest)
