+ All Categories
Home > Documents > MM-coursebook.pdf

MM-coursebook.pdf

Date post: 03-Jan-2016
Category:
Upload: ux
View: 24 times
Download: 0 times
Share this document with a friend
Description:
multimedia cors
Popular Tags:
38
Course Book of Multimedia Technology (SC4) 2011-2012 Contents 1- Course coordinator and list of teachers on this course. 2- Course overview 3- Course objectives. 4- Course Reading list. 5- Course Contents. 6- Syllabus. 7- Exams: Rules and instructions. 8- Samples of expected questions and their answers. 9- External examiners. 10- Student's feedback.
Transcript
Page 1: MM-coursebook.pdf

Course Book of

Multimedia Technology (SC4)

2011-2012

Contents

1- Course coordinator and list of teachers on this course.

2- Course overview

3- Course objectives.

4- Course Reading list.

5- Course Contents.

6- Syllabus.

7- Exams: Rules and instructions.

8- Samples of expected questions and their answers.

9- External examiners.

10- Student's feedback.

Page 2: MM-coursebook.pdf

Course coordinator and list of teachers on this course

1- Name of the Course: Multimedia Technology

2- Lecturer\ tutor in charge: Dr. Aree Ali Mohammed

3- Department\ Branch and the college: Science/ Computer

4- Contacts:

Office phone: +964533121256

Mobile: +9647701421610

- Address:

University of Sulaimani

College of Science/ Computer Dept.

- E-mail:

Formal mail: [email protected]

Personal mail: [email protected]

- Website Link:

34=Jimare?aspx.Mamosta_U_E/org.univsul.www://http

- Other participant Lecturers:

Page 3: MM-coursebook.pdf

Course Overview This course is designed for students who interested in careers in the

Media, the Arts and other academic issues concerning multimedia

technology. Students will explore basic applications of various multimedia

tools to create visual, aural, and written projects in both digital and print

format. Through field trips, guest speakers, and on-line career research,

students will learn about local and regional opportunities in this career

pathway.

MM technology is an advanced course covering both theoretical and

practical issues in designing multimedia systems. Topics to be covered

include introduction to multimedia systems, digital image processing and

compression, digital video compression techniques, operating system

support for digital audio and video, as well as network and transport

protocols for multimedia.

By the end of the course, the students will be familiar with the

common computing fundamentals employed in a variety of multimedia

applications such as: multimedia processing, compression and security. The

students will be exposed to the core techniques and algorithms spanning

across the common and emerging multimedia applications. They will have

experience in applying these techniques to novel situations and will be able

to do analytical as well as empirical performance evaluation of the particular

technique in the overall application context.

This course is intended for developing in multimedia applications

using Java programming. The reasons behind using java as a programming

language tools are the powerfulness and the existing large number of

packages that support multimedia application

Page 4: MM-coursebook.pdf

Course objectives The objective of this subject is to teach the principles of how different

types of media can be processed and presented by computers. It introduces

how multimedia can be used in various application areas. It provides a solid

foundation to the students so that they can identify the proper applications of

multimedia, evaluate the appropriate multimedia systems and develop

effective multimedia applications.

Student objectives:

Students will understand multimedia in respect to many application including business, schools, home, education, and virtual reality;

Students will understand the hardware and software needed to create projects using creativity and organization to create them;

Student will develop multimedia skills understanding the principal players of individual players in multimedia teams in developing projects;

Students will work with all aspects of images; Students will work with all aspects of sound; Students will work with all aspects of video; Students will learn copyright laws associated with multimedia; Students will learn the cost involved in multimedia planning,

designing, and producing; Students will learn ways to present their multimedia projects.

Instructor objectives:

Instructors will deliver content to students in the following modes: Lecture, PowerPoint, Group Activities, and Library Activities;

Instructors will be available before and after class for one-on-one student sessions;

Instructors will provide ample resources for students to utilize and will direct students on the right pathways;

Instructors will monitor students' successes and failures seeking to make the failures learning experiences and growing opportunities.

Page 5: MM-coursebook.pdf

Course Reading list

1. Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook)

2. Digital Image Processing: A practical introduction using Java, Nick Efford, Addison-Wesley, 2000, ISBN 0-201-59623-7.

3. Digital Image Processing: An algorithm introduction using Java, Burger and Burge, Springer, 2008, ISBN 978-1-84628-379-6.

4. Multimedia Introduction to Programming Using Java, David and Paul, Springer, 2005, ISBN 0-387-22681-8.

5. Multimedia over Ip and Wireless Networks Compression, Networking, and Systems, Chou and Schaar, Elsevier, 2007, ISBN 0-12-088480-1.

6. Human Computer Interaction, Alan Dix et al, Pearson Education, 3rd Edition, 2004.

7. Creating Mobile Games, Carol Hamer, APress, 2007.

8. The Multimedia Internet, W. Stephen, Springer, 2005.

In addition to the text books used in this course, other books I use for my class notes are those highly related to the multimedia applications as well as materials from other course existed in the internet.

1. http://www.cs.unc.edu/Courses/jbs/lessons/java/java_multimedia/

2. http://www.javalobby.org/articles/ultimate-image/

3. http://www.csse.monash.edu.au/~cema/courses/CSE5910/

4. http://www.cs.bc.edu/~hjiang/c335/notes/index.html

5. http://engineeringppt.blogspot.com/search/label/

6. http://engineeringppt.blogspot.com/search/label/Multimedia

7. http://www.cse.fau.edu/~xqzhu/cs295.htm

Page 6: MM-coursebook.pdf

Syllabus

No. Title of the Subject Lecturer's/Tutor's Name

1 Introduction to Multimedia Dr. Aree A. M.

2 Multimedia Elements = = = = = =

3 Image Data Representation = = = = = =

4 Audio Data Representation = = = = = =

5 Video Data Representation = = = = = =

6 Multimedia Processing = = = = = =

7 Image Processing = = = = = =

8 Audio Processing = = = = = =

9 Video Processing = = = = = =

10 Multimedia Compression = = = = = =

11 Basic Image Compression Techniques = = = = = =

12 Basic Video Compression Techniques = = = = = =

13 Multimedia Communication = = = = = =

14 Multimedia Network Application = = = = = =

15 Multimedia Database = = = = = =

16 Multimedia Security = = = = = =

17 Multimedia HCI = = = = = =

18 Multimedia Mobile Games = = = = = =

Page 7: MM-coursebook.pdf

First Subject: Introduction to Multimedia

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces students to the course and principle concepts of multimedia. At the end of the lesson, the students will be able to:

Define common multimedia terms such as multimedia, integration, interactive, HTML, and authoring.

Describe several different environments in which multimedia can be used, and several different aspects of multimedia that provide a benefit over other forms of information presentation.

Quality various characteristics of multimedia: nonlinear versus linear content.

Understand multimedia application in different fields.

The Scientific contents and key messages:

0. What is multimedia?

1. Components of multimedia

2. History of multimedia

3. Hypermedia and multimedia

4. History of the WWW

5. Overview of multimedia software tools

6. Multimedia application

Main references of the subject:

1. Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

2. Google books: multimedia applications, Ralf , X. media, 2004

(http://books.google.com/books?id=Zw8h5BrEEKMC&dq=multimedia+applications&source=gbs_navlinks_s)

3. http://en.wikipedia.org/wiki/Multimedia

Page 8: MM-coursebook.pdf

Second Subject: Multimedia Elements

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson looks at the elements that should be considered when choosing multimedia applications. At the end of the lesson, the students will be able to:

Describe the elements of multimedia time and non time based. Identify the multimedia elements as objects and state how they

relate to and interact with each other and their environment.

The Scientific contents and key messages:

1. Text

2. Graphics

3. Image

4. Audio

5. Video

6. Animation

7. Animation and interaction

Main references of the subject:

1. Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

2. Google books: multimedia system, Ralf , X. media, 2004

(http://books.google.com/books?id=34Uuim67mvUC&dq=multimedia+systems&source=gbs_navlinks_s)

3. www3.fed.cuhk.edu.hk/ited/Christy/ppt/graphics.ppt

4. rinajtrapshah.bravehost.com/MD114/Revision1.pp

Page 9: MM-coursebook.pdf

Third Subject: Image Data Representation

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson looks at images and shows the students what they need to create and edit them. At the end of the lesson, the students will be able to:

Discuss the various factors that apply to the use of images in multimedia.

Describe the capabilities and limitations of bitmap images. Describe the capabilities and limitations of vector images. Describe the use of colors and palettes in multimedia. Cite the various file types used in multimedia.

The Scientific contents and key messages:

1. Image data types

2. Graphics data types

3. 1-Bit images

4. 8- Bit gray-level images

5. 24- Bit color images

6. Color Lookup tables (LUTs)

7. Popular file formats

8. Graphics animation files

Main references of the subject:

1. Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

2. Digital Image Processing: An algorithm introduction using Java, Burger and Burge, Springer, 2008, ISBN 978-1-84628-379-6.

3. http://www.cs.cf.ac.uk/Dave/Multimedia/node142.html

Page 10: MM-coursebook.pdf

Fourth Subject: Image Processing

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson gives some basic algorithm for image manipulation like (arithmetic operations, transformation and filtering) and shows the students what they need to create their own algorithms to process the images. At the end of the lesson, the students will be able to:

Consider the implications of using digital image processing in multimedia.

Describe the image processing domains (time, frequency, spatial) Describe the capabilities of image processing algorithms. Cite the various methods of image enhancement. Show the importance of image processing in multimedia. Cite the various image processing techniques used in multimedia.

The Scientific contents and key messages:

1. Image manipulation and processing

2. Image histograms

3. Point operations (modify image intensities)

4. Image filtering (linear and non linear)

5. Morphological filtering

6. Image transformations (DFT, DCT and DWT)

7. Image processing applications

Main references of the subject:

1. Digital Image Processing: An algorithm introduction using Java, Burger and Burge, Springer, 2008, ISBN 978-1-84628-379-6.

Digital Image Processing: A practical introduction using Java, Nick Efford, Addison-Wesley, 2000, ISBN 0-201-59623-7.

http://www.imageprocessingplace.com/downloads_V3/dip2e_downloads/sample_book_material/Chapter02.pdf

Page 11: MM-coursebook.pdf

Fifth Subject: Basics of Digital Audio

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson looks at audio that can be used in multimedia and describes the fundamental concepts of digital audio. At the end of the lesson, the students will be able to:

Understand the basic concepts of digital sound Know how to measure a digital sound Make a difference between analog and digital audio Describe advantages and disadvantages of digital audio Use MIDI and understand its attributes Record, process, and edit digital audio. Determine which audio file is best for use in multimedia projects.

The Scientific contents and key messages:

1. What is sound?

2. Digitization

3. Sound file types and formats

4. Signal – to – Noise Ratio

5. Musical instrument digital interface (MIDI)

6. Synthetic sound

7. Digital audio applications

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=UpzqCrj7QxYC&printsec=frontcover&source=gbs_ge_summary_r&cad=0#v=onepage&q&f=false

https://www.areditions.com/cmdas/DAS22/DAS22_Sample_Pages.pdf

Page 12: MM-coursebook.pdf

Sixth Subject: Audio Processing and Coding

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson aimed to describe the steps of digital audio processing and to apply in different fields of multimedia. At the end of the lesson, the students will be able to:

Understand the basic steps of digital audio processing Presents the basics of continuous – time (analog) signals Characterize the frequency spectrum of analog signals Describe the basics of analog filters and subsequently describe

discrete time signals Understand the fundamentals of transforms that represent the

spectra of digital sequences Develop their own algorithms to apply on digital audio in different

fields of multimedia

The Scientific contents and key messages:

1. Audio processing essentials

2. Spectra of analog signals

3. Review of convolution and filtering

4. Audio sampling

5. Audio transformation and coding

6. Psychoacoustics

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=QvM0jbfgTGkC&dq=Digital+audio+processing&source=gbs_navlinks_s

http://kkothman.iweb.bsu.edu/reference/soundDigitalAudio.pdf

Page 13: MM-coursebook.pdf

Seventh Subject: Fundamental Concepts in Video

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces the class to video concepts and shows how it can be used in computer-based of multimedia projects. At the end of the lesson, the students will be able to:

Consider the implications of using digital video in multimedia. Discuss video recording and how it relates to multimedia

production. Prepare digital video and images for conversion to television. Prepare for shooting and editing video for use in multimedia. Select the best video recording formats for your multimedia

project. Understand the concepts of video codec (MPEG)

The Scientific contents and key messages:

1. Types of video signals (component, composite and S-Video)

2. Analog video (NTSC, PAL and SECAM)

3. Digital video formats

4. Digital video standards

5. Digital video processing

6. Digital video applications

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=CvwO8zm3SqoC&dq=fundamental+of+Digital+video&source=gbs_navlinks_s

http://www.poynton.com/PDFs/TIDV/Basic_principles.pdf

Page 14: MM-coursebook.pdf

Eighth Subject: Multimedia Data Compression

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces the basic concepts of multimedia data compression and shows how it can be used in multimedia communication (data transfer). At the end of the lesson, the students will be able to:

Consider the implications of using data compression algorithms in multimedia.

Describe the importance of data compression for multimedia application and data delivery.

Understand the effect of multimedia data compression on quality of the reconstructed signals (audio, image, video,…).

Describe the difference between lossy and lossless multimedia data compression techniques.

The Scientific contents and key messages:

1. Introduction to data compression

2. Basic of information theory

3. Text compression

4. Image compression

5. Audio compression

6. Video compression

7. Quality assessment

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=aqQ2Ry6spu0C&dq=Multimedia+data+compression&source=gbs_navlinks_s

http://www.data-compression.com/index.shtml

Page 15: MM-coursebook.pdf

Ninth Subject: Lossless Compression Algorithms

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson examines the role played by data compression, perhaps the most important enabling technology that makes modern multimedia systems possible. This lesson also looks at lossless compression, which is, involving no distortion of the original signal once it is decompressed. At the end of the lesson, the students will be able to:

Consider the implications of using lossless data compression algorithms in multimedia.

Describe the importance of lossless data compression for multimedia application and data delivery.

Understand the effect of lossless data compression on quality of the reconstructed signals especially in medical image compression for (audio, image, video,…).

Implement some basic algorithms of lossless data compression.

The Scientific contents and key messages:

1. Introduction to lossless data compression

2. Run length coding

3. Huffman coding

4. Arithmetic coding

5. Lossless image compression

6. Lossless JPEG

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=aqQ2Ry6spu0C&dq=Multimedia+data+compression&source=gbs_navlinks_s

www.cs.cf.ac.uk/Dave/Multimedia/node207.html

Page 16: MM-coursebook.pdf

Tenth Subject: Lossy Compression Algorithms

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson looks at lossy compression, which is, involving a small distortion of the original signal once it is decompressed. For image compression in multimedia applications, where a higher compression ratio is required, lossy methods are usually adopted. At the end of the lesson, the students will be able to:

Consider the implications of using lossy data compression algorithms in multimedia.

Describe the importance of lossy data compression for multimedia application and data delivery.

Understand the effect of lossy data compression on quality of the reconstructed signals especially in larger signal file size (audio, image, video,…).

Implement some basic algorithms of lossy data compression.

The Scientific contents and key messages:

1. Introduction to lossy data compression

2. Quantization

3. Transform coding

4. DCT

5. Wavelet

6. JPEG and JPEG2000 standards

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=aqQ2Ry6spu0C&dq=Multimedia+data+compression&source=gbs_navlinks_s

http://faculty.kfupm.edu.sa/ics/lahouari/Teaching/slide8.pdf

Page 17: MM-coursebook.pdf

Eleventh Subject: Basic Image Compression Techniques

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson motivates the development of many image compression standards for various applications and needs. It also explores the standard JPEG definition, used in most images on the web. At the end of the lesson, the students will be able to:

Consider the implications of using image compression in multimedia applications.

Describe the importance of image compression for multimedia application and data delivery.

Implement some basic algorithms for medical image data compression.

The Scientific contents and key messages:

1. Main steps in JPEG image compression

2. JPEG modes

3. Main steps in JPEG2000 image compression

4. Region of interest coding (RoI) for medical images

5. Comparison between JPEG and JPEG2000

6. JPEG and JPEG2000 standards

7. JBIG standard for bilevel images

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=aqQ2Ry6spu0C&dq=Multimedia+data+compression&source=gbs_navlinks_s

http://www.jpeg.org/

Page 18: MM-coursebook.pdf

Twelfth Subject: Basic Video Compression Techniques

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces to the obvious solution to video compression which is consisting of a time-ordered sequence of frames. In other words, the video has temporal redundancy. At the end of the lesson, the students will be able to:

Consider the implications of using video compression in multimedia applications.

Describe the importance of video compression for multimedia application and data delivery.

Remember that every video is different—some videos look great highly compressed, others don't.

Implement some basic algorithms for video data compression.

The Scientific contents and key messages:

1. Introduction to video compression

2. Motion estimation compensation (motion vector)

3. H261,263

4. MPEG1,2

5. MPEG4,7

6. MPEG21

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=aqQ2Ry6spu0C&dq=Multimedia+data+compression&source=gbs_navlinks_s

http://mpeg.chiariglione.org/

Page 19: MM-coursebook.pdf

Thirteenth Subject: Multimedia Communication

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces technologies for communications and addresses how to efficiently represent multimedia data and how to deliver them over a variety of networks. In the aspect of multimedia networking, special considerations for sending multimedia over the Internet and wireless networks. At the end of the lesson, the students will be able to:

Represent multimedia information Understand the basic concepts of multimedia networking Describe some multimedia communication applications Show the benefits of network QoS and application QoS Understand multimedia transport across IP networks and relevant

products such as RSVP, RTP, RTCP, multimedia in mobile network, multimedia broadcast networks

The Scientific contents and key messages:

1. Basic of multimedia networks

2. OSI network layers

3. TCP/IP protocols

4. Multiplexing technologies

5. Quality of service (QoS)

6. Multimedia over IP

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=mxevmnbD13UC&dq=multimedia+communication+technology&source=gbs_navlinks_s

http://www.knk-mpeg.com/multi.htm

Page 20: MM-coursebook.pdf

Fourteenth Subject: Multimedia Network Application

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson introduces technologies for communications and addresses how to efficiently represent multimedia data and how to deliver them over a variety of networks. In the aspect of multimedia networking, special considerations for sending multimedia over the Internet and wireless networks. At the end of the lesson, the students will be able to:

Discuss the origins of the Internet and computer networks Define bandwidth and discuss how bandwidth limitations govern

the delivery of multimedia over the Internet. Define the most common protocols used on the Internet. Describe the limitations of the World-Wide-Web for delivering

multimedia. Discuss other technologies gaining new ground on the Internet.

The Scientific contents and key messages:

1. Video conferencing

2. Media - on - Demand

3. Video – on – Demand

4. Interactive TV

5. Multimedia over wireless network

Main references of the subject:

Multimedia Over Ip and Wireless Networks Compression, Networking, and Systems, Chou and Schaar, Elsevier, 2007, ISBN 0-12-088480-1

Google books: http://books.google.com/books?id=mxevmnbD13UC&dq=multimedia+communication+technology&source=gbs_navlinks_s

http://www.ja.net/documents/services/video/benefits-of videoconferencing.pdf

Page 21: MM-coursebook.pdf

Fifteenth Subject: Multimedia Databases

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson focuses on the more standardized systems that make use of image features to retrieve images form database or from the web. However, most multimedia retrieval systems have moved toward an approach favoring multimedia content itself. At the end of the lesson, the students will be able to:

Learn how image features are indexing Learn how audio features are indexing Learn how video features are indexing Understand multimedia content based retrieval applications

The Scientific contents and key messages:

1. How should we retrieve images?

2. C-BIRD a case study

3. C-BIRD GUI

4. Search by object modeling

5. Querying on sound

6. Querying on video

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=ds6xRLdlmJgC&dq=Multimedia+Content+%E2%80%93+Based+Retrieval&source=gbs_navlinks_s

Google books:

http://books.google.com/books?id=nCnSy5XXdygC&dq=Multimedia+Retrieval&source=gbs_navlinks_s

Page 22: MM-coursebook.pdf

Sixteenth Subject: Multimedia Security

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson addresses to introduce and to overview a novel approach to multimedia security based on data-hiding technologies and demonstrates some of the main achievements in the field of digital data-hiding technologies for multimedia security. At the end of the lesson, the students will be able to:

Describe general aspects of multimedia security Understand how security of multimedia data plays an important

role in multimedia networking Learn how to secure multimedia data in the net Describe multimedia security applications in different fields

The Scientific contents and key messages:

1. Introduction to multimedia security

2. Multimedia watermarking

3. Image watermarking

4. Audio watermarking

5. Video watermarking

6. Introduction to digital rights managment

Main references of the subject:

Fundamentals of Multimedia, Li and Drew, Prentice Hall, 2004, ISBN 0-13-061872-1. (http://www.cs.sfu.ca/mmbook).

Google books: http://books.google.com/books?id=ds6xRLdlmJgC&dq=Multimedia+Content+%E2%80%93+Based+Retrieval&source=gbs_navlinks_s

http://www.cmlab.csie.ntu.edu.tw/~ipr/mmsec2007/index.php?page=syllabus

Page 23: MM-coursebook.pdf

Seventeenth Subject: Multimedia HCI

Lecturer/tutor’s name: Dr. Aree A. Mohammed

Objective: This lesson studies the Human–computer interaction as an interface between people (users) as well as computers. It is usually regarded as the connection of the computer science, design, behavioural sciences and some other fields of learning. Interaction among users as well as computers takes place at user interface (or just interface), which comprises both hardware and software. At the end of the lesson, the students will be able to:

Describe general aspects of Human computer interaction Methods for putting into practice the interfaces (example software

toolkits in addition to libraries and efficient algorithms) Techniques for estimating and contrasting interfaces Developing innovative interfaces as well as interaction methods

The Scientific contents and key messages:

1. Human

2. Machine (computer)

3. Interaction

4. Vision based interfaces

5. Multimedia interfaces

6. Recognition

7. Detection

Main references of the subject:

Human Computer Interaction, Alan Dix et al, Pearson Education, 3rd Edition, 2004.

http://www.iitg.ac.in/samit/01.pdf

Page 24: MM-coursebook.pdf

Student's feedback on the subject

Date: Course: Year: Lecturer/ tutor:

No. Evaluation Questions Subject's Level 1-5

Subjective Remarks

1 The objectives and key messages of the subject were clear

2 The contents of the subject were useful and related to the main objectives of the course

3 The materials were prepared carefully as needed

4 The lecturer/ tutor while lecturing tried to analyze the principles, contents and the important points of the subject simply and properly.

5 The lecturer/ tutor while lecturing kept my attention.

6 The lecturer/ tutor came into the classroom on time and were committed to the duration of the lecture.

7 The lecturer's behavior in the classroom was calm and respectful.

8 The slides used in the lecture were clear and attractive.

9 At the end of the lecture, the lecturer gave the students a chance for questions and comments. His/ her answers were complete.

10 The reading sources are new and compatible with the subject.

Total of the levels

Standards to evaluate the level of the contents

1 2 3 4 5

Very bad

Bad Medium Good Very good

Page 25: MM-coursebook.pdf

Exams

The course exam is divided on two semesters. Course is graded on the basis of answers to exam questions. Very good grade is obtained when exam questions are correctly answered and exercises are done. The exam duration normally about 2 hours and the number of questions are 4 to 5 questions. The marks are equally distributed on each question. The question style consists of comprehensive, computation and multiple choices.

To successfully pass the exams I advise the students to follow these answering techniques:

o Read the questions more than one time.

o Think carefully before answering.

o Use draft papers for computation questions.

o The answer should contain preface, main contents and conclusion.

o The answers must be well organized according to the question numbers.

Assessment

Final Examination 50% Continuous Assessment 50%

1st semester (theory+lab) 20% 2nd semester (theory+lab) 20%

Final project 10% Total 100%

Page 26: MM-coursebook.pdf

Samples of the expected questions and their answers

Academic Year: 2010-2011 Examination Period: Final Examination Paper Title: Multimedia Duration: 3 hours

Multimedia Questions:

Q1/ (6 marks)

a. Define the following respective to sound (i) Waveform (ii) Frequency (iii) Amplitude

b. Define the following respective to video (i) Frame Rate (ii) Interlaced Video (iii) Progressive Scan

Q2/ (10 marks)

a. Design and plot a (Butterworth High pass Filter) of 3rd order when the cutoff frequency = 20 for the following input data:

D(u,v) = 0, 5, 10, 15, 20, 25, 30, infinity

Knowing that:

HHP (u, v) = 1 – HLP (u, v)

b. Select the correct answer 1. Surround sound means

a. mono b. stereo c. multi-channels d. non of them

2. Mid frequency in a given image needs

a. lowpass filter b. highpass c. bandpass d. all of them

Page 27: MM-coursebook.pdf

3. PSNR stands for

a. Proposed System to Noise Rate b. Pick Signal to Noise Rate

c. Pick Signal to Narrow Rate d. Pick Signal to Noise Ratio

4. MIDI is a standard for

a. Text compression b. Image c. sound d. video

5. An audio recording has the following settings:- sampling rate 16000 samples per second- 32 bits per sample. An audio file size after the recording is 4 kilobytes. How long is the audio recording (in msec)?

a. 46 b. 64 c. 16 d. 26

Q3/ (18 marks)

a. What is the difference between UDP and RTP Internet protocols? b. Describe the multimedia networking considerations. c. Give a block diagram of the video and audio transmission using RTP.

Q4/ (16 marks)

a. Explain in detail the real and non real time multimedia applications. b. Draw the block diagram of JPEG decoder. c. For the image block shown in figure below, 1. Draw its histogram. 2. Determine the output applying on these points

{(3,3), (4,3),(5,3);(3,4),(4,4),(5,4);(3,5),(4,5),(5,5)}

of the following filter using correlation method.

3. Draw the new histogram distribution 4. What is the type of filter?

3 4 5 4 4 3 1

2 3 5 5 4 2 0

Page 28: MM-coursebook.pdf

2 3 3 5 5 2 1

1 3 4 4 6 3 1

1 2 3 3 5 3 1

0 2 2 3 4 4 2

0 1 2 3 4 4 2

(Block of Image)

-1 0 1

-2 0 2

-1 0 1

(Filter)

Multimedia Solutions:

Q1/

A. Define the following respective to sound i. Waveform

Sound is produced by the vibration of matter. During the vibration pressure variation are created in the air surrounding it. The pattern of the oscillation is called a waveform.

ii. Frequency The frequency of the sound is the reciprocal value of the period. It represents the number of period s in a second and it is measured in Hertz (Hz) or cycles per second.

iii. Amplitude The amplitude of a sound is a measure of the displacement of the air pressure wave from its, or quiescent state

Page 29: MM-coursebook.pdf

B. Define the following respective to video i.Frame Rate

In motion pictures, television, and in computer video displays, the frame rate is the number of frames or images that are projected or displayed per second. Frame rates are used in synchronizing audio and pictures, whether film, television, or video.

ii.Interlaced Video Interlacing is a technique used to improve the picture quality of a video transmission without consuming any extra bandwidth. While interlace can improve the resolution of still images, it can cause flicker and various kinds of distortion.

iii.Progressive Scan Progressive scan is a system in which the image is displayed on a screen by scanning each line (or row of pixels) in a sequential order rather than an alternate order, as is done with interlaced scan.

Q2/

A. Design and plot a (Butterworth High pass Filter) of 3rd order when the cutoff frequency = 20 for the following input data:

D(u,v) = 0, 5, 10, 15, 20, 25, 30, infinity

Knowing that:

HHP (u, v) = 1 – HLP (u, v)

The design of the filter is shown in the following figure

Page 30: MM-coursebook.pdf

1))]20/[1/(1(1)(92.0))]20/30[1/(1(1)30(79.0))]20/25[1/(1(1)25(5.0))]20/20[1/(1(1)20(1511.0))]20/15[1/(1(1)15(01538.0))]20/10[1/(1(1)10(

000244.0))]20/5[1/(1(1)5(0))]20/0[1/(1(1)0(

6

6

6

6

6

6

6

6

HHHHHHHH

Now we can plot H(u,v) versus D(u,v) as shown in figure below

Page 31: MM-coursebook.pdf

B. Select the correct answer 1. c 2. c 3. d 4. c 5. b

Q3/

A. What is the difference between UDP and RTP Internet protocols?

UDP RTP

Stand for User Datagram Protocol Stand for Real Time Protocol

Can be applied on unicast Can be applied on unicast and multicast

Not guarantee data packets arrive in the original order

Guarantee data packets arrive in the original order grace to

timestamping

Contain few parameters in the header packets

Contain more parameters in the header packets (payload type,

sequence number, …)

Example audio and video transmission

Video phone, video conferencing

Not provide QoS provide QoS

B. Describe the multimedia networking considerations. Characteristics of multimedia information

Large data volume Real-time property

Continuous display Delay requirement of multimedia applications

Properties of current Internet Limitation of bandwidth Best effort network, cannot guarantee quality of multimedia

applications

Page 32: MM-coursebook.pdf

Heterogeneity Different user requirements Different user network conditions

Requirements of multimedia applications on the network Delay requirement Quality requirement

Satisfactory quality of media presentation Synchronization requirement Continuous requirement (no jerky video/audio) Can tolerant some degree of information loss

C. Give a block diagram of the video and audio transmission using RTP.

Page 33: MM-coursebook.pdf

Q4/

1. Explain in detail the real and non real time multimedia applications.

A number of real time applications are available for use over networks based on computers, which are capable using audio or video.

1. Desk Top Conferencing

2. Video Conferencing or Videophone products

3. Video Mail

4. Image viewing

5. Distance learning

A number of non-real time multimedia applications are available for use over networks which can support audio or video.

1. File Transfer

2. World Wide Web

3. Image Databases

4. Multimedia mail

2. Draw the block diagram of JPEG decoder.

Page 34: MM-coursebook.pdf

3. For the image block shown in figure below, 1. Draw its histogram. 2. Determine the output applying on these points

{(3,3), (4,3),(5,3);(3,4),(4,4),(5,4);(3,5),(4,5),(5,5)} of the following filter using correlation method.

3. Draw the new histogram distribution

4. What is the type of filter?

1. Histogram of the block image

0

2

4

6

8

10

12

14

0 1 2 3 4 5 6 7

Gray Scales

Freq

uenc

y

Page 35: MM-coursebook.pdf

2.

Position Current Value New Value

(3,3) 4 17/9=2

(4,3) 6 2/9=0

(5,3) 3 17/9=2

(3,4) 3 20/9=2

(4,4) 5 0/9=0

(5,4) 3 20/9=2

(3,5) 3 13/9=1

(4,5) 4 2/9=0

(5,5) 4 18/9=2

3 4 5 4 4 3 1

2 3 5 5 4 2 0

2 3 3 5 5 2 1

1

3 4 2 0 2 1

1 2 3 2 0 2 1

0 2 2 1 0 2 2

0 1 2 3 4 4 2

New Image Block

Page 36: MM-coursebook.pdf

3. Histogram of the new block image

0

2

4

6

8

10

12

14

16

0 1 2 3 4 5 6 7

Gray Scales

Freq

uenc

y

4. The type of filter is sharpening filter

Page 37: MM-coursebook.pdf

Student's Feedback on the Course

Date: Course: Year: Lecturer/ tutor:

Evaluation Questions Subject's Level 1-5

Subjective Remarks

1 The objectives and key messages of the subject were clear

2 The contents of the subject were useful and were related to the main objectives of the course

3 The coordinator teacher had worked hard to prepare the materials

4 The coordinator teacher had worked hard to cooperate and prepare the course

5 The lecturers were carefully selected and were expert in their fields

6 The coordinator teacher gave a good attention to the students' criticisms and claims

7 Information on the Examination process was well provided

8 The questions of the exams were related to the contents of the course.

9 Total of the levels

10

There is a potential to promote and develop the course in the following areas:

Page 38: MM-coursebook.pdf

Recommended