IMPROVING 3D TV VIEWING EXPERIENCE USING VISUAL ATTENTION MODEL

PRESENTED BY GUIDED BY

RAHUL P KRISHNAN S7L ,Roll No:52 Mrs. MARY JOSEPH

ELECRONICS AND COMMUNICATION

CONTENTS AN INSIGHT TO THE TOPIC ISSUES WITH CURRENT SYSTEM CONCEPT OF VISUAL ATTENTION INTEGRATION OF VISUAL ATTENTION

INFORMATION TO IMPROVE 3D TV VIEWING EXPERIENCE

CONCLUSION

INSIGHT TO TOPIC STRONG PUSH FOR 3D CONTENT IN THE

FIELD EXTENDED VIEWING ON 3D TV REPORTS

VISUAL DISCOMFORT,FATIGUE,STRAIN VIEWERS TEND TO FOCUS THEIR

ATTTENTION ON SPECIFIC AREAS OF INTEREST IN IMAGE

MOST OF THE 2D WORK FLOWS NOT EASILY USED IN 3D

PERCEPTIONAL ISSUES WITH 3D TV

Depth Cues :combination and conflicts

Vergence and Accommodation

Binocular fusion and Rivarlry

VISUAL ATTENTION Mechanism allowing to select

and analyze some parts of the visual field

3 major functions Alerting Orienting Searching

TWO MECHANISM Bottom Up Involuntary and unconscious Low cognitive Load Signal driven Top Down Voluntary and conscious High cognitive Load Task driven

EYE TRACKING EXPERIMENT

•RECORDS SCAN PATHS IN TERMS OF SACCADES AND FIXATIONS •IDENTIFICATION OF THE LOCATIONS OF VISUAL INTEREST IN THE CONTENT(SALIENCY) ,THUS CREATING SALIENCY MAPS

FIXATION LOW VELOCITY EYE MOVEMENT

DIRECTING A PART OF VISUAL FIELD INTO FOVEA FOR CLOSE INSPECTION OF A LOCATION

CARRY VERY HIGH INFORMATION PROCESSING

SACCADES RAPID EYE MOVEMENTS MOVING

ATTENTION BETWEEN LOCATIONS IN THE VISUAL STIMULUS

CARRY ALMOST NO INFORMATION PROCESSING

SALIENCY MAP The Saliency Map is a topographically

arranged map that represents visual saliency of a corresponding visual scene.

HOW CAN WE IMPROVE 3D TV VIEWING EXPERIENCE THROUGH VISUAL ATTENTION MODELS ?

3D TV DELIVERY CHAIN

3D VIDEO CAPTURE SHOOTING TECHNIQUE OF 2D AND 3D

ARE DIFFERENT SITUATION WHERE VIEWERS UNABLE TO

FUSE THE STEREO IMAGES AUDIENCE VISUAL ATTENTION MODEL

REPLACE THE NEED TO CONDUCT EXPERIMENTS A POSTERIORI AND COULD BE USED ON SITE

2D TO 3D CONVERSION HIGH 2D CONTENT AVAILABLE NEW TV SET HAS 2D TO 3D

CONVERSION USING INFORMATION FROM DEPTH MAP

SALIENCY MAP PARALLAX COMPUTATION

3D IMAGE SALIENCY MAP + DEPTH MAP =

COMFORT 3D

CONTENT REPURPOSING ADAPTATION OF ASPECT RATIO

DIFFERENCE

AUTOMATED CROPPING WINDOW FROM VISUAL ATTENTION MODEL(VAM)

BORDER EFFECT:CUTTING OBJECTS IN FRONT OF SCREEN INHIBITS PERCEPTION OF DEPTH

DEPTH ADAPTATION SCREEN SIZE AND VIEWING DISTANCE

AFFECTS DEPTH PERCEPTION

ADAPTIVE RENDERING OF 3 D CONTENT

SALIENCY MAP + DISPARITY MAP

AREA OF INTEREST IN ZERO PARALLAX PLANE

DOMINANT AREA

VAM

ENCODING OF 3D VIDEO SIMULCAST TRANSMISSION OF DEPTH

MAPS EXTENTION TO AVC/H.264 ,MVC (multi

view coding) IS USED MVC = STANDARD FORMAT ON BLUE

RAY ROI (region of interest) BASED

COMPRESSION CAN BE APPLIED

DECODING AND RENDERING DIBR(depth image based rendering) is

used, rely on depth map Frame freezing strategy leads to

temporal desynchronization or strong binocular rivalryERROR Switching back to 2D DISCOMFO

RT

“So main area of interest in display plane”

Adaptive error concealment in terms of visual importance

BLURRING EFFECTS Reduce accommodation vergence

conflict Simulating depth of field(DOF) uses this

method

Directs viewers attention towards a specific area of image which is in comfort zone

Localiztion of eye position

Determination of fixation point

Implementation of blur filters to non fixated layers

3D SUBTITLE Difference b/w convergence planes leads

to discomfort Largest disparity region on display

plane3D dynamics behind the displaysubtitle on display

3D dynamics changes Can adopt depth dependent subtitle

placement using VAM

CONCLUSION

Understanding of VAM is important to improve QoE of 3D tv

Informations from VAM can be integrated along delivery chain to improve 3D tv experience

Adaptation of cinema environment is necessary for success in home screen

REFERENCES WIKIPEDIA IEEE TRANSACTIONS ON BROADCASTING

VOL.57,NO.2,JUNE 2011

QUERIES