Stereoscopic Image Transforms to Autostereoscopic Multiplexed
Image Wei-Ming Chen, Chi-Hao Chiou and Sheng-Hao Jhang Computer
Science and Automation Engineering (CSAE), 2011
Slide 3
Outline Introduction Related Work Proposed Method Experimental
Results Conclusion 3
Slide 4
Introduction 4
Slide 5
3D technologies have become popular in recent years. Widely
applied to movie, films and show. In early 3D vision technology:
Anaglyph Polarization Shutter 5 With special glasses
Slide 6
Anaglyph Glass
Slide 7
Polarization Glass
Slide 8
Shutter Glass
Slide 9
Introduction Autostereoscopic 3D display Non-glass system
Propose a new technique for generating Autostereoscopic multiplexed
content. 9 Objective:
Slide 10
Related Work 10
Slide 11
Disparity Vertical Parallax Usually = 0 focus on horizontal
parallax Horizontal Parallax Identify the distance of the
object
Slide 12
Disparity retina
Slide 13
Image Rectification Zero Parallax Zero parallax plane
Slide 14
Image Rectification Simplified to one dimension -
horizontal
Slide 15
Solution : All epipolar lines are parallel in the rectified
image plane. Image Rectification
Slide 16
3D coordinate of real scene: Disparity to Depth f : focal
length b : the length of baseline d : disparity (u 0, v 0 ) :
coordinate of image center (camera intrinsic parameter matrix K)
(u, v) : pixel coordinate Du Xin, Zhu Yun-fimg, "A Flexible Method
for 3D Reconstruction of Urban Building", ICSP 2008 proceedings.
Baseline Epipolar line
Slide 17
3D Reconstruction Wei-wei Ma, My-Ha Le, Kang-Hyun Jo, "3D
Reconstruction and Measurement of Indoor Object Using Stereo
Camera", The 6th International Forum on Strategic Technology,
2011.
Slide 18
Autostereoscopic 3D display Time-multiplexed Switch rapidly
(left and right images) 2D & 3D : same resolution
Spatial-multiplexed Parallax barrier Lenticular lenses Lower
resolution for 3D 18
Slide 19
Autostereoscopic 3D display Parallax barrier 19 Lenticular
lenses
Slide 20
Proposed Method 20
Slide 21
System Flow of Depth-map Generation 21 Stereo matching
Slide 22
Depth-map Generation 1) Feature point detection Use SURF
algorithm [5] (based on SIFT) 2) Epipolar Geometry Matching the
feature points 3) Interpolation Estimate the pixels which is not
feature points 4) Graphcut Grouping the close pixels (segmentation)
22 Disparity between stereo images [5] H. Bay, A. Ess, T.
Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF),"
Computer Vision and Image Understanding, vol. 110, pp. 346-359,
2008.
Slide 23
System Flow of Synthesis 23
Slide 24
Zero-parallax setting The most comfortably distance between
user and display could be determined from Z c. Z c ( Base plane) 24
Z far : the highest depth map value Z near : the lowest depth map
value
Slide 25
Pre-processing the Depth Map Mean filter Gaussian filter
25
Slide 26
3D-image Warping Multi-View Need large storage space use depth
map to create virtual views Warping Reference view Virtual view 26
warp
Slide 27
3D-image Warping Multi-View Need large storage space use depth
map to create virtual views 27 Warping
Slide 28
3D-image Warping Lenticular autostereoscopic display DIBR 28
S0S0 The pixel position of the center view k View ID ( K= -4 ~ 4 )
b The distance between two eyes ZFZF Farthest distance ZNZN Nearest
distance pzpz Depth value Pixels/cm (according to monitor) d
Distance between eyes and screen
Slide 29
Issues[*]: Disparity Range Limitations of perception and
technology Disparity Sensitivity More sensitive to nearby objects
Disparity Gradient Disparity Velocity Temporal information 3D-image
Warping 29 [*] :Lang, M., Hornung, A., Wang, O., Poulakos, S.,
Smolic, A. & Gross, M. (2010, July). Nonlinear Disparity
Mapping for Stereoscopic 3D. To appear in ACM Transactions on
Graphics (Proc. SIGGRAPH).
Slide 30
Disoccluded Regions-filling Disoccluded Regions : regions
without warped pixel 30 warp Reference view Virtual view
Slide 31
Disoccluded Regions-filling Associated with DIBR: 31 Similar to
occlusion handling
Slide 32
Disoccluded Regions-filling 32
Slide 33
Experimental Results 33
Slide 34
Experimental Results Disoccluded Regions-filling: 34 Previous
Work Proposed
Slide 35
Experimental Results 35 The six warping views The six warping
views
Slide 36
Experimental Results 36 Synthesized result
Slide 37
Conclusion 37
Slide 38
Conclusion 3D-image generation of stereo images with good 3D
effect was proposed. Future : using temporal information Stereo
images Disparity map 3D warping Hole filling Issues: Zero-parallax
setting Disparity Range / Disparity Velocity Hole filling 38
Slide 39
Reference Optical Design, Fabrication, and Measurement 3D
Introduction and Project (Dept. of Photonics & Display
Institute,National Chiao Tung University) Image Rectification
(Stereo), Guido Gerig AGENCY1903 BLOG
http://www.agency1903.com/blog/2010/8/18/z-axis-power
http://www.agency1903.com/blog/2010/8/18/z-axis-power 3D 3D (
)