14
Three-Dimensional Imaging, Visualization, and Display
Three-Dimensional Imaging, Visualization,and Display
Bahram Javidi · Fumio Okano · Jung-Young SonEditors
Three-Dimensional Imaging,Visualization, and Display
123
EditorsBahram Javidi Fumio OkanoElectrical and Computer NHK Nippon Hoso Kyokai
Engineering Department TokyoUniversity of Connecticut JapanUSA [email protected]@engr.uconn.edu
Jung-Young SonSchool of Computer and
Communication EngineeringDaegu [email protected]
ISBN: 978-0-387-79334-4 e-ISBN: 978-0-387-79335-1DOI 10.1007/978-0-387-79335-1
Library of Congress Control Number: 2008939447
c© Springer Science+Business Media, LLC 2009All rights reserved. This work may not be translated or copied in whole or in part without the writtenpermission of the publisher (Springer Science+Business Media, LLC, 233 Spring Street, New York, NY10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connectionwith any form of information storage and retrieval, electronic adaptation, computer software, or by similaror dissimilar methodology now known or hereafter developed is forbidden.The use in this publication of trade names, trademarks, service marks, and similar terms, even if they arenot identified as such, is not to be taken as an expression of opinion as to whether or not they are subjectto proprietary rights.
Printed on acid-free paper
springer.com
This book is dedicated to the memory of friendand colleague Dr. Ju-Seog Jang (1961–2004)
Preface
The history of visual media is characterized by drawing, painting, photo,stereoscope, TV and displays, Holography, and HDTV. Three-dimensional(3-D) imaging, visualization, and display technology is the next phase in thishistorical development. There is no doubt that 3-D TV and 3-D display are thevisual media that will succeed HDTV in near future. The evolutionary mergingof communication and broadcast technologies will be enhanced by 3-D visu-alization, including multimedia communication centers which can respond toall the services and functions provided by the future communication systems.
Comparison of a scene presented by 2-D and 3-D images reveals that the3-D image provides much more pleasing and realistic information than its 2-Dversion. The benefits provided by 3-D images result from the depth informa-tion they preserve. Depth gives viewers the feeling of being in the place wherethe 3-D image is captured (i.e., immersive feeling) and the feeling of beingpresent (presence feeling). Depth increases efficiencies in remote site opera-tions, such as remote medical and tele–operations, by making viewers perceivethe scene as more real from within their living environments. The accuracyand the presence feeling are the main motives of demands for 3-D images in theareas of communication, broadcasting, entertainment, medical operations, vir-tual world presentations, advertisement, training, edutainment (education +entertainment), telemarketing, tele-presence, tele-conference, visualization ofexperimental results, and so on.
The presence feeling will be more enhanced if users can interact with the3-D images displayed on the screen/display panel. In this case, the imageshaving real object sizes will probably create a better environment for presencefeeling, that is, ”super presence feeling.” The ultimate goal of communicationis providing the communication partners with the real feeling of being in thesame place and interacting face-to-face with each other. Without 3-D images,it would be difficult to achieve this goal. 3-D images should be user-friendlyand provide natural sense of depth. The multi-view 3-D imaging methodsare intended to provide a natural sense of depth by equally de-magnifyingobject images in all three coordinates to fit into the display device, instead of
vii
viii Preface
exaggerating the depth sense to maximize visual effect as in the stereoscopicimaging methods.
Our first edition of the book on 3-D TV and Display appeared six yearsago by Springer. During the last six years tremendous progress has been madein 3-D imaging technologies. This progress has motivated the major displaycompanies to produce their own 3-D displays. Currently, these displays are inthe production stage. The widespread use of mobile phones has created theneed to fuse communication and broadcasting technologies. As a consequence,some mobile phones are being equipped with a stereoscopic camera, and 3-Dimage service has already been provided to the mobile phone company. Thisis another reason why the major display companies in the world are trying toget into the 3-D visualization market.
The new book provides readers with an introduction as well as an overviewof the recent progress made in this field. It consists of 23 chapters describingconcepts, applications, and new developments of various areas in the field of3-D imaging, 3-D visualization, and 3-D display. These include multi-viewimage acquisition, processing, and display; digital holography; human factorsfor 3-D display, and recent use of high speed LCDs for 3-D image display.These chapters are written by some of the most active researchers in the field.
We believe that this book provides in-depth coverage of current 3-D imag-ing technologies and can be a good reference for students, engineers, andresearchers who have interests and/or are working on 3-D imaging, 3-D visu-alization, and 3-D display.
We wish to thank the authors, many of whom are our friends andcolleagues, for their outstanding contributions to this book.
This book is dedicated to the memory of our friend and colleague, Dr. JuSeog Jang (1961–2004).
Storrs, CT Bahram JavidiTokyo Fumio OkanoSeoul Jung-Young Son
Contents
Part I 3-D Image Display and Generation TechniquesBased on I.P
1 Three-Dimensional Integral Television UsingHigh-Resolution Video System with 2000Scanning Lines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Fumio Okano, Jun Arai, Kohji Mitani, and Makoto Okui
2 High Depth-of-Focus Integral Imaging withAsymmetric Phase Masks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25Albertina Castro, Yann Frauel, and Bahram Javidi
3 Integral Imaging Using Multiple Display Devices . . . . . . . . . 41Sung-Wook Min, Yunhee Kim, Byoungho Lee,and Bahram Javidi
4 3-D to 2-D Convertible Displays Using LiquidCrystal Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55Byoungho Lee, Heejin Choi, and Seong-Woo Cho
5 Effect of Pickup Position Uncertainty inThree-Dimensional Computational Integral Imaging . . . . . . 79Mehdi DaneshPanah, Behnoosh Tavakoli, Bahram Javidi,and Edward A. Watson
6 3-D Image Reconstruction with Elemental ImagesPrinted on Paper . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Daesuk Kim and Bahram Javidi
ix
x Contents
Part II Multiview Image Acquisition, Processing and Display
7 Viewing Zones of IP and Other Multi-viewImage Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109Jung-Young Son
8 Rich Media Services for T-DMB: 3-D Videoand 3-D Data Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131BongHo Lee, Kugjin Yun, Hyun Lee, Sukhee Cho, Namho Hur,Jinwoong Kim, Christoph Fehn, and Peter Kauff
9 Depth Map Generation for 3-D TV: Importance ofEdge and Boundary Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153Wa James Tam, Filippo Speranza, and Liang Zhang
10 Large Stereoscopic LED Display by Use of a ParallaxBarrier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183Hirotsugu Yamamoto, Yoshio Hayasaki, and Nobuo Nishida
11 Synthesizing 3-D Images with Voxels . . . . . . . . . . . . . . . . . . . . . . . 207Min-Chul Park, Sang Ju Park, Vladmir V. Saveljev,and Shin Hwan Kim
12 Multi-view Image Acquisition and Display . . . . . . . . . . . . . . . . . 227Sung Kyu Kim, Chaewook Lee, and Kyung Tae Kim
13 3-D Video Processing for 3-D TV . . . . . . . . . . . . . . . . . . . . . . . . . . . 251Kwanghoon Sohn, Hansung Kim, and Yongtae Kim
Part III 3-D Image Acquisition, Processing and DisplayBased on Digital Holography
14 Imaging 3-D Objects by Extending the Depth of Focusin Digital Holography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281Pietro Ferraro, Simonetta Grilli, Giuseppe Coppola,and Sergio De Nicola
15 Extraction of Three-dimensional Information fromReconstructions of In-Line Digital Holograms . . . . . . . . . . . . . 303Conor P. McElhinney, Bryan M. Hennelly, Bahram Javidi,and Thomas J. Naughton
Contents xi
16 Polarimetric Imaging of 3-D Object by Use ofWavefront-Splitting Phase-Shifting Digital Holography . . . 333Takanori Nomura and Bahram Javidi
17 Three-dimensional Display with Data Manipulationbased on Digital Holography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345Osamu Matoba
Part IV Other 3-D Image Acquisition and DisplayTechniques, and Human Factors
18 A 3-D Display System Using Motion Parallax . . . . . . . . . . . . . 363Hiroshi Ono and Sumio Yano
19 Dynamic Three-Dimensional Human Model . . . . . . . . . . . . . . . 373Y. Iwadate
20 Electronic Holography for Real Objects Using IntegralPhotography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 389Tomoyuki Mishina, Jun Arai, Makoto Okui, and Fumio Okano
21 Working Towards Developing Human HarmonicStereoscopic Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417Masaki Emoto and Hirokazu Yamanoue
22 Development of Time-Multiplexed AutostereoscopicDisplay Based on LCD Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 467Dae-Sik Kim, Sergey Shestak, Kyung-Hoon Cha, Jae-Phil Koo,and Seon-Deok Hwang
23 3-D Nano Object Recognition by Use of Phase SensitiveScatterometry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 493Daesuk Kim, Byung Joon Baek, and Bahram Javidi
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 503
Contributors
Jun Arai NHK (Japan Broadcasting Corporation) Science & TechnicalResearch Laboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan,[email protected]
Byung Joon Baek Division of Mechanical & Aero System Engineering,Chonbuk National University, Jeonju 561-756, Republic of Korea
Albertina Castro Instituto Nacional de Astrofısica, Optica y Electronica,Apartado Postal 51, Puebla, Pue. 72000, Mexico, [email protected]
Kyung-Hoon Cha Samsung Electronics Co., Ltd., Suwon, Republic ofKorea
S. Cho Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Seong-Woo Cho School of Electrical Engineering, Seoul NationalUniversity, Seoul 151-744, Republic of Korea
Heejin Choi School of Electrical Engineering, Seoul National University,Seoul 151-744, Republic of Korea
Giuseppe Coppola Istituto di Microelettronica e Microsistemi, ConsiglioNazionale delle Ricerche, Via Campi Flegrei 34, 80078 Pozzuoli (Napoli),Italy
Mehdi Danesh Panah Department of Electrical and ComputerEngineering, U-2157, University of Connecticut, Storrs, CT 06269-2157,USA
Masaki Emoto NHK (Japan Broadcasting Corporation) Science &Technical Research Laboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo157-8510, Japan, [email protected]
C. Fehn Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut, Einsteinufer 37, 10587 Berlin, Germany, [email protected]
xiii
xiv Contributors
Pietro Ferraro Istituto Nazionale di Ottica Applicata, Consiglio Nazionaledelle Ricerche, Via Campi Flegrei 34, 80078 Pozzuoli (Napoli), Italy,[email protected]
Yann Frauel Departaments de Ciencias de la Computation, Institutode investigaciones en Matematicas Aplicadas y en Sistemas, UniversidadNacional Autonoma de Mexico
Simonetta Grilli Istituto Nazionale di Ottica Applicata, ConsiglioNazionale delle Ricerche, Via Campi Flegrei 34, 80078 Pozzuoli (Napoli),Italy
Yoshio Hayasaki Center for Optical Research & Education (CORE)Utsunomiya University, Japan
Bryan M. Hennelly Department of Computer Science, National Universityof Ireland, Maynooth, County Kildare, Ireland
N. Hur Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Seon-Deok Hwang Samsung Electronics Co., Ltd., Suwon, Republic ofKorea
Y. Iwadate NHK (Japan Broadcasting Corporation) Science & TechnicalResearch Laboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan,[email protected]
Bahram Javidi Department of Electrical and Computer Engineer-ing, University of Connecticut, U-2157, Storrs, CT 06269-2157, USA,[email protected]
P. Kauff Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut, Einsteinufer 37, 10587 Berlin, Germany, [email protected]
Dae-Sik Kim Samsung Electronics Co., Ltd., Suwon, Republic of Korea,[email protected]
Daesuk Kim Division of Mechanical & Aero System Engineering,Chonbuk National University, Jeonju 561-756, Republic of Korea,[email protected]
Hansung Kim Knowledge Science Lab, ATR, Kyoto, Japan
Shin Hwan Kim School of Computer and Communication Engineering,Daegu University, South Korea, [email protected]
J. Kim Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Kyung Tae Kim Department of Information and CommunicationEngineering, Hannam University, Daejeon, Korea
Contributors xv
Yongtae Kim School of Electrical and Electronic Engineering, YonseiUniversity, Seoul, Republic of Korea
Yunhee Kim School of Electrical Engineering, Seoul National University,Seoul, Republic of Korea
Sung Kyu Kim Imaging media center, Korea Institute of Science andTechnology, Seoul, Korea, [email protected]
Jae-Phil Koo Samsung Electronics Co., Ltd., Suwon, Republic of Korea
B. Lee Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Byoungho Lee School of Electrical Engineering, Seoul National University,Seoul 151-744, Republic of Korea, [email protected]
Chaewook Lee School of Computer and Communication Engineering,Daegu University, Kyungsan, Kyungbuk, Korea
H. Lee Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Osamu Matoba Department of Computer Science and SystemsEngineering, Kobe University, Rokkodai 1-1, Nada, Kobe 657-8501, Japan,[email protected]
Conor P. McElhinney Department of Computer Science, National Uni-versity of Ireland, Maynooth, County Kildare, Ireland, [email protected]
Sung-Wook Min Department of Information Display, Kyung HeeUniversity, Seoul, Republic of Korea, [email protected]
Tomoyuki Mishina NHK Science & Technical Research Laboratories,1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan, [email protected];National Institute of Information and Communication Technology, 4-2-1,Nukui-Kitamachi, Koganei, Tokyo 184-8795, Japan, [email protected]
Kohji Mitani NHK (Japan Broadcasting Corporation) Science & TechnicalResearch Laboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan,[email protected]
Thomas J. Naughton Department of Computer Science, NationalUniversity of Ireland, Maynooth, County Kildare, Ireland; University ofOulu, RFMedia Laboratory, Oulu Southern Institute, Vierimaantie 5, 84100Ylivieska, Finland
Sergio De Nicola Istituto di Cibernetica “E. Caianiello”, ConsiglioNazionale delle Ricerche, Via Campi Flegrei 34, 80078 Pozzuoli (Napoli),Italy
Nobuo Nishida Department of Optical Science and Technology, TheUniversity of Tokushima, 2-1 Minamijosanjima, Tokushima 770-8506, Japan
xvi Contributors
Takanori Nomura Department of Opto-Mechatronics, WakayamaUniversity, 930 Sakaedani, Wakayama 640-8510, Japan,[email protected]
Fumio Okano NHK (Japan Broadcasting Corporation) Science & TechnicalResearch Laboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan,[email protected]
Makoto Okui National Institute of Information and CommunicationTechnology, 4-2-1, Nukui-Kitamachi, Koganei, Tokyo 184-8795, Japan;NHK (Japan Broadcasting Corporation) Science & Technical ResearchLaboratories, 1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan,[email protected]
Hiroshi Ono Centre for Vision Research and Department of Psychology,York University, Toronto, Ontario M3J 1P3, Canada, [email protected]
Min-Chul Park Intelligent System Research Division, Korea Institute ofScience and Technology, seoul, South Korea, [email protected]
Sergey Shestak Samsung Electronics Co., Ltd., Suwon, Republicof Korea
Vladmir V. Saveljev Whole Imaging Laboratory, Hanyang University,Seoul, South Korea, [email protected]
Sang Ju Park School of Electronic and Electrical Engineering, HongikUniversity, Seoul, South Korea, [email protected]
Kwanghoon Sohn School of Electrical and Electronic Engineering, YonseiUniversity, Seoul, Republic of Korea, [email protected]
Jung-Young Son Center for Advanced Image, School of Informationand Communication Engineering, Daegu University, Kyungsan, Kyungbuk,Republic of Korea, [email protected]
Filippo Speranza Communications Research Centre Canada, 3701 CarlingAvenue, Ottawa, Ontario, Canada K2H 8S2, [email protected]
Wa James Tam Communication Research Centre Canada, 3701 CarlingAvenue, Ottawa, Ontario, Canada K2H 8S2, [email protected]
Behnoosh Tavakoli Department of Electrical and Computer Engineering,U-2157, University of Connecticut, Storrs, CT 06269-2157, USA
Edward A. Watson U.S. Airforce Research Laboratories, Wright PattersonAir Force Base, OH 45433, USA, [email protected]
Hirotsugu Yamamoto Department of Optical Science and Technology,The University of Tokushima, 2-1 Minamijosanjima, Tokushima, 770-8506,Japan, [email protected]
Contributors xvii
Hirokazu Yamanoue Science & Technical Research Laboratories, JapanBroadcasting Corporation (NHK), 1-10-11, Kinuta, Setagaya-ku, Tokyo157-8510, Japan
Sumio Yano NHK Science & Technical Research Laboratories,1-10-11, Kinuta, Setagaya-ku, Tokyo 157-8510, Japan, [email protected];National Institute of Information and Communication Technology, 4-2-1Nukui-Kitamachi, Koganei, Tokyo 184-8795, Japan, [email protected]
K. Yun Electronics and Telecommunications Research Institute, 161Gajeong-dong, Yuseong-gu, Daejeon, Republic of Korea, [email protected]
Liang Zhang Communications Research Centre Canada, 3701 CarlingAvenue, Ottawa, Ontario, Canada K2H 8S2, [email protected]
