Transparent Object Reconstruction via Coded Transport of Intensity

Supplemental Video

Paper ID: 846

Turb

ulen

ce /

Gas

Flam

eW

ater

Glas

s

Transparent Objects

Aero

nauti

cal

Engi

neer

ing

ApplicationsGr

aphi

c Re

nder

ing

Live

Cel

l Im

agin

g

Light Field Probes

Intrusive Methods

Wet

zste

in e

t al.,

ICCP

201

1

Schlieren Imaging

Yu e

t al.,

CVP

R 20

13At

ches

on e

t al.,

SIGG

RAPH

Asia

200

8

Impe

rical

Col

lege

Lod

on

Hulli

n et

al.,

SIG

GRAP

H 20

08Tr

ifono

v et

al.,

EGS

R 20

06Related Work

Non-intrusive Methods

Collimated Coded Illumination

Moveable Sensor PlaneObject

Our Method

We propose to reconstruct transparent object using two different intensity projections based on transport of intensity equation.

Transport of Intensity

( ) ( ( ) ( , ) )c

I x I x n x z dsz x

In Volumetric Object Case: In Thin Object Case:

( ) ( ( ) ( ))I x I x n xz x

( ) ( , )v

zz

I x v l x v dvz x

Obtaining Outgoing Light Field via Transport of Intensity Equation

Collimated Coded Illumination

Moveable Sensor PlaneObject

Estimate Ray-ray Correspondences Using Spatial Intensity Codes

Light Path ApproximationCollimated

Coded IlluminationMoveable

Sensor PlaneObject

( )I x const ( )I x CodedPattern

Tomographic Volume ReconstructionCollimated

Coded IlluminationMoveable

Sensor PlaneObject

Rotating

Diffe

rent

pers

pecti

ves

3D V

olum

e

Collimated Coded Illumination Moveable Sensor Plane

Object

Sensor 1

Sensor 2

Illumination 2

Illumination 1

Sensor 3

Illumination 3

Dynamic Volume Reconstruction

…

……

…

Experimental Results

Simulation Results: Thin refractive objectSi

mul

ation

Setti

ngRe

cons

truc

tion

Target Object

Simulation Results: Homogeneous Volume

Reconstructed 2D Projections of 3D Refractive Index Field

Simulation Results: Homogeneous Volume

Reconstructedvolume

Target Object

Simulation Results: Inhomogeneous Volume

Reconstructed Isosurface and Refractive Index Field

Target Object

Our Prototype

ProjectorRefractive sample

CollimatinglensCamerasBeam splitter

& screens

Prototype Result: Thin refractive objectTa

rget

Obj

ect

Reco

nstr

ucte

dRe

nder

ed

Prototype Result: Dynamic refractive index fields

Targ

et O

bjec

t

Reco

nstr

ucte

d

Imag

e Pa

irs

Imag

e Pa

irs

Prototype Result: Refractive Volumetric Reconstruction

Reco

nstr

ucte

dvo

lum

e

Targ

et O

bjec

t

Reconstructed Refractive Index

Surface Reconstruction

-90° -45° 0° 45° 90°