+ All Categories
Home > Documents > Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no...

Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no...

Date post: 05-Oct-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
24
Retrographic S Sensing for the Measurement of Su urface Texture and Sha Sha ape ape Micah K. Johnson Edward H H. Adelson MIT October 9, 2009
Transcript
Page 1: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Retrographic SSensing for the Measurement of Suurface Texture and

ShaShaapeape

Micah K. JohnsonEdward HH. Adelson

MIT

October 9, 2009

Page 2: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

no

CapturingCapturing geometrygeometry

• Woodham, 1980

• Zickler, 2002

•• Goldman, 2005

• Hertzmann 2005Hertzmann, 2005

Immages removed due to copyright restrictions.

Seee: 1)) Fig. 10 (baby doll head) in Zickler, T. et al.

International Journal of Computer Vision 49, no. 2-3 (2002): 215. (PDF)

2)) Fig. 1 (cast iron teapot) in Goldman, D. B., et al. Proc. Of ICCV 2005. (PDF)

3)) Ceramic cat from Hertzmann, A., and S. Seitz. “Shape and Materials by Example: A Photometric Stereo ApproachStereo Approach.” IEEE PAMI 27 8 (2005)” IEEE PAMI 27, no. 8 (2005).

Page 3: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Surface texture and shapeSurface texture and shape

Page 4: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

CookieCookie

Paint

Cl ElClear Elasttomer

Page 5: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,
Page 6: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,
Page 7: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

t

ElastoElastoomersomers • M t i l ld b • Material shhould be

clear, soft, durable, etc.

• Have tried siliconesHave tried silicones and polyurethanes

•• Thermoplastic elastomers (TPEs)

See accompanying video “ThermoplasticSee accompanying video Thermoplastic elastomers” (lec05_tpe.mov)

Page 8: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Bake at 3350 for 30 minutes...

Page 9: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

PaaintPaaint

Page 10: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Lights, camLights, cammera, actionmera, action Sensor Ligghts

Cammera

Page 11: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Why threWhy threee lightsee lights?

shading SFSFFSFS shape

• Shape-from-shadinng

Page 12: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Multiple lightsMultiple lightss: photometrics: photometric stereo

Woodham, 1980Woodham, 1980

Page 13: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

RGB RedRGB Red

Green Blue

Page 14: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

CalibrrationCalibrration

Page 15: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

Lookup Table

B

R G

Loo GradientRGB color RGB color Lookupkup Gradient

(10,200,3) (0,-0.3)

(200,10,3) (0.2, 0.2)

Page 16: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

S rface rec constructionSurface recconstr ction

Page 17: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,
Page 18: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,
Page 19: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

See accompanying video ““20 dollar bill” (lec05_20.mov)

Page 20: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

S nyiing videoSee accompan id “Fingertip” (lec05_finger.mov)

Page 21: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

S mpanyiing videoSee accom id “Fingertip with lotioon” (lec05_finger2.mov)

Page 22: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

LimitaLimitaationsations • pends on gel• Limited depth - dep

• Some objects distoSome objects distoort when pressedort when pressed

- fingertips, cloth

Page 23: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

RetrographRetrographhic sensinghic sensing

• Inexpensive

• High-resolution

• SimpleSimple

• Portable / Interactivve

• Acknowledgementss

- Funding from NSFunding from NSSF and Adobe SystemsSF and Adobe Systems

Page 24: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,

MIT OpenCourseWarehttp://ocw.mit.edu

MAS.531 Computational Camera and Photography Fall 2009

For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.


Recommended