Post on 10-May-2020
transcript
2
Virtual Automotive: Projection Mapped Graphics for Automotive Design
Roy C. Anthony Kevin Moule
Who we are • Roy C. Anthony
• Leads research initiatives creating new concepts and technologies designed to benefit Christie's extensive, global customer base.
• Kevin Moule • Focused on developing machine vision based system for automatically
warping and blending multi-projector displays.
3
Christie at a Glance
4
At Christie we help our customers create and share the world’s best visual experiences.
Christie at a Glance
5
Christie at a Glance
6
Entertainment Solutions Business Products
Visual Environment - Visualization Visual Environment - Simulation
Projection Mapping
? 7
8
Projection Mapping • What can Projection Mapping
offer? • A “wow-factor”. • Cost-effective transformation of any
space • The projected image is mapped to fit
the surface and space .
9
Projection Mapping • What can Projection Mapping
offer? • A “wow-factor”. • Cost-effective transformation of any
space • The projected image is mapped to fit
the surface and space .
10
Projection Mapping • What can Projection Mapping
offer? • A “wow-factor”. • Cost-effective transformation of any
space • The projected image is mapped to fit
the surface and space .
11
Projection Mapping • What can Projection Mapping
offer? • A “wow-factor”. • Cost-effective transformation of any
space • The projected image is mapped to fit
the surface and space .
12
13
14
25 March 2014 CONFIDENTIAL 15
25 March 2014 CONFIDENTIAL 16
Projection Mapping • For traditional megapixel displays Christie
develops technologies like TWIST and AutoSTACK • Allow projection images to be warped and
blended automatically • Supports typical screen shapes • Supports techniques such as overlaying
multiple projected images for brightness
17
18
19
CONFIDENTIAL 20
Projection Mapping
21
Projection Mapping
Projection Mapping • Problems?
• Approach and tools can be
ad-hock, using a custom production pipeline
• Every job may be uniquely built, with few reusable parts
• Workflow is “whatever works”
22
Projection Mapping • So given this, we tried it!
• Used commonly accepted
popular toolkit • COTS projector and an
irregular surface to project onto.
• Enabled 2D Mask workflow with custom masking pipeline
23
Projection Mapping • We wanted something reusable…
• We wanted higher quality • We wanted to augment
existing design tools and technologies
• We wanted to integrate a pipeline and design solution that enables tool creation
24
Projection Mapping • We wanted something reusable…
• We wanted higher quality • We wanted to augment
existing design tools and technologies
• We wanted to integrate a pipeline and design solution that enables tool creation
25
Projection Mapping • We wanted something reusable…
• We wanted higher quality • We wanted to augment
existing design tools and technologies
• We wanted to integrate a pipeline and design solution that enables tool creation
26
Retrieved from GPUTech 2013 On Demand, Ralph Gilles SVP Chrysler talk http://on-demand.gputechconf.com/gtc/2013/video/S3902-Gilles-SRT-GPU-Motorsports-Chrysler.mp4
Projection Mapping • We wanted something reusable…
• We wanted higher quality • We wanted to augment
existing design tools and technologies
• We wanted to integrate a pipeline and design solution that enables tool creation
27
Retrieved from GPUTech 2013 On Demand, Ralph Gilles SVP Chrysler talk http://on-demand.gputechconf.com/gtc/2013/video/S3902-Gilles-SRT-GPU-Motorsports-Chrysler.mp4
WE BUILT SOMETHING ELSE…
28
29
Inspiration • Automotive and other design applications frequently use scale
prototypes as a design verification step
30
Retrieved from Oobject, a Curations Creation http://www.oobject.com/category/12-clay-car-mockups/
Retrieved from Oobject, a Curations Creation http://www.oobject.com/category/12-clay-car-mockups/
Inspiration • Clay models for automotive design
in particular are ubiquitous • Static and Expensive to produce • Frequently finished, alterations can
take quite a bit of time to execute • Tools have evolved for generating
the models, opportunities still exist for taking this further...
31
Retrieved from Car Body Design http://www.carbodydesign.com/archive/2008/06/02-mercedes-benz-new-design-studio-california/
Inspiration • Clay models for automotive design
in particular are ubiquitous • Static and Expensive to produce • Frequently finished, alterations can
take quite a bit of time to execute • Tools have evolved for generating
the models, opportunities still exist for taking this further...
32
Retrieved from Oobject, a Curations Creation http://www.oobject.com/category/12-clay-car-mockups/
Inspiration • Clay models for automotive design
in particular are ubiquitous • Static and Expensive to produce • Frequently finished, alterations can
take quite a bit of time to execute • Tools have evolved for generating
the models, opportunities still exist for taking this further...
33
Photo Credit, Aaron Gold, 2007 Los Angeles Auto Show http://cars.about.com/od/autoshows/ig/2007-LA-Auto-Show-pics/Mazda-Clay-Concept-LAAS07.htm
Inspiration • Clay models for automotive design
in particular are ubiquitous • Static and Expensive to produce • Frequently finished, alterations can
take quite a bit of time to execute • Tools have evolved for generating
the models, opportunities still exist for taking this further...
34
Retrieved from Oobject, a Curations Creation http://www.oobject.com/category/12-clay-car-mockups/
Inspiration • Clay models for automotive design
in particular are ubiquitous • Static and Expensive to produce • Frequently finished, alterations can
take quite a bit of time to execute • Tools have evolved for generating
the models, opportunities still exist for taking this further...
35
Retrieved from Oobject, a Curations Creation http://www.oobject.com/category/12-clay-car-mockups/
Inspiration • Reproduce and augment the clay
experience through Projected Light • Add dynamic details with the use of
projection • Provide a path for iterative design • Rendered visuals and background to
generate an immersive experience and integrate the model within a virtual space
36
37
Retrieved from AutoBlog, Jaguar designers deconstruct XF Clay model -- http://www.autoblog.com/2012/06/06/jaguar-designers-deconstruct-xf-clay-model-with-axes/
Problem/Challenges • Display Design
• Megapixel canvas support • Resolution in PPI required • Image quality from DEP • Interactivity
• 3D printing a car • Rendering, clustering, graphics • Warping/blending
38
Problem/Challenges • Display Design
• Megapixel canvas support • Resolution in PPI required • Image quality from DEP • Interactivity
• 3D printing a car • Rendering, clustering, graphics • Warping/blending
39
Designing a megapixel canvas • Placing the car with in an enclosed
environment provides a more immersive experience
• MicroTiles provide excellent pixel density and good ambient light rejection
40
Designing a megapixel canvas • Projector location needs to be chosen
that fit physically within in the display but also provide sufficient coverage
• Many other factors come into play • Brightness • Pixel shape • Warping required • Shadows
41
Designing a megapixel canvas • A simulation of the car and
projectors is an essential design tool in optimizing image quality
• Achieving a desired PPI density is crucial in creating a compelling life-like experience
42
43
Picture Quality • Pixel Per Inch (PPI)
• Target: 50-100 PPI
Channel 1
Channel 2
Channel 3
Display Development • Pixel pitch dictates projection coverage,
from an initial Design Eye Point • 43 Microtiles used to aid in integrating
120 degree H-FOV from the User DEP • Further optimization for coverage
considered increased horizontal viewer positions
44
Design Engineering, Shawn Mills
Display Development • Pixel pitch dictates projection coverage,
from an initial Design Eye Point • 43 Microtiles used to aid in integrating
120 degree H-FOV from the User DEP • Further optimization for coverage
considered increased horizontal viewer positions
45
Design Engineering, Shawn Mills
3D Printing a model for projection • Cost effective • Starts with the existing 3D Asset • 3D Asset is also required for the graphics
application • Some processes are need to craft a good
model for printing • “shell”-ing • Internal support structure • Shadow elimination
46
Adapting a model for 3D printing and projection
47
• Removing details to avoid shadows when projecting • Details will be added back via projection • Simplifies the model for 3D printing
Adapting a model for 3D printing and projection
48
• Removing details to avoid shadows when projecting • Details will be added back via projection • Simplifies the model for 3D printing
Rendering/Clustering • Computing power
• 7x HP z620 / z820 • Cluster is spit into two, for rendering
the car versus the backdrop.
• Balancing and synchronizing the car and backdrop • 12 NVIDIA k5000 with Quadro gSync
49
Rendering/Clustering • Real-Time Graphics engine
• We use RTT DeltaGen r11 for generating visuals, RTT is a market leader in design visualization within automotive
• For simplicity both clusters are running DeltaGen Master/Slave and share the asset database and just suppress some information at init time
50
51
RTT DeltaGen Virtual World Building • The virtual world
• Allowed for Pre Visualization of all display surfaces, and final 3D Asset in its final position
• This quality virtual rig aids in display calibration prior to runtime
• Helps the artists develop the scene prior to final integration with the display product
52
RTT DeltaGen Virtual World Building • The virtual world
• Allowed for Pre Visualization of all display surfaces, and final 3D Asset in its final position
• This quality virtual rig aids in display calibration prior to runtime
• Helps the artists develop the scene prior to final integration with the display product
53
RTT DeltaGen r11 Scene Configuration
54
R&I: Audi R8 Projection Map Interactive Experience
Asset Design &Print Virtual World Design Final Rendered Result Asset Design &Print
Warping and Blending • Ideally the projected image is
rendered from the projector’s location
• Not always possible • Limitations in application software • Lighting and reflections may be wrong
55
Warping and Blending • The viewer’s location is where the
image needs to look right • Rendering the image from the
viewer’s location is where typical application do this
56
Warping and Blending • Warping is the transformation that
corrects the projector’s image for the viewer.
• Allows us to account for many factors • Physical geometry errors • Intermediate view points • Lens distortion
57
Warping and Blending • Careful planning on the design side
is needed to minimize the amount of warping necessary
• Optimizing the eye point and other view parameters (FOV, etc.) can also help.
58
Warping and Blending • Careful planning on the design side
is needed to minimize the amount of warping necessary
• Optimizing the eye point and other view parameters (FOV, etc.) can also help.
59
Warping and Blending • Careful planning on the design side
is needed to minimize the amount of warping necessary
• Optimizing the eye point and other view parameters (FOV, etc.) can also help.
60
Warping and Blending • NVIDIA Warp + Intensity API enables the warping and blending • The API is a low level warping engine that need additional software
support • Ideal for us because we can layer our existing projector based warping
tools (Twist/AutoCal) on top • Ideal for the application because the warping support is baked into the
driver, no need for software changes
61
Results – 3D Surface in a Virtual World
62
Results – Projector/Viewer Calibration
63
Results – Reflection and Colour, Final
64
65
Integrated Result – Reflection and Colour, Final
Future work • The car looks great but requires a lot of time
• Both in setup and design
• How to make it faster and better? • Aim to formalizing workflow, enabling broader use
66
Automation • Machine vision and
structured light • Reduced manual calibration
of warping and blending
• Expand our existing AutoCal solution to handle more complex geometry
67
Automation • Feed key information up
stream • Projection locations • Which model to use • Model orientation
• Create a unified system, a software platform to tie the virtual and physical worlds together
68
Advanced canvas correction • Front projection leads to global
illumination effects • Ruins contrast • Does not give a faithful reproduction of
the content
• Attempt to compensate for indirect lighting contribution
• Use white and black level blending for correction
69
Full Light
Advanced canvas correction • Front projection leads to global
illumination effects • Ruins contrast • Does not give a faithful reproduction of
the content
• Attempt to compensate for indirect lighting contribution
• Use white and black level blending for correction
70
Direct Light
Advanced canvas correction • Front projection leads to global
illumination effects • Ruins contrast • Does not give a faithful reproduction of
the content
• Attempt to compensate for indirect lighting contribution
• Use white and black level blending for correction
71
Indirect Light
Advanced canvas correction
72
Previsualization • CAD For Projection Mapping • Tailored tools, for:
• Lumens, brightness • Coverage, shadowing • Warping, blending
• Leads to simulation and eventually virtualization of whole process
73
74
Conclusion • Effective 3D Projection Mapping
• Includes a fully 3D workflow • Uses 2D Masking and warping
sparingly • Integrates Content Creators needs and
where possible full DCC solutions
• Create opportunities for further tool and technology development
Cheers!