+ All Categories
Home > Documents > CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel ([email protected]), Francesco...

CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel ([email protected]), Francesco...

Date post: 18-Dec-2015
Category:
Upload: pearl-whitehead
View: 215 times
Download: 0 times
Share this document with a friend
Popular Tags:
41
CRYTE K © 2010 Crytek GmbH AAA Stereo-3D in CryEngine 3 Jens Schobel ([email protected]) , Francesco Carucci ([email protected])
Transcript
Page 1: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

AAA Stereo-3D in CryEngine 3Jens Schobel ([email protected]) , Francesco Carucci ([email protected])

Page 2: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 2

Research project

Page 3: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 3

Research project

Page 4: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 4

Depth Perception

Research project

Page 5: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 5

Popping out of the screen

Research project

Page 6: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Popping out of the screen

6

Your health is important

Page 7: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Popping out of the screen

7

Your health is important

Page 8: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

8

WHERE do we place it?

Page 9: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

• Feels natural• Depth violations

Inside the screen

9

Page 10: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

• Feels cool• More tiring for the eyes

OUT OF the screen

10

Page 11: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Color palette• Depth of field• Atmospheric effects

IN A 2D WORLD

11

Page 12: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Stereo effect strength• Convergence distance

IN A STEREO 3D WORLD

12

Page 13: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Stereo effect strength• Convergence distance• Change depth perception

IN A STEREO 3D WORLD

13

Page 14: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: Conveying mood

14

STEREO 3D AS ACOMMUNICATION TOOL

Page 15: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 15

VS

Page 16: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 16

1.5%

Page 17: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality

Rendering Twice

17

STEREO IMAGE GENERATION

Page 18: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality• dramatically reduced quality

Rendering Twice

18

STEREO IMAGE GENERATION

Page 19: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality• dramatically reduced quality• lower resolution• less special effects

Rendering Twice

19

STEREO IMAGE GENERATION

Page 20: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

Rendering Twice

20

STEREO IMAGE GENERATION

Not an option

Page 21: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

21

• single pass pixel shader

Page 22: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

22

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

Page 23: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

23

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

• surprising depth strength possible

Page 24: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

24

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

• surprising depth strength possible• full implementation by Nicolas Shulz (RnD)

Page 25: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

25

• re-project pixel into left/right camera

Page 26: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

26

• re-project pixel into left/right camera• in screen space

Page 27: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

27

• re-project pixel into left/right camera• in screen space• offset based on pixel depth

Page 28: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

28

• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting

Page 29: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

29

• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting• resample backbuffer with bilinear filtering

Page 30: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

30

• great quality with positive parallax

does it look good?

Page 31: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

31

• great quality with positive parallax• no artifacts for opaque objects• transparent objects look acceptable• slight stretching at screen edges (easy to solve)

does it look good?

Page 32: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

32

• good quality for negative parallax (popping out)

does it look good?

Page 33: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

33

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

does it look good?

Page 34: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

34

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

• artifacts for steep parallax gradient

does it look good?

Page 35: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

does it look good?

35

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

• artifacts for steep parallax gradient• smooth out depth to solve

Page 36: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

36

Page 37: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Outputting left/right

37

• PS3 Native HDMI 1.4 support

Page 38: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

Outputting left/right

38

• PS3 Native HDMI 1.4 support• XBOX360 no native stereo support frame-compatible format (SBS, LBL, ...)

encode output format in a final pass

Page 39: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

AUTOSTEREOSCOPIC

39

• Natively supported!• Output color and depth separation buffers

Page 40: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

• Nicolas Schulz - RnD• Michael Kopietz - RnD• Marco Corbetta - Crysis 2

THANKS TO…

Page 41: CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel (jenss@crytek.de), Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Questions ?

41

ASK NOW


Recommended