JPEG Business plan Prof. Touradj Ebrahimi JPEG Convener Sunday, March 20, 2022 1 www.jpeg.org
Transcript
1. JPEG Business plan Prof. Touradj Ebrahimi JPEG Convener 27
June 2015 1www.jpeg.org
2. JPEG Family of Standards 27 June 2015 www.jpeg.org 2
3. JPEG a strong and fast growing ecosystem 27 June 2015
www.jpeg.org 3 Source: KPCB 2014 Internet Trends, estimates based
on publicly disclosed company data. 1995-96 Technology and
Engineering Emmy award (together with MPEG-2)
4. JPEG 2000 great impact on professional markets 27 June 2015
www.jpeg.org 4 2015 Technology and Engineering Emmy award (JPEG
2000 interoperability)
5. JPEG 2000 framework 27 June 2015 www.jpeg.org 5 Part 1/13
Core Codec Part 2 Extensions Part 10 3D Extensions Part 9 JPIP Part
3 MJPEG 2000 Part 6 JPM Image Codec Tools File Format Part 8 JPSEC
Part 11 JPWL Part 14 JPXML E2E Toolset Extra Functionality Codec
Tools Part 4 Compliance Testing Part 5 Reference Software Part 12
ISO Base Media
6. JPEG XR bridging a gap 27 June 2015 www.jpeg.org 6
Complexity Performance JPEG JPEG XR
7. JPEG vs JPEG 2000 vs JPEG XR 27 June 2015 www.jpeg.org
7
8. JPEG XR not widely used! 27 June 2015 www.jpeg.org 8
9. JPSearch 27 June 2015 www.jpeg.org 9 F. Temmermans, F.
Dufaux and P. Schelkens, JPSearch: Metadata Interoperability During
Image Exchange, IEEE Signal Processing Magazine, vol.29, no. 5,
pp.134-139, 2012
10. Other standards in Progress 27 June 2015 www.jpeg.org 10
Advanced Image Coding (AIC) Evaluation methodologies and metrics
JPEG AR Image exchange in Augmented Reality JPEG Systems
Consolidated system layer structure JPEG XT JPEG forward/backward
compatible HDR compression
11. Advanced Image Coding (AIC) Advanced Image Coding Part 1:
Guidelines for codec evaluation Part 2: Evaluation procedure for
assessing visually lossless coding Call for information issued in
February 2015 to receive information on next generation still image
compression with superior compression efficiency, as well as other
useful features needed in future multimedia applications PCS2015
Feature Event - Evaluation of current and future image compression
technologies Further contributions received on 69th WG1 meeting in
Warsaw, Poland 27 June 2015 www.jpeg.org 11
13. JPEG XT backward compatible HDR 27 June 2015 www.jpeg.org
13 A JPEG legacy backward & forward compatible HDR image
compression standard
14. JPEG XT design principles Exif and JFIF use APP marker of
JPEG Reserved for application segments 27 June 2015 www.jpeg.org 14
APP marker (0 to 15) Format APP0 JFIF, JFXX APP1 Exif APP2 ICC
Profile APP3 JPSearch Part2 APP14 Adobe SOI APP1 DQT DHT SOF
streamSOS EOI WG1N5725 Start of Image (SOI) APP11 (Residual JPEG
XT) JPEG-1 Code-stream End of Image (EOI) JPEG XT File
15. JPEG XT design principles Two-layer coding, with base layer
a legacy JPEG coded LDR and enhancement layer the residual to
produce the HDR Enhancement layer uses a maximum of JPEG Legacy
coding tools 27 June 2015 www.jpeg.org 15
16. JPEG XT profiles 27 June 2015 www.jpeg.org 16
17. JPEG XT compression efficiency 27 June 2015 www.jpeg.org
17
18. JPEG XT status 27 June 2015 www.jpeg.org 18 Part Title WD
CD DIS FDIS IS 1 Core Coding System 13/01 13/07 14/01 - 14/10 2
Coding of High Dynamic Range Images 13/10 14/01 14/04 - 14/10 3 Box
File Format 14/05 14/07 15/02 - 15/06 4 Conformance Testing 15/02
15/10 16/02 - 16/06 5 Reference Software 14/07 15/06 16/02 - 16/06
6 IDR Integer Coding 14/05 14/07 15/02 15/06 15/10 7 HDR
Floating-Point Coding 14/05 14/07 15/02 15/06 16/02 8 Lossless and
Near-lossless Coding 14/07 15/02 15/06 - 16/02 9 Alpha Channel
Coding 14/10 15/02 15/06 - 16/02
19. JPEG Privacy & Security Features: Access control to
specific images is defined with rules (privacy policies). Policies
are defined either by the service provider or by the image owner.
Policies define conditional access to information based on User:
individual, group, location, role, Context: date and time, number
of accesses, action (view, download, ), etc. Image: quality,
geolocation, author, date, semantic information, etc. Action: read,
update, delete, etc. 27 June 2015 www.jpeg.org 19
20. JPEG Privacy & Secuity App11 27 June 2015 www.jpeg.org
20 SOI APP1 (Exif) EOI SOI APP1 (Exif) EOI APP11 (protected
metadata) JPEG-1 decoder JPEG Privacy & Security decoder APP1
(Exif) APP1 (Exif) original JPEG codestream JPEG compatible
codestream with data protection Image Data Image data APP11
(protected image data) Image Data APP11 (protected metadata) Image
data APP11 (protected image data) APP3 (JPSearch) APP3 (JPSearch)
APP3 (JPSearch)
21. Should pictures be flat? 27 June 2015 www.jpeg.org 21
22. JPEG PLENO JPEG PLENO targets a standard framework for the
representation and exchange of new imaging modalities such as
light- field, point-cloud and holographic imaging. 27 June 2015
www.jpeg.org 22
23. Plenoptic representation of visual information 7D function
P(a,q,l,t,x,y,z) view point wavelength time 27 June 2015
www.jpeg.org 23
24. JPEG PLENO design principles One or limited number of
representation models Well defined, specific and useful milestones
Backward compatible with legacy JPEG 27 June 2015 www.jpeg.org 24
Panorama 360 degree Spatial photo Point cloud Light field
Holography
25. Spatial Photography Motion parallax 27 June 2015
www.jpeg.org 25
26. Point-cloud Photography 27 June 2015 www.jpeg.org 26
27. Light-field Photography 27 June 2015 www.jpeg.org 27
28. Light-field Photography 27 June 2015 www.jpeg.org 28
29. Light-field Photography 27 June 2015 www.jpeg.org 29
30. Holography 27 June 2015 www.jpeg.org 30 LIGHT-FIELD Rays
with position + orientation HOLOGRAM Interference = superposition
of waves
31. JPEG PLENO Workshop Warsaw, Poland June 23rd, 2015 Marriott
Hotel Warsaw 14:00 Touradj Ebrahimi (JPEG Convenor - EPFL): "JPEG
PLENO - Introduction and Scope" Light-fields 14:15 Christian Perwa
(Raytrix GmbH, Germany): "Metrically Calibrated Multi-focus
Plenoptic Camera and its Applications" 14:40 Joachim Keinert
(Fraunhofer IIS, Germany): "Lightfield media production using
camera arrays - use cases and requirements" 14:55 Peter Kovacs
(Holografika, Hungary): "Light Field Displays" 15:20 Atanas Gotchev
(Tampere University of Technology): "Content creation for
light-field displays" 15:35 Roger Olsson (Mid Sweden University):
"Objective evaluation and SotA compression solutions for plenoptic
image content" 15:50 Discussion on compression of light field data
(Requirements, use cases, technologies) Point-clouds 16:30 Rufael
Mekuria (CWI Netherlands): "Point Cloud Compression" 16:45
Discussion on compression of point cloud data (Requirements, use
cases, technologies) Holography 16:55 Magorzata Kujawinska (Warsaw
University of technology): "Holographic capturing and rendering
systems, suitable data representations for phase and amplitude"
17:10 Frederic Dufaux (TELECOM ParisTech, France): "Digital
Holography Compression" 17:35 Discussion on compression of
holographic data (Requirements, use cases, technologies) 17:50
Conclusions 27 June 2015 www.jpeg.org 31
33. JPEG XS Light weight / Low Latency Image Coding Already
several solutions around: TICO VC-2DiracPro
LowLatencyVideoCodec(LLVC) LowComplexityCodec(LLC)
LS/NLS-Encoder/Decoder TITC ARMFrameBufferCompression(AFBC)
CompactFrameBufferTechnology(CFrame) Oz2 EVLC DSC&A-DSC 27 June
2015 www.jpeg.org 33 New Work Item
34. Conclusions JPEG is exploring several paths to serve future
imaging needs Privacy and security solutions in progress New
imaging modalities started Activities in Advanced Still Image
Coding JPEG PLENO JPEG XS JPEG Privacy Workshop planned at 70th
ISO/IEC JTC1/SC29/WG1 (JPEG) Meeting Brussels, Belgium October 12,
2015 - October 16, 2015 27 June 2015 www.jpeg.org 34
35. More information 27 June 2015 www.jpeg.org 35 Prof. Touradj
Ebrahimi JPEG Convener cole Polytechnique Fdrale de Lausanne (EPFL)
[email protected] Prof. Peter Schelkens JPEG Public
Relations Chair JPEG Coding & Analysis Chair Vrije Universiteit
Brussel - iMinds [email protected]
www.jpeg.org/contact.html
36. Acknowledgements Tim Bruylants, Antonin Decampe, Jamie
Delgago, Karel Fliegel, Philippe Hanhart, Takaaki Ishikawa, Lukas
Krasula, Fernando Pereira, Antonio Pinheiro, Martin Rerabek, Thomas
Richter, Gael Rouvroy, Peter Schelkens, Frederik Temmermans 27 June
2015 www.jpeg.org 36