+ All Categories
Home > Documents > MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral...

MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral...

Date post: 23-Aug-2020
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
47
Transcript
Page 1: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors
Page 2: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

MULTISPECTRAL IMAGINGby S I L I O S T EC H N O LO G I ES

Page 3: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

SILIOSAIX EN PROVENCE

About us

Page 4: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

M o n t a g n e S a i n t e - V i c t o i r e

Page 5: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

I n d u s t r i a l Z o n e o f R o u s s e t( d e d i c a t e d t o s e m i c o n d u c t o r i n d u s t r y )

Page 6: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Spin-off

ION BEAM SERVICES

SILIOS

10 people

Established in 2001

75 people

Photonics

Established in 1987

Semiconductor

600 m² clean room for

micro-technologies

About us

Page 7: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

MULTISPECTRAL (2009)

MULTISPECTRAL IMAGING

MICRO-OPTIC (2001)

SCIENTIFIC & INDUSTRIAL LASERS, ASTRONOMY & SPACE

CMS series

A single Process : Realization of Multilevel Phase Profiles thanks to a cumulative etching process

… Two Product Ranges

Page 8: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Area : 600 m²Class : 100 down to 10 (FS209)

5 down to 4 (ISO)

Manufacturing Capacities

Page 9: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

COLOR SHADES® TechnologyM u l t i s p e c t r a l F i l t e r s

Page 10: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Multispectral Filter

Technology

Pixelated Detector

Page 11: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Geometries adapted to 1D or 2D CMOS

Centimeter to micrometer scale Geometries

Any Geometries

Page 12: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

COLOR SHADES® Multispectral Filters

COLOR SHADES VIS-8

Multispectral Filters Design &Manufacturing

Technology for the VISIBLE & NIRDomain (between 400nm and1000nm).

(Chip size : 9 x 2 mm²)

Page 13: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

COLOR SHADES® Multispectral Filters

COLOR SHADES VIS-8(Chip size : 9 x 2 mm²)

Tmax : 40% to 60%FWHM : 20nm à 40nmMax Spectral Range : 300nm (shiftable)

Page 14: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

50x50 mm²

Color Standard Chipfor Microscopy.

VIS-16 Spectral Response

Page 15: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Spectrometry & Multispectral ImagingSensors and CMS Cameras

Page 16: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

1D CMOS (Melexis)128 pixels – 66 µm

1D Assembly : 8 Channel Spectrometer

COLOR SHADES® 1D Chip

COLOR SHADES® e-Board

Page 17: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

4 cm

4 quadran sensorSi PIN PD 5980

COLOR SHADES CHIP 4Number of bands : 4Spectral ranges : 550 - 700 nm / 400 – 550 nmBandwidth (FWHM) : 30 nmPeak Transmission (%) : 60%

Sensor for Waste Sorting

Page 18: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Monochrome standard imagerResolution : N x M

Regular Color Imaging (RGB).

Standard RGB imagerResolution : N x M (after demosaicing)

4 interleaved imagesResolution : N/2 x M/2 9 interleaved images

Resolution : N/3 x M/3 16 interleaved imagesResolution : N/4 x M/4

Multispectral Imaging.

Supply of a set of 4, 9 or16 sub-images filtered @different λ.

SILIOS multispectral approach : filtering at the pixel scale

Multispectral imaging: Custom Bayer Matrix (Pixelated Filter)

Page 19: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Technology Space Time

Filter Wheel Field of view = Sequential

Sub-images Field of view ≠ Synchronous

Pixelated Filter(custom Bayer Matrix)

Field of view = Synchronous

Multispectral Imaging System Comparison

Page 20: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

FIL

TE

RC

MO

S

Mosaic filter substrate

Mosaic filter pixels

CMOS pixels

Microlenses

Air

Active CMOS pixel areas

CMOS substrate

Advantages : The microlens function is preserved (+50% photons). The filter is placed above the microlens avoiding high incidence angle onto the filter.

Drawback : Geometrical crosstalk (light from a filter N collected by a pixel M)

Solution : SILIOS developed a post-processing method that suppress the crosstalk.

Hybrid assembly of a SILIOS multispectral filter on top of a commercial CMOS sensor

Hybrid Assembly : Multispectral Sensor

Page 21: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

CMS multispectral Sensor(e2V Ruby based)

828nm 790nm 748nm

552nm PAN 713nm

586nm 628nm 663nm

5.3 mm

Macro-pixel

Hybrid Assembly : CMS Series Multispectral Sensor

Page 22: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

400 nm 500 nm 600 nm 700 nm 800 nm 900 nm

Visible Near infra-red

CMS Series (Multispectral Cameras)

1.3 MpxUSB3.0 or GigE

COLOR SHADES Lab (SDK)

+DLL for :

Hypercube extraction Crosstalk correction

Page 23: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Color Shades Lab

Page 24: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Measured transmission curves of the filter.

Filter

Multispectral Filter Characterization

Page 25: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Quantum Efficiency of the multispectral sensor.

Filter

CMOS

Multispectral Sensor Characterization

Page 26: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Compensated Crosstalk Efficiency of the multispectral sensor.

Application of a post-processing method based on linear combinations of the bands to reduce the crosstalk. For more information, please see Application Note at www.silios.com

Filter

CMOS

+Raw Data Processing

Multispectral Sensor Characterization

Page 27: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Raw multispectral image

Multispectral Image Management

Page 28: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Multispectral Image Management

Raw multispectral image

Page 29: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Multispectral Image Management

Raw multispectral image

Confidential

Page 30: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

l8 l7 l6

l1 l5

l4l2 l3

Panchromatic

Multispectral Image Management

Raw multispectral image

Confidential

Page 31: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

green550nm

red650nm

Infra-red> 750nm

Chlorophyll red-edge

Ch

loro

phyll sign

ature

Spectrum extraction

Multispectral Image Management

Page 32: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

The Chlorophyll-rich objects of this scene are highlighted in Red Color.

Multispectral Image Management

Chemical Image

Page 33: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

430-700nm

CMS-C CMS-V CMS-S

Raw images (contains the 8 spectral channels + 1 additional B&W channel)

CMS Series Image Samples

550-830nm 650-930nm

Page 34: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

430-700nm

CMS-C CMS-V CMS-S550-830nm 650-930nm

CMS Series Image Samples

Page 35: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Applications

Page 36: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

PRECISION FARMINGDrone Field Mapping

Page 37: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

COSMETICSPersonalized Skin care and Make-up

Face mapping Care personalization

Page 38: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

NEW SPACEEarth Observation

Nano-/Micro-Satellites

Page 39: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

MEDICALDermatology / Endoscopy / …

Page 40: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

DEFENSEDecamouflage

Page 41: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Have you made the proof ofconcept with our off-theshelf CMS cameras for yourapplication ?

Need for a specific range ?Specific band centering ?A specific image resolution ?A specific image sensor ?…

We’ll develop YOUR custommultispectral camera forYOUR specific application !

Your Custom Multispectral Camera

Page 42: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

CMOSe2V/teledyne

RUBY1.3 Mpx

e2V/teledyneONYX

2.0 Mpx

CMOSISCMV40004.0 Mpx

High dynamicsensors

> 120 dB VGA

Ultra fast sensors1.0 Mpx

SWIRsensors

ViiMagic2.0 Mpx

2016 2017 2018 2019

Already worked on a Large Diversity of Sensors

CMS CMS4

Page 43: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Custom Bayer Matrices approach :

Small footprint sensors. Light sensors. Robust sensors (not sensitive to vibrations).

COLOR SHADES® filters :

Large numerical aperture acceptance. High integrated transmission (higher sensitivity).

Hybrid assembly approach :

Versatile : compatible with almost any sensor and multispectral configuration. Economically viable from low to medium volume production. The hybrid architecture allows preserving the microlens function (higher sensitivity).

Reminder: Main Advantages

Page 44: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

News

Page 45: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Textile leaf

Natural leavesSILIOS under the spotlight(on French TV)

SILIOS on TV !

Page 46: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

CMS4 Series (Coming Soon! Q1 2019)

4.0 MpxUSB3.0 or GigE

COLOR SHADES Lab (SDK)

+DLL for :

Hypercube extraction Crosstalk correction

400 nm 500 nm 600 nm 700 nm 800 nm 900 nm

Visible Near infra-red

Page 47: MULTISPECTRAL IMAGING · Colored images (RGB image coming from the combination of the 8 spectral channels + the B&W channel) Colors close to the reality. False colors. False colors

Thank you for you attention


Recommended