ASTRI Proprietary

Intelligent Vision Technology for

Industry Automation

Anna, Liu Ying

Senior Manager, MTECH / OE / ASTRI

June / 2016

ASTRI Proprietary

Core Competence:

(1) Miniaturize optical engines (2) Image understanding algorithms

Defect

Inspection

3D Robotic

Vision

Display &

Sensing

Bi-Sensing

Augmented Reality HMD

Automotive Holographic HUD

HMI

Industry Robot Cognition: 3D Vision

Defect Inspection 3D AOI

3D Reconstruction

3D Body Measurement

The Technologies We Focus

ASTRI Proprietary

Defect Inspection Platform

Defects on case

(Scattering surface)

Defects on logo (Glare surface)

Defects on

geometrical edges

Defects on Camera

(Transparent surface)

Defects on LCD Panel

(Glare surface)

End Product Level Defect Inspection Component Level Defect Inspection Camera module

• Mixed characteristics surface

• Various of defects, various of locations

Optical Film

LCD Panel

Touch Panel

• Very small size

• Very limited focus depth

• Transparent surfaces

3

3D Defects Inspection & 3D

Precision Dimension

Measurement

Scratch on corner / side spot on surface

ASTRI Proprietary

3D Robotic Vision Platform

3D solder paste inspection (SPI)

Accuracy.: 2-5um@ 600um

• 3D AOI for SMT

Accuracy: 20um @ <2mm, 100um@ 2-10mm

• Semi. Package Detection

Bump: Accuracy 1-2um@ 300um

High Precision 3D AOI

3D Scanning, Reconstruction & Measurement Intelligent Robot: 3D Robot Cognition

Scanning Point Cloud 3D Mesh Dimension Phase shift 3D & Machine Learning Recognition

Assembly, Pick & Place, Random Bin Picking

ASTRI Proprietary

Core Competence

5

ASTRI Proprietary

Illumination Optics

Imaging Optics

Thermal/Mechanical

Electrical/Control

Customized Lighting To enhance the visibility of the

defects, removing noise influence .

Thermal /Mechanical Design To well organize the mechanical structure

and foot print of the vision system, and

enhance the reliability by thermal

optimization

Special Designed Imaging Lens To achieve the best image quality, well

defined field of view and variable working

distance.

Electrical / Control To power, control, trigger the vision

system by using PLC, FPGA, etc.

Optical-Mechanical-Electrical-Thermal Design Capability

Line scanning

lighting

Linear LED

lighting Light collector 16K line sensor

lens

12M array sensor

lens SXGA projection

engine

Display driver board & synchronization

control

3D AOI engine

Mech. design Thermal

simulation

ASTRI Proprietary

Template Approach Perceptive Vision

Probabilistic Approach

Perceptive Vision

7

Precision

Flexibility

Machine learning for Industry Application

Big Data Driving

Deep Learning

Image processing

Upgrade industry

Smart manufactory

Low cost high added-value

ASTRI Proprietary

High Profile Image Processing

8

Design algorithms to detect low contrast defect image, handle noise background

image and extract high precision features

High precision feature

extraction with sub pixel

accuracy, e.g. 0.1 pixels

Low contract defects with complex and noise

background

ASTRI defect inspection result with high

profile image processing: detect low contract

defect in noise data

Traditional image processing result: more

noise and false alert.

Input image with blurred edges Extract the edge position with high accuracy

Low contrast defects

ASTRI Proprietary

Rough surface with shapes

Golden samples model

Comparision

Raw photo taken

-

Good sample Test image

Directly comparison, false alert

Good sample

Test model

Test image

Machine(deep) learning modeling

[1] Benezeth Y, Jodoin P M, Emile B, et al. Comparative study of background subtraction algorithms[J]. Journal of Electronic Imaging, 2010, 19(3): 033003-033003-12.

Faster

Anti-noise

Hybrid surface

Traditional Method ASTRI’s Method

Orange peel defect

Perceptive Vision: Deep Learning Defect Inspection

ASTRI Proprietary

Main Window (UI

Display)

Main Controller

Capture

Receiver

Camera Controller

Trigger

PLC Controller

Simulator

Processing Control

Top Surface Logic

Top Surface Detector

Side Surface Logic

Side Surface Detector

Capture image path

Feasible (moduli zed) Flexible (pluggable) UI Level

Function Level

Implement Level

Implement Level

Evalution flow

High Standard Software Architecture

ASTRI Proprietary

Cases Study

11

ASTRI Proprietary

Features

Customized LCoS projection engine

Tilted projection optical design, satisfy the Scheimpflug principle

High resolution (>=720P)

Full digital pattern generation

Multi-frequency pattern modulation

Whole field, fast, accurate

3D Inspection for SPI & AOI (SMT Application)

• FOV: 46.5 x 25.6mm

• Resolution: 1280 x 720

• Work distance: 200mm

• Luminance: 32lm@5W

Engine 1

• FOV: 25 x 20mm

• Resolution: 1280 x 1024

• Work distance: 200mm

• Luminance: 25lm@5W

• FOV: 60 x 48mm

• Resolution: 1280 x 1024

• Work distance: 200mm

• Luminance: 20lm@5W

Engine 3

Engine 2

ASTRI Proprietary

3D AOI 3D SPI

Technology Multi frequency

phase shift Shadow free phase shift

Function Height, xy position

FOV size 40mm x 40mm 25mm x 20mm

Max. height 10mm 600um

camera 4M/5M high speed camera

x-y resolution 20um 10um

Z-resolution 1.2um (<2mm), 6.3um (<10mm) 0.37um

Z-Accuracy +/-20um(< 2mm)

+/-100um(<10mm) 2um

max. speed <0.47s/FOV 0.37s/FOV

3D SPI / AOI (SMT Application)

China 1st 3D SPI / AOI machines (2015) embedded ASTRI’s technology

5 companies licensed ASTRI’s 3D SPI/AOI technologies

ASTRI Proprietary

3D Scanning & Reconstruction

Dental, Face, Body 3D Reconstruction

Small object 3D Reconstruction

Applications:

Dental digitizing

3D copy machine (3D scanning+3D printing)

3D face / body Reconstruction

High speed, High precision, Full color

Product Specification

Technology Hybrid fringe projection

FOV 60~120mm 200~300mm 0.5m-1m

Camera

Resolution 1.3~2 M

Accuracy 20~30um 0.1~0.2mm 1mm

Output STL, PLY, XYZ,

ASTRI Proprietary

15

Glass (OGS, CG, Raw Glass) Inspection(1/2)

Type of inspection (檢測類型) OGS CG Raw Glass

Field of View (視場) 3~7 inch 3~7 inch 3~7 inch

Defect Size ( 瑕疵尺寸) >= 0.015mm >= 0.015mm >= 0.015mm

System resolution (系統分辨率) 0.005mm 0.005mm 0.005mm

Operation Speed( 檢測速度) <6s/panel < 4s/panel <3.5s/panel

Defects (缺陷種類） Scratch, Paint chip, Spot defects, Edge-crack, Mura, Etch defect

Core technologies

Adaptive lighting and image capture system

Advanced machine learning algorithm

High profile perceptive image processing module

High speed data processing module

ASTRI Proprietary

16

Glass (OGS, CG, Raw Glass) Inspection(2/2) Control and Setting Toolbar

Image Display Image Zoom

Log Output

Image Directory

Pilot-run ongoing

ASTRI Proprietary

17

Painted Metal Parts Inspection

Prototype

Defect Description Shape Size

Impurity Dust particles in the smooth painted surface Few tenths to some mms (>0.3mm2)

Burr Irregular bars rising on the planar surface Widths – Few tenths to some mms

Lengths – Some mms to cms

Paint stripping Unpainted spots on the uniform colored surface Few tenths to some mms (>0.5mm2)

Deformation General deformation of glazed surface with a circular shape Radius usually < 5mm

Wrinkle Wrinkles of the glazed surface with respect to the planar

surface Some mms to cms

ASTRI Proprietary

Roadmap for U.S. Robotics: Flexible

A Roadmap for U.S. Robotics, 2013 Robotics Virtual Organization (NSF: MIT, CMU, Stanford, UC Berkeley,…)

Robots for manufacturing

Shift from automotive to 3C products

Shift from fixed manufacturing to flexible manufacturing for one-off products /mass customization

18

Flexible Manufacturing:

Re-configure production line by “intelligent

industrial robot”

T=2013 +5Y +10Y +15Y

24

8 1

Hours

Fixed Manufacturing:

ASTRI Proprietary

Random Bin Picking for Industrial Robot

Robot Eye

(Perception)

Robot Brain

(Intelligence)

Robot Arm

Features & Applications :

• Wide applications in manufacturing lines of automotive, 3C and food products.

• Good solution for flexible manufacturing

• High flexibilities for different production lines

• To shorten production line change time

• To reduce production line change cost

3D scanning technology

2D/3D object recognition

Next-generation

intelligent robot

Core

technologies

ASTRI Proprietary

End of Presentation Thank you. Questions are welcome.

Corporate website: www.astri.org

20

Contact E-mail Phone No.

Tsai Chen Jung

(蔡振榮) cztsai@astri.org 852-34062814

Ryan Chung

(鍾沛璟) ryanchung@astri.org 852-34062868

Liu Ying

(劉穎) annaliu@astri.org 852-34062544

ASTRI Proprietary

Disclaimer The information contained in this presentation is intended solely for your reference and may be subject to

change without further notice.

Such information's truthfulness, accuracy or completeness is not guaranteed and it may not contain all the

material information concerning Hong Kong Applied Science and Technology Research Institute Company

Limited and/or its affiliates (collectively, "ASTRI"). ASTRI makes no representation or warranty regarding,

and assumes no responsibility or liability for, the truthfulness, accuracy or completeness of any information

contained herein.

In addition, the information may contain projections and forward-looking statements that may reflect

ASTRI’s current views with respect to future events and financial performance. These views are based on

current assumptions which may change over time. ASTRI makes no assurance that such future events will

occur, that such projections will be achieved, or that ASTRI’s assumptions are correct.

Lastly, this presentation does not constitute an offer made by ASTRI whatsoever (including an offer relating

to ASTRI's technologies and/or services).

21