© 2018 Cognex Confidential1
INTRODUCTION TO MACHINE VISION
Thibaut van Baer | February 2018
© 2018 Cognex Confidential2
Agenda
▪ What is machine vision?
▪ Why use machine vision?
▪ Machine vision applications
▪ Types of machine vision systems
▪ Vision system components
▪ Machine vision terms
▪ Improving vision system performance
▪ Summary
▪ Q&A
© 2018 Cognex Confidential3
What is machine vision?
The camera lens and sensor
capture images…
Cognex advanced vision tools
interpret what’s being seen
© 2018 Cognex Confidential4
Proprietary Box
Embedded
Boards
Modular
Vision
Barcode
Readers
PC Vision
Vision
Sensors
1982 Today
3D Displacement
Sensors
Evolution of machinevision
© 2018 Cognex Confidential5
Machine vision systems:
1. Analyze images
2. Makes decisions and returns results about each image
Simple examples
The center tab on this bracket is
37.255 mm wide
Good Oil Filter:
All holes are
open
Bad Oil Filter:
Some holes
are blocked
© 2018 Cognex Confidential6
Image analysis
The primary purpose of machine vision is image analysis
Image
Decision
Answer
Location
© 2018 Cognex Confidential7
Where is machine vision used?
Automotive
Industry
Graphic Arts/ Packaging
Consumer
Products
Semiconductor
Industry
Shipping
Transportation
Electronics
Medical
Pharmaceutical
Food Packaging
Industry
© 2018 Cognex Confidential8
▪ Automate manufacturing processes
▪ Improve product quality
▪ Protect brand image
▪ Reduce operational costs
Why is machine vision used?
▪ Overcome inefficient manual inspection processes
▪ Increase manufacturing throughput
▪ Reduce material waste
▪ Minimize the risk of recalls
© 2018 Cognex Confidential9
Critical for achieving strategic goals
▪ High speed production lines
▪ Clean room environments
▪ Hazardous environments
▪ Microscopic inspection
▪ Closed-loop process control
▪ Robot guidance
▪ Precise non-contact measurement
© 2018 Cognex Confidential10
Manufacturing Goal Machine Vision Applications
Improved product quality Inspection, measurement, gauging, and
assembly verification
Increased productivity Repetitive tasks done manually are
automated with machine vision
Production flexibility and
less machine downtime
Automatic product changeovers
Increased manufacturing
throughput
High-speed inspection keeps up with the
fastest production lines
Reduce manufacturing
waste
Detecting defects earlier in the process
prevents adding value to defective
products
Benefits of machine vision
© 2018 Cognex Confidential11
MACHINE VISION APPLICATIONS
© 2018 Cognex Confidential12
What does machine vision do?
GUIDE INSPECT GAUGE IDENTIFY
© 2016 Cognex Confidential12
© 2018 Cognex Confidential13
Determines part position (x, y, and angle)
Automates handling of parts for machines:
▪Alignment & Placement
▪2D & 3D Picking
▪Eliminates need for fixturing & improves robot flexibility
Vision tool alignment, fixturing
▪Locate at least one feature on a part for the purpose of calculating the (x, y) position and rotation of the part to position other vision tools precisely
Guidance
Delta Robot - PackExpo 03.mpg
© 2018 Cognex Confidential14
Trained Image Out of focus
Uneven LightingOcclusions
Confusing Background
Rotation and Scale Changes
Geometric pattern matching
© 2018 Cognex Confidential15
Appearance Changes
Part location challenges
© 2018 Cognex Confidential16
Part location challenges
Variation in part appearance
1
6
© 2018 Cognex Confidential17
Correct location
▪Orientation
▪Skew
Quality
▪Defect Detection
▪Surface Inspection
▪Contaminants
Completeness
▪Fill Level
▪Feature Presence
▪Counting
▪Assembly Verification
Inspection
© 2018 Cognex Confidential18
Precise dimensioning
▪ Automated metrology and data recording
Ensures tolerances
▪ Diameters
▪ Gaps
▪ Bushings
▪ Threads, etc.
Gauging
© 2018 Cognex Confidential19
Read Codes
▪ Printed 1-D Barcodes & 2-D Matrix
▪ Direct Part Mark
Read Characters
▪ OCR / OCV
Recognize Objects
▪ Based on color, shape, or size
Identification
© 2018 Cognex Confidential20
MACHINE VISION PRINCIPLE
© 2018 Cognex Confidential21
1D machine vision
▪ 100% continuous web inspection and classification
▪ Uses line-scan cameras
▪ Materials inspected include:Metals, non-wovensPlastics, Paper
© 2018 Cognex Confidential22
1. Unwrap cylindrical objects for inspection
2. Add vision to space-constrained environments
3. Meet high-resolution inspection requirements
4. Inspect objects in continuous motion
Four reasons to use line scan
© 2018 Cognex Confidential23
2D machine vision – area scan
© 2018 Cognex Confidential24
3D Machine Vision
© 2018 Cognex Confidential25
Profiler principle of operation
© 2018 Cognex Confidential26
Displacement sensor
© 2018 Cognex Confidential27
VISION SYSTEMS AND SENSORS
© 2018 Cognex Confidential28
COGNEX VISION SENSOR
Compact, modular
body design fits into
tight spaces
Field changeable, high power,
diffuse illumination
Powerful, proven In-Sight®
vision tools for reliable
inspection performance
Field changeable
lenses and filters
for optimal image
quality
Step-by-step setup
with EasyBuilder®
© 2018 Cognex Confidential29
▪ Industry-leading image acquisition and optical character recognition
▪Powerful and precise pattern matching algorithms
▪Most reliable and flexible inspection systems
Cognex 2D Vision
© 2018 Cognex Confidential30
Cognex 3D Vision
▪ 3D laser displacement sensors provide three dimensional inspection of products to optimize quality
▪ Measure height, volume or tilt with cross section and plane fitting tools –regardless of contrast or light variations
▪ Expanded range of 3D sensors, factory calibrated to deliver real-world values
© 2018 Cognex Confidential31
SYSTEM COMPONENTS
© 2018 Cognex Confidential32
Key parts of a vision system
Light Source
Vision System
Vision Software
I/O Comm.
CameraLensPOWER
A- BALLEN- BRADLEY
I NPUT
10
23
4567
SLC 5/04 CPURUNFLTBAT
FORCDH+RS232
RUN REM PROG
I NPUT
10
23
4567
O UTPUT
10
23
4567
Inputs/Outputs: switches, PLCs, robots, lights
Communication
© 2018 Cognex Confidential33
Putting it all together
Camera
Monitor
Operator Pointing Device
(Trackball, Mouse, Touchscreen)
Parts
Light Source
Vision System
Output:
•Serial
•Parallel
•ISA, PCI, VME bus
Input:
•Serial
•Parallel
•ISA, PCI, VME busa
Lens
© 2018 Cognex Confidential34
How the system works
1. Part arrives at inspection station
5. Software algorithms running on vision systemperforms image processing and/or image analysison acquired image
6. Vision system sends signal along a discrete output line which activates a diverter if the part is bad
7. Operator can view rejected parts and ongoing statistics on display,and can take system off-line if necessary
2. Sensor detects part and sends a trigger to the vision system3. Strobe is flashed to illuminate part 4. Vision System acquires the image from the sensor.
FAIL
© 2018 Cognex Confidential35
Machine vision algorithms
All within just one to tens of milliseconds!
Algorithms used by Vision Tools transform raw numbers into
useful higher level features …
- Raw numbers turned into edges, colors, characters, and
other characteristics
… then makes decisions
- Returns answers such as position, similarity, distance,
presence, quality
© 2018 Cognex Confidential37
TERMINOLOGY
© 2018 Cognex Confidential38
Vision definitions
Field of View (FOV)
▪ The part which can be seen by the machine vision system at one moment.
▪ The field of view depends on the lens of the system and the working distance between object and camera.
5” x 7”
© 2018 Cognex Confidential39
Field of view
What is my field of view?3”
4”
8”
15”
© 2018 Cognex Confidential40
Working distance and resolution
Working Distance (WD)
▪Distance between the FRONT of the lens and the target
Resolution
▪The minimum feature size of the object under inspection.
10”
© 2018 Cognex Confidential41
Correlation working distance/FOV
© 2018 Cognex Confidential42
Depth of field
Depth of Field (DOF)
▪ The distance in front of and behind the object which appears to be in focus
3”
More DOF with a small aperture
(high f/number) than with a large
aperture (low f/number)
© 2018 Cognex Confidential43
SYSTEM COMPONENTS
© 2018 Cognex Confidential44
Different lens … same image?
▪ Lighting
▪ Depth of field
▪ Working distance
▪ Line speed
▪ Exposure time
▪ Aperture
▪ Budget
© 2018 Cognex Confidential45
Lighting techniques
4
5
Bright FieldDark Field
Back Lighting
Diffuse Dome
Axial Diffuse
Light can be structured in different ways. Angle and direction of the light determine how the mark and space is seen by the camera.
Structured
© 2018 Cognex Confidential46
Optics
To learn more about choosing the right optics go to
Cognex.com > Resources > On-Demand Webinars
© 2018 Cognex Confidential47
Filtering techniques
▪ Control quality and quantity of
light
▪ Block all unwanted
ambient lighting
▪ Pass only the output of
lighting used for inspection
▪ Increase contrast
and resolution
For more on optical filters, go to Cognex.com >
Resources > On-Demand Webinars
© 2018 Cognex Confidential48
Image pre-processing tools
To learn more about image pre-processing, go to Cognex.com > Resources > On-Demand Webinars
© 2018 Cognex Confidential49
Summary
▪ Make products better, faster, and less expensively
▪ Gauging, Inspection, Guidance, and Identification are the key applications
▪ Key components are the lens, camera, lighting, vision software and communications
▪ Learn more about optics, lighting, filters and image pre-processing to improve system performance
▪ Don’t go it alone…get help from experts!
© 2018 Cognex Confidential50
QUESTIONS?
[email protected] | www.Cognex.com
mailto:[email protected]