Vision for Networked Security and

Surveillance Systems

Presented by:

Markus Tarin, President & CEO

m.tarin@movimed.com

Webcast – April 9, 2013 15540 Rockfield Boulevard., Suite C-110

Irvine, CA 92618, USA

949.699.6600 x111 Phone

www.movimed.com

High-Level Topics

• Surveillance Market Overview

• Machine Vision & Surveillance.

What’s the difference?

• Categories of Surveillance/Security Systems

• Application Areas

• Choosing the right Technology for the Job

• Example Applications

• Interactive Q&A

Surveillance Market –

How big is it? “Putting things into perspective”

Watchful Eyes

• UK started installing surveillance systems in the 1960s.

• Over 1.85 million cameras today.

• London alone has an estimated 420,000 cameras.

• Operation Virtual Shield (OVS) in

Chicago has installed over 17,000

cameras and 600 miles of fiber optic

cables.

• Former Mayor Daley has been quoted

as saying this is the “next best thing to

a police officer on every corner”.

Image Source: topleftpixel.com

Image Source: wsj.com

Watchful Eyes

• Theft and fraud at American stores alone results

in losses of approximately $45 billion per year

• In 2011, one in every 36 retail sector employees

was apprehended for theft from his or her

employer

• FAA expects that as many as 30,000

drones will be operating in U.S.

airspace by 2020.

Image Source: www.securitycameraking.com

Source: “Surveillance and Security Equipment: Technology and Global Markets”, by K. Gainer (www.finance.yahoo.com)

Image Source: strandedpassengers.blogspot.com

Watchful Eyes – Social Surveillance

• 72 hours of video are uploaded every minute

• Over 4 billion hours of video are watched each month on

YouTube

• In 2011, YouTube had more than 1 trillion views – about 140

views for each person on Earth.

Source: YouTube.com

• 300 million photos uploaded daily to Facebook Source: CNET

• 40 million photos a day uploaded to Instagram Source: Instagram.com

Market Comparison

2012 Worldwide Revenue

Security & Surveillance

Machine Vision

Estimated at approx.

$20 Billion US **

Estimated at approx.

$3.1 Billion US*

** Source: “Surveillance and Security Equipment: Technology and Global Markets”,

by K. Gainer (finance.yahoo.com)

* Source: IMS Research – John Morse (imsresearch.com)

Machine Vision vs. Surveillance “What’s the difference?”

Machine Vision & Surveillance “What’s the difference?” - Overview

Machine Vision Security & Surveillance

Controlled Environment • Unit Under Test (UUT) in fixture

• Fixed Region of Interest

• Carefully-controlled Illumination

• Fixed Focal Distance and Magnification

Uncontrolled Environment • Subject of Interest can be anywhere

(not necessarily in the normal field of view)

• Dynamic Region(s) of Interest

• Widely Varying Illumination (day/night)

• Variable Focal and Zoom Distance

Clearly-Defined Pass/Fail Criteria • UUT specifications known

• UUT faults often predictable

• Consistent with automated analysis and decision-making

Potentially Complex Situational Analysis • Risk assessment is complex, dynamic and situation-specific

• Risk patterns not always predictable

• Limited analysis and decision-making through video analytics and AI, but

human analysis is usually also required

Rigorous Calibration Requirements • Repeatable, high-quality images critical for success

• Dimensional accuracy often important (sub-pixel)

Calibration is Secondary to Other Considerations • Environmental factors and data compression limit image quality

• Dimension accuracy usually secondary to behavior patterns

Data Compression and Storage • Data compression and storage is a secondary consideration

• Images typically processed uncompressed

• Inspection results often more important than raw image data

Data Compression and Storage • Data compression and storage is a primary consideration

• Motion video rather than single-frame images

• High compression ratios and/or reduced frame rates

to reduce the storage footprint

• Video data usually archived for historical review

Machine Vision & Surveillance “What’s the difference?”

Environmental Considerations

• Most surveillance system will be ‘outdoor applications’

• Cameras must be protected from:

- large temperature swings

- Rain, Fog, Snow, Ice, Hail, Dust, Sand, Wind

- direct sun light (into lens)

• Applications in Oil & Gas may require Ex-Proof provisions

- Ex-proof by either ignition prevention or explosion containment

Categories of Surveillance Systems

Categories of Surveillance Systems

Complexity Technology Complexity, not number of cameras

Retail Store Surveillance

Typical System Topology

High-Value Asset Protection

Typical System Topology

Options: • Simple Motion Detection

• Perimeter Intrusion Alert

• Basic Video Analytics

Intelligent, Automated Surveillance

Thermal Image Sources: FLIR and zeetee.ca

• Fully automated 24/7 operation

• Software makes decisions

• Performs actions such as alarming,

turning machines and processes off, etc.

Sample Application – Critical Vessel Inspection

Tactical Surveillance

• Multi-sensor systems

• Image stabilization

• Advanced imaging sensors and optics

• Critical applications • Homeland Security

• Situational awareness

• Military

Sample Application

Image Sources: PVP (pvpaeo.com) and www.norad.mil

Application Areas Low Cost Security

• Small Retail Stores

• Small Businesses

• Residential Installations

High-Value Asset Protection

• High-End Residential/Mansions

• Large Retail Businesses

• Casinos

• Biotech/Research Facilities

• Public Safety & Law Enforcement

• Transportation Infrastructure

Conventional Applications for Security System Integrators

Application Areas (cont’d)

Intelligent, Automated Surveillance

• Critical Vessel Monitoring

• Flare Stack Monitoring for Refineries

• Electrical Substation Monitoring

• Other Industrial Applications

Tactical Surveillance

• Border Control / Homeland Security

• Port Monitoring

• Military & Defense

• Other Critical Asset Protection

Specialized Applications Reserved for Elite Integrators

Technology Considerations &

Component Selection

Technology Considerations Camera Types & Imaging Sensors

- CCD vs. CMOS

- EMCCD

- Non-Visible

Lenses

- Auto-Iris

- Motorized Zoom, Focus

Interfaces

- Analog

- HD-SDI

- Ethernet/PoE

- Fiber Optics Converters

- CoaXPress

- PTZ

Image Compression

- Compression & Image Formats

Cameras for Day/Night

Visible Imaging

Camera Types & Imaging Sensors

Today’s technology advances in CMOS fabrication almost puts the equal

sign between CCD and CMOS.

CCD CMOS

Higher Cost More affordable

Potential for blooming Simpler Electronics

High dynamic range Limited dynamic range

Better quantum efficiency,

good low light performance

Less sensitive, poorer low

light performance

Better image quality Decent image quality

“This is probably one of the most discussed topics in camera technology.”

Camera Types & Imaging Sensors

Use CMOS if:

- Camera budget is low

- Scenery is well lit

- Power Consumption is an issue

Use CCD if:

- Superior Image Quality is important

- Camera needs to cover a wider dynamic range

- Low noise images in low light conditions are desirable

Guidelines for selecting CMOS and CCD

Camera Types & Imaging Sensors

Electron multiplying CCD Cameras

• Specialty Cameras for extreme low-light conditions

• Primarily night vision without artificial illumination

• Uses residual light from moon, stars, glow of city lights, northern glow

• Multiplies Electro-photons by means of avalanche effect. 1e- x1000

• Allows color night vision!

• Very Expensive $5k+ entry price per camera

• (Also used for scientific imaging, fluoroscopy, X-ray, astronomy)

Camera Types & Imaging Sensors

NIR – Near Infrared Imaging

“Infrared Camera” is a misnomer often used in surveillance discussions

• CMOS and CCD sensors are all sensitive up to about

1um (1000 nm)

• Using (N)IR LEDs as illuminations allows night vision

• However, technically this is not “Infrared Imaging”, since it

is only near the IR region of the spectrum. (Near IR/NIR)

• Remember to remove the NIR filter from your camera!

NIR LEDs ~850nm

Lens Selection

Lens Attribute Pros Cons When to choose?

Fixed or manually-adjusted Iris Lower cost Problematic when

light intensity changes

Indoor applications where lighting

remains constant, both day and night.

(i.e. a constantly lighted hallway)

Auto-controlled Iris

Compensates for

light intensity

changes

Increased cost Outdoor applications or where lighting

can change, both day and night

(i.e. exterior perimeter security)

Fixed or manually-adjusted

Focus

Lower cost

Potentially problematic

when position of subject

can change dramatically

When the focal distance of the

protected asset is known and fixed, or

at a fixed point of interest (i.e. a

doorway)

Auto-Focus

Compensates for

moving targets

Increased cost

When detail is important and the object

interest is moving and/or can be at

different distances from the camera

(i.e. license plate reading)

Choosing the Right Lens

Many lens options associated with Security & Surveillance are not typically

associated with conventional Machine Vision Applications

Lens Attribute Pros Cons When to choose?

Fixed Magnification/

Wider Angle FOV

Lower cost

Limited detail on

distant objects of

interest

When the secured area is a fixed and

relatively small size, and the distance of

subjects in limited. (i.e. an entry way, a

small room, etc.)

Auto-Zoom

Enhanced detail

regardless of the

distance of subjects

Increased cost

When the secured area is relatively large,

with a large potential variation in the

distance between subjects and the

camera. (i.e. large warehouse, perimeter

security, traffic monitoring etc.)

Motorized Pan/Tilt Dramatically increases

camera field of view

Increased cost

When the secured area is relatively large,

with a large potential variation in the

position of subjects with respect to the

camera. (i.e. large warehouse, perimeter

security, traffic monitoring etc.)

Choosing the Right Lens (cont’d)

Many lens options associated with Security & Surveillance are not typically

associated with conventional Machine Vision Applications

Non-Visible Imaging

Camera Types & Imaging Sensors Non-Visible Sensors and Cameras for Specialty Applications

SWIR MWIR LWIR

1.7µm 2.5µm 3.0µm 5.0µm 14.0µm 8.0µm

NIR

1.0µm

UV Visible

Thermal Bands

0.4µm

CMOS/CCD µBolometer

Compound Semiconductors (Photon Detectors – Higher Performance)

InGaAs InSb QWIP

Camera Types & Imaging Sensors

SWIR – Short Wave Infrared Imaging

• InGaAs Detector - Indium Gallium Arsenide, thermo-

electric/Peltier cooled

• Wavelength: 0.9um to 1.7um typical

• Still uses reflected light, photon based (not thermal)

• Allows night vision based on residual light, monochrome

• ‘Sees’ through fog and smoke

Left: Bay Bridge,

San Francisco,

CCD Camera

Right: SWIR

camera

Camera Types & Imaging Sensors

MWIR – Mid Wave Infrared Imaging

• InSb Detector - Indium Antimonide, cryogenically cooled

• Wavelength: 3.0um to 5.0um typical

• Heat/Thermal imaging, photon based (no reflected light)

• Allows night vision based thermal signature i.e. body heat

• ‘Sees’ through fog and smoke

Left: Person at

intersection

Right: Burglar

opening car

Camera Types & Imaging Sensors

LWIR – Long Wave Infrared Imaging

• MCT Detector (HgCdTd) – Mercury Cadmium Telluride,

cryogenically cooled (Photon detector) OR Micro-

Bolometer/MEMS (Thermal Radiation)

• Wavelength: 7um to 14um typical

• Heat/Thermal imaging

• Allows night vision based thermal signature i.e. body heat

• ‘Sees’ through fog and smoke

Camera Types & Imaging Sensors

Choosing the right camera

Camera Type Applicable for

NIR/CCD/CMOS

Cost: $

Standard, short range surveillance application requiring

some ability to see at night. Use NIR LED illuminators.

EMCCD

Cost: $$

Color night vision, extreme low light, no artificial illuminators

available or practical

SWIR

Cost: $$$

Applications that need superior night vision, short and long

range, need to see through fog without losing details.

MWIR

Cost: $$$$

Applications requiring detection of heat signatures,

differentiation of hot/cold i.e. body or engine heat.

LWIR

Cost: $$ or $$$$$

Commonly used in military, homeland security to detect heat

signatures. Choice of cooled and uncooled cameras.

Note: Some applications may also use a mix of the above cameras.

Camera Interfaces

Camera Interfaces - Analog

• Legacy interface used in most

standard surveillance systems in

the past, prior to availability of IP

Cameras.

• Analog Video Signal transmission

on 75 Ohm impedance coaxial

cable (RG59)

Camera Interfaces – HD-SDI

• Serial Digital Interface

• Uses also 75 Ohm coax

• 3 Gbits/sec (“3Gig interface”)

• Makes this a drop in replacement

for existing analog/coax

infrastructure

• Up to 300m (1,000ft)

Camera Interfaces – CoaXPress (CXP)

• Asymmetric Serial Digital Interface

• Uses also 75 Ohm coax

• Up link for camera control and

triggering at 20.833 Mbits/sec

• Down link for image data at

6.25Gbits/sec (Limit: 68m (220ft))

• Makes this also drop in replacement for

existing analog/coax infrastructure

• Up to 212m (1,000ft) @ 1.25Gbits/sec

• Power over CoaXPress, 13W

Camera Interfaces - Ethernet

• Most commonly used.

Inexpensive, flexible, scalable

• CAT5, CAT5e, CAT6, CAT7

• Uses standard IT

infrastructure i.e. hubs,

switches, routers

• Twisted pair cable

construction

• IP Cameras and HD IP, GigE

Camera Interfaces – PoE Ethernet

• Allows power

transmission over

Ethernet cable

• Reduces wiring

• Limited power

• 100m (330ft)

cable runs with up

to 12W power

• Shorter runs up to

51W (PoE+),

depending on

standard

Fiber Optics

• Commonly used to help

extend cable runs from

camera to control room

• Converters are available for

Ethernet, Analog and other

‘copper’ interfaces

• Helps overcome distances to

several km

• GigE converters available

Pan/Tilt/Zoom Control

• Telemetric control is required to

remotely adjust pan, tilt, zoom and

focus.

• Most common protocol is PELCO P

or D, many others are available

• Allows joystick or software based

control

• For sensor fusion applications,

there is the TASS protocol.

“Tactical Automated Security

Systems”

Image Compression in short

• There are two types of compressions

a) Frame by Frame (MJPEG)

b) Temporal (H.264)

• MPEG4 – Low quality, low bandwidth

• MJPEG & H.264 is more suitable for surveillance as it retains more

details.

• H.264 may not be suitable for traffic type applications, due to its

inherent latencies.

• Consider required processing power for compression algorithms as

well. Especially for larger scale systems

• There is a very long list of video and audio CODECs

• Some are lossless, if required.

Video Management Software

VMS: Video Management Software

• Large installations require more capabilities and storage

capacity than DVRs (Digital Video Recorders) or NVRs

(Network Video Recorders)

• Countless VMS (Video Management Software) options

available

• Proprietary products from Pelco, Bosch, Panasonic,

Honeywell and others have historically dominated the

mainstream security market

• Specialized niche markets are served by smaller players

• Proprietary products now challenged by Open VMS –

Open platform Network VMS products that support

hardware from multiple vendors.

Source: IMS Research - Video Surveillance and VCA Group

Image Source: bluevioletnetworks.com

Key VMS Application Features

• Vendor-neutral Camera Integration

• Support for IP and legacy Analog Cameras

• Recording & Archiving

• Control-Room/Video Wall capabilities

• Content-based Analytics / Video Alerts

• Physical Access Control (i.e. RFID, Retinal Scan, etc.)

• License Plate Recognition

Source: IMS Research - Video Surveillance and VCA Group

VMS Screen Shot

Image Source: securityinfowatch.com

Top 10 Leading VMS Suppliers

Source: IMS Research - Video Surveillance and VCA Group

1. On-Net Surveillance (OnSSI)

2. Genetec, Inc.

3. Milestone Systems, Inc

4. Verint Systems, Inc.

5. DVTEL

6. Aimetis Corp.

7. Avigilon

8. Cisco Systems, Inc.

9. Exacq Technologies

10.March Networks Corp

Example Applications

Virtual Border Program - DHS

• Tactical Surveillance with long range

MWIR and Visible Cameras

• Human detection at up to 8 miles

• Gyro Stabilized Pan/Zoom/Tilt. Images

virtually with no jitter when driving through

rough terrain at 50 mph.

• Texas border control equipped with 29 on-

vehicle system with dashboard computer

• Multi-sensor system integration with

ground radar using TASS protocol.

Toll Violation Video Enforcement

Video Surveillance System Tracks Toll Booth Violations

Toll = $0.50, Violation = $25.50

System Features:

• 1 to 3 cameras per lane, depending lane configuration

(high speed, attended, unattended)

• Typical camera sensitivity ~0.7 lux

• Uses digital IP cameras and analog cameras with frame grabbers

• Camera alignment adjustments driven by data from unusable

images (off: left/right/top/bottom, too bright or dark, etc.)

• Color cameras implemented to detect multi-state license plates,

• OCR, and dedicated link to DMV vehicle owner records automates

violation processing

Images Source: Google Earth

System paid for itself very quickly. In one case, the total implementation

cost was recovered in two weeks, processing a backlog of images from the

previous 6 months.

Critical Vessel Monitoring

• Networked thermal cameras

monitor chemical process in

vessel for over-temperature

condition

• 24/7 surveillance with software

based decision making

• Process interruption/shutdown

on alarm

Thermal Image of vessel

Electrical Substation Monitoring

• Thermal monitoring of overload conditions

• 24/7 surveillance with software based decision making

• Assists in load balancing and troubleshooting on overload

conditions

• Helps to prevent catastrophic failures

Unmanned Aerial Surveillance

Boeing Scan Eagle Mini UAV Scans for Seal on the Arctic Ice

The Boeing Scan Eagle flies a grid pattern over sea ice in the arctic,

surveying the remaining seal populations. 850,000 images taken over

Bering Sea.

Camera Dome

System Features:

• Camera: FLIR A615/A315 thermal imagers

• DSLR for visible imaging

• Wi-Fi and satellite down/up links

• On-board, real-time image data analysis

• GEO TIFF Image tagging

• Unmanned Aircraft - flight times up to 18 hours

Image Source: Boeing

Image Source: CIRES Seals Detected

in scanned image

15540 Rockfield Blvd., Suite C-110

Irvine, CA 92618, USA

949.699.6600 x111 Phone

www.movimed.com

m.tarin@movimed.com

Interactive Q & A session

Feel free to email your questions as well