Introduction to Bio-IDiom
April, 2018
Safer City Solutions Division
Corporate Marketing Division
NEC
NEC biometric authentication Bio-IDiom
3 © NEC Corporation 2018
Wave of rapidly progressing digitization
10.4
15.4
30.4
7
7.3 7.7
0
5
10
15
20
25
30
35
2011 2015 2020
Number of IoT devices
billion
World population
billion
Progress of Digital Transformation
4 © NEC Corporation 2018
Digital Game changer=
Changes through Digitization
Immense improvement in productivity
Emergence of unexpected competition
5 © NEC Corporation 2018
Empowering companies, industries, cities and people
People Cities
EnterprisesIndustries
Real world
Cyber world
Visualization
Analysis
Prescription
Adds new significance to people, things, and contexts
NEC’s Digital Transformation
Changes through Digitization
6 © NEC Corporation 2018
Authenticated with biometric features as the key you naturally possess.
Biometrics to become a common part of our daily lives.
No
carrying
No
waiting
No forgetting
No
passing
Trust and sharing
without passing of physical keys.
Access to services without
carrying IDs
Use of services
without waiting
Safe and secure credential that
can never be forgotten
Biometric authentication in our lives and society
7 © NEC Corporation 2018
Iris
Ear acoustic
Fingerprint/
Palmprint
NECの生体認証
Finger vein
Voice
NEC’s biometric authentication solutions
Face
8 © NEC Corporation 2018
Digital
A world with risks
NEC’s biometric authentication
NEC’s biometric authentication solutions
Bio-IDiom
A safe digital
environment for all
people
9 © NEC Corporation 2018
Instant authentication can generate trust
bring the world closer together.
Biometric authentication technologies use physical features
of face, iris, ear, voice, palm, and finger to identify individuals.
Possible applications range from security to services
for governments, corporations and individuals.
For over half a century NEC has engaged in the research
and development of biometric authentication technologies.
As the pioneer in the field, NEC strives to offer flexible and
reliable biometric authentication to connect people and
society globally for a safe and prosperous future.
Ear acoustic
Fingerprint
Palmprint
Finger vein
Voice
Iris
Face
You are the key.
NEC’s biometric authentication: Bio-IDiom
The Bio-IDiom Brand Story
10 © NEC Corporation 2018
Social Value Creation
Bio-IDiom
11 © NEC Corporation 2018
For the Safety, Security + Efficiency, Equality of society
Biometric authentication for Social Value creation
SmartTransportation
DigitalGovernment
Public Safety
Fraud detection
Enhanced
Citizen Service
ID theft
prevention
EducationIris
Finger vein
Voice
Fingerprint/
Palm print
Ear acoustic
Face
Safety・Security Efficiency・Equality+
・・・
・・・
Mega events
Payments
Entertainment
Enterprise
12 © NEC Corporation 2018
Over 700 systems in over 70 countries globally
Systems for Criminal Investigation,
Immigration Control, National IDs, Entertainment, etc.
Global Deployment of NEC’s Biometric Authentication Solutions
13 © NEC Corporation 2018
South Wales Police, UK: Real-time face recognition
Real-time Watchlist detection for mega event security.
Challenges
Solution
Results
FaceRecognition NEC Press Release https://www.nec.com/en/press/201707/global_20170711_01.html
Deployed during the week of the UEFA Champions League finals (June
2017), and contributed to the safe event management
NeoFace Watch real-time face recognition system
Ensuring safety Ensuring and security in key locations with a
high crowd level such as airports and stadiums
170,000 spectators
Database of 500,000
Mega Events
Matching of images captured from
surveillance cameras mounted on
police vehicles against a database of
50,000 face images of persons of
interest, missing people etc.
Real-time matching for fast and
accurate identification of individuals.
Watchlist Detection
Actual arrests
14 © NEC Corporation 2018
USA: LA County Sheriff’s Department MBIS system
One of world’s largest biometric criminal investigation service.
Challenges
Solution
Results
NEC Press Release https://www.nec.com/en/press/201803/global_20180315_03.html
Quick and efficient identity verification in the field and in prisons.
⇒Resolution of more cases.
Multi-modal identification biometric solution
Increase efficiency of criminal investigation.
Matching of biometrics captured in crime scenes
for suspect verification.
Connect to federal and local law enforcement
databases. (Including California DOJ and FBI)
Uncovered 107 hits including 2 cold case
homicides in the first 7 days.
Criminal Identification
FaceRecognition
FingerprintRecognition
15 © NEC Corporation 2018
Singapore: Safety and Security trial
Safety and security of the country through inter-agency collaboration.
Challenges
Solution
Results
NEC Press Release https://www.nec.com/en/press/201801/global_20180117_01.html
Testing of usability of biometrics, video and acoustic analysis technologies for
safety and security in cities and critical infrastructures.
NeoFace face recognition, fingerprint recognition, video and acoustic
analytics
Use of data analytics to meet safety and security needs.
Use of face and fingerprint recognition for enhanced
security at entry points into Jurong Island.
Monitoring for suspicious opening of doors/ windows of
busses entering the area.
Early detection of suspicious individuals and behaviors
using data input from multiple sensors such as
surveillance cameras, microphones etc.
Urban SurveillanceWatchlist Detection
FaceRecognition
FingerprintRecognition
16 © NEC Corporation 2018
Frictionless exit control system using face recognition.
USA: CBP US Exit Control face recognition
NEC press release https://www.nec.com/en/press/201706/global_20170627_03.html
Immigration Control
Enhanced security for exit control using face recognition.
Enable frictionless exit process.
Walkthrough face recognition system NeoFace Express
Reduce processing time, enhance customer service and safety of airport
operations.
FaceRecognition
Exit control trial in several US airports
including Dulles International Airport.
Checking ageist passport DB (US citizens) and
entry data (visitors) to confirm the identities of
those leaving the country.
Enhance security and enable detection of
illegal overstays of foreign visitors.
Challenges
Solution
Results
17 © NEC Corporation 2018
South Wales Police, UK: Real-time face recognition
Real-time Watchlist detection for mega event security.
Challenges
Solution
Results
FaceRecognition NEC Press Release https://www.nec.com/en/press/201707/global_20170711_01.html
Deployed during the week of the UEFA Champions League finals (June
2017), and contributed to the safe event management
NeoFace Watch real-time face recognition system
Ensuring safety Ensuring and security in key locations with a
high crowd level such as airports and stadiums
170,000 spectators
Database of 500,000
Mega Events
Matching of images captured from
surveillance cameras mounted on
police vehicles against a database of
50,000 face images of persons of
interest, missing people etc.
Real-time matching for fast and
accurate identification of individuals.
Watchlist Detection
Actual arrests
18 © NEC Corporation 2018
Faster and securer immigration control with face recognition.
JFK International Airport, USA: Entry Control system
NEC press release https://www.nec.com/en/press/201605/global_20160505_01.html
Immigration Control
Enhanced security with face recognition at Automated Passport Control
kiosks at JFK International Airport in New York.
NeoFace face recognition engine.
Reduce processing time, enhance customer service and safety of airport
operations.
FaceRecognition
Matching of face data in the e-passport
against the photo of the passenger
captured at the kiosk, to ensure the
legitimate owner of the passport is entering
the country.
System delivered by Unisys and in
operation since January 2016.
Challenges
Solution
Results
19 © NEC Corporation 2018
Preventing illegal activities at airport customs control.
Brazil: Face recognition for 14 international airports
FaceRecognition
Detection of pre-registered individuals who have been registered for
suspicious activities.
NeoFace Watch real-time face recognition system
Increase efficiently and rigor of customs control at airports.
Used to enhance efficiency and
effectiveness of customs operations in 14
international airports in Brazil.
Screening of passengers as they walk past
the customs control area based on a
database of pre-registered suspects.
Challenges
Solution
Results
Enhanced Citizen Services
NEC press release https://www.nec.com/en/press/201507/global_20150716_02.html
20 © NEC Corporation 2018
Social services for 1.2 billion with multi-modal biometrics.
India: Aadhaar (Unique Identification numbers) Program
FaceRecognition
FingerprintRecognition
IrisRecognition
Accurate citizen data registered with the government.
Equal and efficient social services for citizens.
Multi-modal biometric authentication system.
Equal services for its 1.2 billion citizens.
ID theft prevention
Multi-modal system combining face,
fingerprint and iris recognition to identify
individuals.
Prevent duplicate registrations and
ensure all citizens have equal access to
services such as food supply,
employment and tax payment.
Challenges
Solution
Results
Enhanced Citizen Services
http://www.google.co.jp/imgres?imgurl=http://newsonair.nic.in/feature-image/uid_logo.jpg&imgrefurl=http://newsonair.nic.in/AADHAAR-UID-Card-THE-NUMBERS-FOR-LIFE.asp&usg=__LtKpEwWGRAWj01ZaF6wBUAqt1uY=&h=402&w=633&sz=104&hl=ja&start=9&zoom=1&tbnid=7phuecH93sCe3M:&tbnh=87&tbnw=137&prev=/images?q=aadhaar&hl=ja&sa=N&gbv=2&tbs=isch:1&itbs=1http://www.google.co.jp/imgres?imgurl=http://newsonair.nic.in/feature-image/uid_logo.jpg&imgrefurl=http://newsonair.nic.in/AADHAAR-UID-Card-THE-NUMBERS-FOR-LIFE.asp&usg=__LtKpEwWGRAWj01ZaF6wBUAqt1uY=&h=402&w=633&sz=104&hl=ja&start=9&zoom=1&tbnid=7phuecH93sCe3M:&tbnh=87&tbnw=137&prev=/images?q=aadhaar&hl=ja&sa=N&gbv=2&tbs=isch:1&itbs=1
21 © NEC Corporation 2018
Fist in Japan! Face recognition for all local governments.
Tagging of face data to the registered individual at issuance to enable the use of My
Number Cards as a method of authentication in various use cases.
ID verification using face recognition at the issuance counters in local
government facilities nationwide (1,743 organizations).
Preventing identity fraud at My Number Card issuance.
Japan: Identity verification for My Number Card
NEC Technical Journal https://www.nec.com/en/global/techrep/journal/g17/n01/170116.html
Source: The Mainichi, Jan 8, 2016
FaceRecognition
●●●●●●■■■■■■■■■■■■■■■■
Prevent ID fraud at card issuanceMatching of face data against the registered image.
Local governments
nationwide
マイナンバー
カード交付受付
Person at the office
for issuance
Face data in the
My Number Card database
Match
Face recognition is used to verify identity of citizens
at My Number Card issuance in the local
government facilities nationwide.
In operation since January 2016 with the
introduction of My Number Card system in Japan.
Challenges
Solution
Results
ID theft prevention
22 © NEC Corporation 2018
Japan: Local government offices
Enhanced operations and efficiency for better citizen services.
ID verification solution with finger hybrid recognition, and face recognition.
Efficient security measure for local governments.
FaceRecognition
FingerprintRecognition
More projects with the start of My Number Card operations.
Instant and accurate authentication with the simple scanning of
finger, or face by sitting in front of the PC.
Simpler and more convenient than using an IC card
Improves the efficiency of the increasingly complex card
issuing/management operation and reduces the risks of cards
getting lost.
Challenges
Solution
Results
Enhanced Citizen Services
23 © NEC Corporation 2018
Identity theft prevention
Japan: Concert Ticket Holder Identity Verification
NEC Online TV: https://www.nec.com/en/global/onlinetv/en/concert.html
Supports events of every size or scale. Reduces burden on audience by eliminating
the need to bring photo IDs to the venue.
NeoFace face recognition engine for identity verification.
Risk of entry with resold tickets using borrowed or fake IDs.
Ticket resell prevention and smooth admission!FaceRecognition
Matching of faces captured using tablets at admission with the pre-
registered face images of the ticket holders.
Supports events of any size and scale, including those with tens and
thousands of audience through fan clubs.
Reduces admission time by up to 30% compared to visual inspection by
concert staff, enabling smooth entry for the audience.
Challenges
Solution
Results
Mega Event
24 © NEC Corporation 2018
Japan: Universal Studio Japan Admission
NEC OnlineTV: https://www.nec.com/en/global/onlinetv/en/usj.html
Smooth admission and a VIP like experience for visitors.
NeoFace face recognition engine
Printing annual passes with facial photos, and visual inspection by staff.
VIP-like entry in to the park with face recognition!FaceRecognition
Face recognition deployed at special gates for annual pass holders ensures smooth
entry into the park and gives visitors that VIP feeling.
Visitors swipe their annual pass over the reader, face the monitor, and wait one
second for the system to recognize their face.
Significantly reduces the time needed to issue the passes.
Prevents the use of passes by persons other than the registered pass holder.
Challenges
Solution
Results
Enhanced Citizen Services
25 © NEC Corporation 2018
Taiwan: Taipei Summer Universiade access control
Face recognition based access control in the
main operation centre in Taipei Arena.
Used for the access control for the 750 staff
members entering the venue daily.
Enable “walkthrough recognition” without having
to stop to be authenticated.
NEC press release https://www.nec.com/en/press/201710/global_20171027_01.html
Mega Event
Secure and smooth personal authentication at entrance.
Contribute to the safe and secure event operation.
NeoFace face recognition engine
Enhancing venue security with access control for staff members.
FaceRecognition
Challenges
Solution
Results
Smooth and secure venue access with face recognition.
Identity theft prevention
26 © NEC Corporation 2018
India: Lemon Tree Hotels
NEC press release htttp://jpn.nec.com/press/201411/20141127_02.html
Adopted as a new security standard in the hospitability field in India.
NeoFace Watch real time face recognition system.
Detecting persons of interest who could be a threat to the hotel.
FaceRecognition
Face recognition to ensure safe and pleasant experience.
Deployed at Delhi Aerocity Hotel of Lemon Tree
Hotels, a major hotel chain in India.
Real time matching of faces as people enter the
hotel, against a database of potential threats
provided by local authorities.
System also has the ability to detect VIP
customers for enhanced customer service.
Watchlist Detection
Challenges
Solution
Results
Enhanced Citizen Services
27 © NEC Corporation 2018
Singapore: OCBC Bank VIP recognition
Trial in Holland Village Branch.
Real-time identification of VIPs as they enter the
lounge.
Customized service (preference of drinks, magazines)
based on VIP data.
Input of purpose of visit and feedback for future
services.
First bank in Singapore to use face recognition.
Identify Premier Banking members with their faces and enhance services for
VIPs.
NeoFace face recognition engine
Enhanced service for VIP customers.
NEC press release https://www.nec.com/en/press/201802/global_20180214_02.html
Enhanced Citizen Services
Challenges
Solution
Results
Elevate customer experience using face recognition.FaceRecognition
28 © NEC Corporation 2018
Face recognition for walk-through entry!
Japan: Walk-through Entry (NEC in-house trial)
Efficient operation at the entrance with walk-through authentication.
Neo Face Access Control for entry/ exit management.
Employees need to stop at security gates for ID card authentication.
Unable to prevent entry using someone else’s employee card.
Prevention of identity theft
FaceRecognition
Matching of photos of employees captured at the gate against the database of pre-
registered employee face data. No need to stop in front of the camera.
Trial with about 1,000 employees at the NEC Headquarter building in Tokyo.
To improve practical technical performance and accumulate know-how for capturing
good quality images for accurate identification of individuals.
Challenges
Solution
Results
29 © NEC Corporation 2018
Making cashless and cardless payments possible
NEC press release https://www.nec.com/en/press/201606/global_20160621_01.htmlFaceRecognition
Payments via face recognition helps to improve business efficiency and ensures
verification of the person’s identity.
NeoFace face recognition engine
Payments at the cashier takes too long. Fraud using stolen ID cards.
Verifies identity by comparing faces captured at the POS terminal against the pre-
registered face images of employees.
Feasibility of face recognition for cashless/ cardless payment was verified through the
trail at shops in the NEC Headquarter building with 500 employees.
To improve practical technical performance and accumulate operation know-how of
recognition performance and operation load under various conditions in shops.
Challenges
Solution
Results
Prevention of identity theft
Japan: Payment Service (NEC in-house trial)
30 © NEC Corporation 2018
Biometric Authentication
Technology
Bio-IDiom
31 © NEC Corporation 2018
Different biometric authentication technologies
Finger
Hand
writing
Face
Voice
Iris
Palm
print Oto-acoustic
Vein
Convenience
Accuracy
High
Low
HighLow
*Source: Addition to “Biometrics Market White Paper 2007 version” Yano Research Institute, Ltd.
DNA
NEC’s key technology
• Fingerprint recognition offers great convenience with high accuracy and ease of use.
• Face recognition is highly convenient in that it does not require any special actions
⇒Walk-through entry/ exit while holding your luggage, etc.
Characteristics of different biometric authentication
32 © NEC Corporation 2018
Multi-modal
authentication
Combination of various biometrics
such as fingerprint, face, and iris.
1970 1980 1990 2000
History of NEC’s Biometric Authentication technology
• Wider range of application in our daily lives
through enhancement of technology and
combination of different modalities.
A pioneer with over 40 years of experience in R&D
1982: Metropolitan Police
Department (Japan)
1971: Started research
for fingerprint recognition
Early 1990’s: Criminal AFIS for states across US
Late 1990’s: Global deployment
1984: San Francisco Police Department
2008: Developed finger hybrid recognition technology
2003: Ranked No.1 in US Government benchmark testing
1989: Started research
for face recognition
1996 Started 3D face recognition R&D
1999 Commercialization of face recognition
2003 Global deployment
2009, 2010, and 2013:Ranked No.1 in US Government benchmark testing
2017: Ranked No.1 for the 4th consecutive time in
US Government benchmark testing
Fingerprint
Recognition Face
Recognition
2010
33 © NEC Corporation 2018
NIST:National Institute of Standards and Technology
*Voice recognition technology was also ranked No1.
*Iris recognition benchmark testing currently in progress.
FpVTE2003
FpVTE2012
Slap Fingerprint Segmentation
Evaluation 2004
MINEX2016
Evaluation of Latent Fingerprint
Technologies 2007(ELFT2007)
NIST Proprietary Fingerprint
Template Testing (PFT2009、PFTⅡ 2013)
Multiple Biometric
Grand Challenge 2009(MBGC2009)
Multiple Biometrics
Evaluation 2010(MBE2010)
Face Recognition Vendor
Test 2013(FRVT 2013)
MBE
Face In Video Evaluation (FIVE)
World-class Technology: US NIST* Benchmark Testing
Fingerprint
recognition
Face
recognition
http://fingerprint.nist.gov/slapseg04/index.htmlhttp://fingerprint.nist.gov/slapseg04/index.htmlhttp://fingerprint.nist.gov/minex04/index.htmlhttp://fingerprint.nist.gov/minex04/index.htmlhttp://fpvte.nist.gov/index.htmlhttp://fpvte.nist.gov/index.html
34 © NEC Corporation 2018
Detection of faces from images/ videos and analyzing features to identify individuals
Robustness against varying conditions
Face Recognition
Faces are recognized through 2 processes, “face detection” and “face matching”
Detecting faces. (number of faces, position, size, face features, etc.)
Matching faces to “identify” who it is. (Verifying face features, searching for matches in the
database, showing results based on matching scores, etc.)
Achieves high accuracy with robustness against varying environment and conditions.
Face Angle
Lighting Expression Aging
Infrared
camera
images
DETECT
MATCH
Verify features
Face detection:“Detect faces” from images
Face Matching:Verify if it is the same person
35 © NEC Corporation 2018
Iris Recognition
Extremely high accuracy and speed of recognition
Contact-less, hands-free recognition in the same way as face recognition. Biometrics
information is not left on the capturing device.
Uses near infrared lighting (LED) and a camera, enabling use in dark locations.
Retina
Pupil
Iris
Matching of the iris features, muscle pattern around the pupil, to identify individuals.
36 © NEC Corporation 2018
Fingerprint/palmprint recognition
NEC’s unique high-speed and highly accurate recognition technology.
Abundant track record of installations around the world.
Based on international standard for fingerprint/palm print, and minutia data formats and the data is compatible with other systems.
With its “permanence” and “uniqueness”, fingerprint and palmprint is used forapplications with rigid recognition such as criminal investigation and National IDsystems in Public Safety market worldwide.
Digitized dataOriginal image is discardedafter digitization
Minutiae andrelated method
Relation network
Original image
Registered data
Only the digitalized data is stored
Print images of individuals
are irreversible [Protection of privacy]
Analyzing fingerprint/ palmprint features extracted from finger/ palm for recognition.
37 © NEC Corporation 2018
Combination of fingerprint and finger vein makes it difficult to forge or steal. It is used widely for access to PCs in governments and enterprises.
● Capable of reading fingerprint and finger vein information simultaneously by simply placing a finger over the reader.
● World’s first finger hybrid identification technology for secure user authentication.
Finger vein recognition
High-speed and highly accurate recognition technology.
Difficult to forge as it uses vein patterns inside a finger.
Contactless capture of fingerprint and finger vein data, for hygienic benefits and protection of privacy (no data is left on the device surface).
Hybrid fingerprint recognition solution
Detection finger vein patterns of the finger to identify individuals.
For Japan domestic market only
38 © NEC Corporation 2018
Voice recognition
Contact-less, hands-free recognition.
Identifies an individual remotely through a telephone, etc.
Not depend on the language spoken.
No need for special devices (standard microphone on smart phone and tablet).
A
C
E
B
D
F
G H
Voice database Verify
Recommended data size:
30 - 60 seconds/person
Voice data of 10 seconds
or more is recommended.
Picks up voice through a microphone and identify individuals by analyzing features.
39 © NEC Corporation 2018
Ear acoustic recognition
Analyzing the sound
reflection patterns
Peak of 5 - 8 kHz (Supports distance of 2 - 3 cm to the ear drum)
Hearable device
Transmitted
signal
Received
Signal
Identification using
unique patterns
A
B
C
Recognition using the shape of the ear cavity that are unique to each individual.
High-speed and highly accurate recognition technology.
Contact-less, hands-free recognition.
Applicable for locations where users wear masks or gloves, such as in hospitals.
Highly secure method of authentication.
High affinity for real life application, without the need to look at any screens, etc.
40 © NEC Corporation 2018
High accuracy/ security
User friendly
Multi-modal authentication
Ear acoustic
Fingerprint/palm print
Finger vein
Voice
Face
Iris
+Bio-IDiom
Authentication by
combining multiple modals
Multi-modal authentication by combining different biometric recognition modalities.