Biometrics How Do I know Who You Are?

How Do I know Who You Are

Anil K. Jain

Michigan State University

http://biometrics.cse.msu.edu

October 29, 2014

1

Outline

2

• Why biometrics?

• What is biometrics?

• Automatic biometric recognition

• Research opportunities

• Where is biometrics heading?

Bank ATM

Input to ATM:

Card

PIN: 6-digit (4-digit in US)

3

Machine does not know who is inputting the card and PIN

Is This ATM Secure?

6-digit PIN

#1 000000

#2 111111

#3 112233

#4 123123

Most popular 6-digit PINs Stolen or duplicate ATM cards, CCTV

4 http://aq.cebnet.com.cn/2014/0916/295234.shtml

How to Make ATM More Secure?

Biometric ATM in Lanzhou

Finger Vein recognition

module

5

High security (Card, PIN and Finger Vein) or Convenience (finger vein only)

Credit Card Data Stolen, July 2014

• JP Morgan says data

belonging to 83M

customers was stolen

• 88% of stolen data

used within minutes

USA Today, October 3-5, 2014 6

Cash, Credit or Apple Pay?

Apple Pay, Oct 20, 2014 (your fingerprint is the password) USA Today, Oct. 21 2014

Mobile Payment

M-Pesa allows deposit, withdraw & transfer money with a mobile; $882M USD/month

Joseph Van Os/Getty Images World population is 7.3B; ~4.5B have mobiles

Security Threats • People can not be trusted based on ID documents

• INTERPOL has data on 40M lost/stolen travel documents

• Some of the 9/11 hijackers had multiple driver licenses

幽灵户口：江西神秘中介叫卖幽灵户口 假身份证或涉诈骗犯罪 http://stock.591hx.com 2014年01月24日 10:36:06 新京报

9

US VISIT (OBIM) Program, 2004

U.S. border security through fingerprint identification 10

What is Biometrics?

11 Recognize a person based on body traits, not ID card or PIN

Biometric Traits

12

Biometrics is Not New!

13

Friction Ridge Patterns

Cummins and Midlo, Finger Prints, Palms and Soles, Dover, 1961 14

Early Days of Fingerprints

Fingerprint on a fragment of Palestinian lamp (400-500 C.E.)

15

A thumb print on a Chinese clay seal (300 B.C.E)

A Chinese deed of sale signed with a finger print (1839 C.E.)

Cummins and Midlo, Finger Prints, Palms and Soles, Dover, 1961

Fingerprint Types and Features

: core point : delta point

Arch Loop Whorl

Ridge ending Ridge bifurcation

Scotland Yard first used fingerprints for catching criminals in 1905; FBI in 1924 16

10 print

Automatic Fingerprint Identification System (AFIS)

• Find duplicates in database and catch criminals

• First AFIS (FBI, 1980): Fingerprints of 70M criminals & 34M civilians

17

Assumption 1: Uniqueness

Even identical twins have different fingerprints 18

Assumption 2: Persistence

1881, age 7 1890, age 17 1913, age 40

Herschel showed fingerprints can be matched even with a large time gap

W. J. Herschel, “The Origin of Finger-printing”, Oxford University Press, 1916 19

Fingerprint Recognition at Disney Parks

20

India’s Aadhar Program

• Provide a 12-digit unique ID number (UID) to all Indian residents

• De-duplication (one person, one UID) using 10 fingers & 2 iris

• ~700M residents have received a UID since 2009 21

Biometric Systems in China

Face & fingerprint verification at Lo Wu Face verification at Beijing Olympics

Face recognition at Beijing Airport Iris recognition for coal mine workers 22

Biometric Recognition System

Feature Extractor

Template Database

Verification

Enrollment

Matcher

(similarity score)

Yes: score > T

No: score < T

Preprocessor Preprocessor

T: threshold or system operating point

23

Verification: 1:1 matching (you claim who you are) Identification: 1:N matching (you do not claim your identity)

Reference fingerprint

How to Match Two Fingerprints?

Who made this impression?

24

Similarity = 0.9 Match!

Fingerprint Similarity Score Distributions Fr

equ

en

cy

Similarity score

T = 0.18

Score: 0.10 False Reject

Score: 0.39 True Accept

Fingerprint Similarity Score Distributions Fr

equ

en

cy

Similarity score

T = 0.18 Score: 0.05 True Reject

Score: 0.21 False Accept

Face Recognition

Probe Gallery

MATCH

Challenge: What is the best set of features and similarity measure?

27

How to Match Two Faces?

Face detection and normalization

Face detection

Face detection

Landmark detection

Landmark detection

Face normalization

Face normalization

Probe Gallery

28

How to Match Two Faces?

MLBP feature extraction and matching

0 2000 4000 6000 8000 100000

0.2

0.4

0.6

0.8

1

Feature dimensionality0 2000 4000 6000 8000 10000

0

0.2

0.4

0.6

0.8

1

Feature dimensionality

Similarity = 0.6 Match!

29

Score: 0.50 False Reject

Score: 0.92 True Accept

Face Similarity Score Distributions

T = 0.52

30

Face Similarity Score Distributions

T = 0.52 Score: 0.05 True Reject

Score: 0.55 False Accept 31

State of the Art Performance

Users

Imag

ing

Co

nd

itio

ns

Cooperative Co

nst

rain

ed

100% TAR @ FAR=0.1%

99.4% TAR @ FAR=0.01%

FVC2002 FRGC, Exp. 1

Un

con

stra

ined

Altered fingerprint

97% TAR @ FAR=0.1%

FERET’06

75% Rank-1 accuracy

Uncooperative

99% TAR @ FAR=1.0%

72% Rank-1 accuracy

NIST SD27 LFW

32

FVC2004 MBGC

92.2% TAR @ FAR=0.01%

MBGC

98% TAR @ FAR=0.1%

Research Opportunities

33

Intra-person Variability

Same woman arrested at different times

34

35

Inter-person Similarity

Identical twins Father and son

35

Latent (Partial) Fingerprint Matching

Latent fingerprint Segmented and enhanced latent fingerprint

Mated rolled fingerprint

Unconstrained Face Detection & Recognition

37 Not all faces can be detected by the best algorithm!

Face Recognition in Video

20M surveillance cameras in China (3M in Beijing & Shanghai) 38

Recognize Person of Interest

39

Boston marathon bombing, April 15, 2013 Suspects Photo in database

Soft Biometrics: Scars, Mark & Tattoos

http://wtvr.com/2012/05/04/pictures-investigators-seek-shirtless-heavily-tattooed-suspect/ 40

Tattoos to Distinguish Identical Twins

Haircuts help to avoid confusion among the four identical six-year-old twins

http://www.cbsnews.com/8301-503543_162-57508537-503543/chinese-mom-shaves-numbers-on-quadruplets-heads/

Does the matching accuracy decrease with time?

June 2001 January 2003 January 2005

August 2007 April 2010 July 2013

Longitudinal Study of Fingerprints

Capacity of a Biometric Trait

Can we recognize all the 1.3B faces in China?

Biometric Spoof Attacks

2D fingerprint image 3D virtual spoof

2D image of spoof 3D printed spoof 2D fingerprint image

Spoof Vs. Real Fingerprint

Where is Biometrics Heading? • Biometric recognition will be everywhere: on-line

payment, airports & train stations, network access,…..

• Recognition will be made not just based on body trait(s) but also on “what you are doing” (context)

• Challenges:

– Recognize persons in unconstrained conditions

– Prevent spoof attacks & secure user templates

46

Biometrics For Lifetime

Inked finger of an Afghan woman after voting in Bamiyan, Afghanistan

Fingerprint capture of a baby at a health clinic in Cotonou, Benin

Beyond Person Recognition

48