8/11/2019 0927_1425_Mr13_Khitrov

1/26

8/11/2019 0927_1425_Mr13_Khitrov

2/26

2

Each human voice is unique

Over 70 body parts participate in creatingspeech

Not what we say, but who is talking

Over 20 years of voice biometrics asforensic application

2010-2011 - from forensic products toautomatic large scale solutions

Accuracy similar or better than other biometric modalities

Voice Biometrics 101

8/11/2019 0927_1425_Mr13_Khitrov

3/26

Most natural way to communicate

In person

On the phone

Online

Easy to collect microphones everywhereRemote collection

Low cost (no need for costly collection devices)

Easy to enroll just say a few words

Ability to conduct verification / identificationduring regular communication

Existing audio archives911 calls

Call center recordings

CCTV

Wired operations

Why Voice?

8/11/2019 0927_1425_Mr13_Khitrov

4/26

Investigative tool

Wired operationsDatabase checks for suspects / persons of interest

Audio monitoring

Intelligence tool

Wealth of information from available voice samples

Fraud prevention

Real time cross check for call centers

Remote and physical access control

Voice-based ID for government services

Secondary biometric (multi-modal ID)

Border crossings

Bookings at arrest

Interviews

Practical Tasks in Law Enforcement

8/11/2019 0927_1425_Mr13_Khitrov

5/26

Operational Fast ID cross match turnaround

Stand alone system

Positive ID in seconds

Part of the multi-modal solution(SDK)

Fusion of biometric modalities

Real time monitoring

Lawful interception

Forensic

Scientific (expert) ID

Globally- Vast majority ofjurisdictions accept voice ID

US- Courts in 41 states alreadyaccept voice ID

Voice in Law Enforcement - 2 tier solution

8/11/2019 0927_1425_Mr13_Khitrov

6/26

Automatic:

Identification

Language ID

Emotional State

Gender

Key word search

Audio enhancement

Expert:

Recording device

Authenticity analysis

Educational background

Sicknesses

Body features

Content Analysis

Voice AnalysisAmazing Capabilities

8/11/2019 0927_1425_Mr13_Khitrov

7/267

Evolution of Voice Biometrics

Noisecancellation

Enhancement

Expert ToolsAnalyze

Voice

biometrics Automatedprocessing

Identify

Processing

Noisecancellation

Featureextraction

Cross channelvariability

Length ofrecordings

Accuracy ofalgorithims

Channelindependent

Languageindependent

Large scale

High accuracy

Real Time

Over 20 years of Expertise

& Experience with Analytics

Improvements and Innovations

with Algorithms

Advancements in ComputingPower

8/11/2019 0927_1425_Mr13_Khitrov

8/26

8

Voice vs Other Modalities

Voice is one of the most reliable biometric identification methods

8/11/2019 0927_1425_Mr13_Khitrov

9/26

Forensic systems - Long history of forensic deployments

Over 60 countries worldwide

Automatic voice identification

New capability

Dozens of countries deploy small scale systems

Latest deployments

Mexico nation wide

Turkey

Hungary

Beta testing of a state-wide system in Pennsylvania

Deployments to date

8/11/2019 0927_1425_Mr13_Khitrov

10/26

Forensic Laboratory in Baja CaliforniaNation-wide Automatic Voice Identification System (AVIS)

Case Study 1

10

8/11/2019 0927_1425_Mr13_Khitrov

11/26

Acoustic Forensic Laboratory in Baja California, Mexico

Background

Started operations in October 2009.

Laboratory Activities

Audio enhancement (noise cancellation) recordings.

Authenticity analysis (tempering detection)

Monitoring, recording and filtering of calls in real time.

Voice Identification in databases (1:N)

Voice Identification one on one (1:1)

Forensic Expert Analysis

Case Study 1

11

8/11/2019 0927_1425_Mr13_Khitrov

12/26

Available Equipment: Audio Analysis Stations - IKARLab

Voice Identification in Database VoiceGrid

Audio Enhancement Software Sound Cleaner

Audio Enhancement Hardware (real time filtering) - ANF

Authenticity Analysis Software EdiTracker

Recording Equipment - 2M Gnome and Gnome-Nano.

Case Study 1

Typical Cases for Voice Analysis:

Extortion

Terrorism

Telephone Threats

Corruption Cases

Kidnapping

12

8/11/2019 0927_1425_Mr13_Khitrov

13/26

Escorpio

Servidor

10.3.8.17

Base de Datos

Audios

Registros

MexicaliRegistros

Tijuana

Registros

Ensenada

Registros

MexicaliRegistros

Tijuana

Registros

Tecate

Registros

Tecate

Registros

Ensenada

Mexicali

C4

Tecate

Tijuana

Enesenada

CERESO

Mexicali

CERESO

Mediana

CERESO

Mediana

CERESO

TijuanaPEP

CERESO

Ensenada

Complejo

PFP

Voice Identification Network

Case Study 1

13

8/11/2019 0927_1425_Mr13_Khitrov

14/26

Police Voice Database in Baja California

18,000 voice cards:

Police and Law Enforcement agencies

Private security agentsInmates

Drug rehabilitation

Firefighters and civil protection personnel

Voices collected during investigations(wired operations, extortionand kidnapping calls)

Acoustic Forensic Laboratory in Baja California, Mexico

Case Study 1

14

8/11/2019 0927_1425_Mr13_Khitrov

15/26

Kidnapping Case

A gang of suspected kidnappers was arrested. There was a possibilitythat this gang participated in other kidnapping cases in the state.

Police were required to take a voice samples from the hostage takers to

determine whether they were involved in other kidnapping cases.

The police had a 36 hour deadline, at which time the public prosecutor

had to present the expert evidence to make the case.

Case Study 1Actual Case

15

8/11/2019 0927_1425_Mr13_Khitrov

16/26

All the equipment required for sampling voice and conducting

research had to be moved to another town.

The ransom call recordings provided by the public ministry were

reviewed and an interview format was developed.

Interviews were conducted with the alleged perpetrators andtheir voices were recorded with high quality equipment looking

for the best acoustic conditions.

Case Study 1Actual Case

16

http://localhost/var/www/apps/conversion/tmp/scratch_1/Picture%20030.MOVhttp://localhost/var/www/apps/conversion/tmp/scratch_1/Picture%20027.MOV

8/11/2019 0927_1425_Mr13_Khitrov

17/26

17

Police moved the lab to a strategic location for analysis, in this

case to a local hotel where the kidnappers were arrested.

Police began the forensic biometric analysis and psychological

assessment the recordings.

Kidnapper 1

Kidnapper 2

Kidnapper 1

Kidnapper 2

17

Case Study 1Actual Case

Ransom Calls

Interrogation Recordings

8/11/2019 0927_1425_Mr13_Khitrov

18/26

Results

36 hours to: Conduct an interview with hostage takers

Collect voice samples of 4 kidnappers

Analyze 30 calls of negotiation

Identify number of hostage takers to participate in negotiations

What was achieved in 36 hours: Comprehensive expert opinion for the judge

Results for the Police:

Identified that 2 of the 4 kidnappers were involved in 3 other kidnapping

cases It was determined that one of the kidnappers was a leading negotiator in

kidnapping gang

As a result 4 hostages that were still in captivity were freed

18

Case Study 1Actual Case

8/11/2019 0927_1425_Mr13_Khitrov

19/26

19

Corruption Case

Police were provided an audio recording in which two menallegedly discussed an extortion plot.

The recording was segmented to separate the voices of 2

speakers.

The voices were matched against the voice database and

identified speakers as 2 known individuals

Forensic analysis confirmed the identity of the speakers.

Original Call

Voice 1

Voice 2

Interrogation 1

Interrogation 2

Case Study 2Actual Case

8/11/2019 0927_1425_Mr13_Khitrov

20/26

20

Case Study 3

Nation-wide voice biometric platform in Mexico

First system of this scale in the world

Current capability of the database: 600K voice samples

Number of samples by 2011 over 1 Million

Access by 250 jurisdictions across the country

Peak performance 300K searches per minute

8/11/2019 0927_1425_Mr13_Khitrov

21/26

21

Voice identification for phone and onlinetransactions in real-time

AVIS Automatic Voice Identification System inevery jurisdiction

Multi-modal biometric systems to include voicecapability

Whats in the future?

8/11/2019 0927_1425_Mr13_Khitrov

22/26

22

About SpeechPro

A World Leader in Voice Technology:

SpeechPro is the US branch of Speech Technology

Center (STC)

STC Established in 1990

Offices in US, Mexico, Germany, Finland and HQ inSt. Petersburg Russia

Fully Certified ISO-9001:2008

STC has established a leadership position in a fast-growing

and po tent ial ly large sector of the voice biometr ics

marketplaceDan Miller, Senior Analyst at Opus Research, USA

8/11/2019 0927_1425_Mr13_Khitrov

23/26

350 employees worldwide including over 100 technical

specialists, scientists and software developers

Strong implementation, training and support team

Largest R&D Department of any Voice Biometrics company

Benefits:

Not dependent on 3rdparties for any technology changes

Can quickly react to market, partner & customer needs

Product Mod i f icat ions

Error Correct ion

Enhancements

Improvements

New Products

23

Company Resources

8/11/2019 0927_1425_Mr13_Khitrov

24/26

24

Worldwide Deployments

Global customer base in 65 countries

8/11/2019 0927_1425_Mr13_Khitrov

25/26

Voice Biometrics

from forensic toautomatic ID

New opportunities for law enforcement

Real World Successes

SpeechProis eager to Deliver, Adapt or

Modify Solutions for Specific Customer &

Partner Needs

25

CONCLUSION

8/11/2019 0927_1425_Mr13_Khitrov

26/26

26

CONCLUSION