SURFnet Relatiedagen 2010Noordwijkerhout December 9, 2010

Searching in spoken wordsDisclosure of recorded content in MediaMosa

Speech & Language

TechnologyA.J.vanHessen@ewi.utwente.nl

• Introduction

– Why speech is so important

– What is HLT?

• Working applications:

– Self-service (Internet & Telephony)

– Searching in recorded audiovisual recordings

• Demonstrations

What is HLT?

• Human Language Technology is the technology that mimics the human language capacity.

speech text sign

Redundancy

• Vlgones een oznrdeeok op een Eglneseuvinretsiet mkaat het neit uitin wlkeevloogdre de ltteers in een wrood saatn, het einge watblegnaijrk is is dat de eretse en de ltaatse ltteer op de jiutsepatals saatn. De rset van de ltteers mgoen wllikueirggpletaastwdoren en je knut vrelvogensgwoeon lzeen wat er saatt. Dit kmotodmatwe neit ekle ltteer op zcih lzeen maar het wrood als gheeel.

WORKING APPLICATIONS

Dialogue systems (telephony, real time, limited complexity)

Disclosure systems (high quality audio, offline, complex)

Dictation

Voice

Information Retrieval

Mens-Machine-Communicatie

Emotie detectie:Lachen/Huilen

Spoken Document Retrieval

Web

Mobile

ContactCenter

Natural Language Search

HLT

Companies using speech technology

How may I help you

Who is calling?Identification via ZIP-

code and house number

Why are they

calling?Classification based on

the recognition of the

question: “how may I

help you”

Organisations using speech technology

Disclosure of audiovisual archives

• The number of AV-archives on the Internet increases rapidly

• Archiving is not enough: disclosure and reusing is required!

• The use of HLT is needed (humans cost too much).

Buchenwald

Digitalized (historic)

collections

H.M. Koningin

Wilhelmina

Digital recorded collections

Second feministic wave

Memories of Indonesia

WFH

LVSR

Searching in historic radio recordings:Radio Oranje

Oral History: Buchenwald

Oral History: Brandgrens, Rotterdam

10 getuigen van het bombardement van Rotterdam (mei ‘40) vertellen hun verhaal. TST wordt gebruikt om in de getuigenissen te zoeken.

Searching in the radio interviews of WFH

Searching in 46 interview collections:getuigenverhalen (600 hour)

Searching in 500 interviews in Croatia

CroMe - Audio Search

Search word traumas

Language

found

Political metings

Parliament

transcriptions

Gisteren was er een bespreking ivm de betrekkingen tussen Nederland en Vlaanderen

Recognition of lectures

• Record the speech

• Record the PPT

• Recognise the speech

• Use the display time of each slide as THE time unit

• Use the recognised speech as keywords for each slide

Searching in news broadcasts

Questions?