HLT 2013 - From Research to Reality: Advances in HLT by David Murgatroyd

Post on 07-Dec-2014

371 views 0 download

Tags:

description

There's never been a more exciting time to be involved in Human Language Technology (HLT). Advances in algorithms, architectures, and applications are making real differences in fulfilling missions around the world. We'll use the perspective of one specific, end-to-end use case starting from primary source collection going all the way through finished intelligence to show the value and importance of moving your HLT thinking from strings to things, from configuration to adaption, from isolation to collaboration, and from small scale to Big Text. This perspective will serve as a guide to the other talks of the day which together will give you greater insight in applying HLT to your mission.

transcript

From Research to Reality:Advances in HLTDavid MurgatroydVP, Engineering

Basis Technology

2

To show what’s possible with recent advances in HLT so that you can consider how they can help your mission.

To connect today’s talks so that you can be more informed in listening to them.

To spur discussion to motivate and inform future advances in HLT.

Let me tell you a story…

3

This morning the CIA was asked by the President to assess the chance that the Syrian opposition would use chemical weapons by mid-2014.

As part of building that analysis, and because there are Al-Qaeda elements in the Syrian opposition, an analyst named Amanda was asked to characterize Al-Qaeda’s attitude on using chemical weapons against Middle Eastern governments.

A Story…

4

PhotoA document Amanda would want to see…

5

Photo

6

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

7

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

8

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

9

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

10

From: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

3/28/07

11

3/28/07 Today

12

3/28/07 Today5/2/11

Raid in Abbottabad

13

3/28/07 Today5/2/11

Triage at Bagram AFB

5/3/11

14

3/28/07 Today5/2/11 5/3/11

15

3/28/07 Today5/2/11 5/3/11

16

3/28/07 Today5/2/11 5/3/11

17

3/28/07 Today5/2/11 5/3/11

Advance: Robust NLP for an application that’s not text-centric

18

3/28/07 Today5/2/11 5/3/11

19

3/28/07 Today5/2/11 5/3/11

20

3/28/07 Today5/2/11 5/3/11

Translation in Vienna, VA

5/12/11

21

3/28/07 Today5/2/11 5/3/11 5/12/11

22

3/28/07 Today5/2/11 5/3/11 5/12/11

23

3/28/07 Today5/2/11 5/3/11 5/12/11

24

3/28/07 Today5/2/11 5/3/11 5/12/11

25

3/28/07 Today5/2/11 5/3/11 5/12/11

26

3/28/07 Today5/2/11 5/3/11 5/12/11

Advance: Configuration to adaptation (cf., Deep Learning’s unsupervised pre-training; distributional semantics)

27

3/28/07 Today5/2/11 5/3/11 5/12/11

28

3/28/07 Today5/2/11 5/3/11 5/12/11

29

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1

30

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1Screen 2

31

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1Screen 2

Advance: Collaboration of translator’s knowledge with computer’s fast extraction.

32

3/28/07 Today5/2/11 5/3/11 5/12/11

33

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

34

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Cataloging in “the cloud”

35

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

36

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

37

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

38

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Advance: From indexing strings to understanding things.

39

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

40

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

…characterize Al-Qaeda’s attitude on using chemical weapons against Middle Eastern governments.

41

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

42

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

43

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

44

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

45

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

46

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

47

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

48

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

49

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

50

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

51

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

52

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

53

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

54

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

55

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

56

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

57

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

58

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

59

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

60

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

61

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

62

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

63

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

64

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

65

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

66

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

67

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

68

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

69

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

70

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

71

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Advance: Taming Big Text through human-computer collaboration with confidence and correction.

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Summary

Advances in HLT Include:1. Mission-driven Applications that need more than HLT2. Adaptation rather than Configuration3. Move from Indexing Strings to Understanding Things4. Broad Human-Computer Collaboration

Questions?

Questions?

Suggestions:1. How do you envision this story being different 5 years

from now?2. What does it look like to do human-computer

collaboration well?3. Could we someday replace standardizing to

transliterations to standardizing to resolved entities?