From Research to Reality:Advances in HLTDavid MurgatroydVP, Engineering

Basis Technology

2

To show what’s possible with recent advances in HLT so that you can consider how they can help your mission.

To connect today’s talks so that you can be more informed in listening to them.

To spur discussion to motivate and inform future advances in HLT.

Let me tell you a story…

3

This morning the CIA was asked by the President to assess the chance that the Syrian opposition would use chemical weapons by mid-2014.

As part of building that analysis, and because there are Al-Qaeda elements in the Syrian opposition, an analyst named Amanda was asked to characterize Al-Qaeda’s attitude on using chemical weapons against Middle Eastern governments.

A Story…

4

PhotoA document Amanda would want to see…

5

Photo

6

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

7

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

8

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

9

PhotoFrom: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

Dear Brother, We need guidance from you on the issue of using chlorine gas technology. It was reported that the brothers in Iraq have used it, but this was implicitly denied in a statement issued by the Islamic State of Iraq.

The brothers where Mahmud is have the potential to use chlorine gas on the forces of the apostates, Jalal Talabani and Mas'ud Barzani, and have already considered using it. However, I informed them that matters as serious as this require centralized [coordination] and permission from the senior [al-Qa'ida] leadership, because the gas could be difficult to control and might harm some people, which could tarnish our image, alienate people from us, and so on.”

10

From: Ayman Al-Zawahiri (?)To: “Hafiz Sultan”

3/28/07

11

3/28/07 Today

12

3/28/07 Today5/2/11

Raid in Abbottabad

13

3/28/07 Today5/2/11

Triage at Bagram AFB

5/3/11

14

3/28/07 Today5/2/11 5/3/11

15

3/28/07 Today5/2/11 5/3/11

16

3/28/07 Today5/2/11 5/3/11

17

3/28/07 Today5/2/11 5/3/11

Advance: Robust NLP for an application that’s not text-centric

18

3/28/07 Today5/2/11 5/3/11

19

3/28/07 Today5/2/11 5/3/11

20

3/28/07 Today5/2/11 5/3/11

Translation in Vienna, VA

5/12/11

21

3/28/07 Today5/2/11 5/3/11 5/12/11

22

3/28/07 Today5/2/11 5/3/11 5/12/11

23

3/28/07 Today5/2/11 5/3/11 5/12/11

24

3/28/07 Today5/2/11 5/3/11 5/12/11

25

3/28/07 Today5/2/11 5/3/11 5/12/11

26

3/28/07 Today5/2/11 5/3/11 5/12/11

Advance: Configuration to adaptation (cf., Deep Learning’s unsupervised pre-training; distributional semantics)

27

3/28/07 Today5/2/11 5/3/11 5/12/11

28

3/28/07 Today5/2/11 5/3/11 5/12/11

29

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1

30

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1Screen 2

31

3/28/07 Today5/2/11 5/3/11 5/12/11

Screen 1Screen 2

Advance: Collaboration of translator’s knowledge with computer’s fast extraction.

32

3/28/07 Today5/2/11 5/3/11 5/12/11

33

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

34

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Cataloging in “the cloud”

35

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

36

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

37

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

38

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Advance: From indexing strings to understanding things.

39

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

40

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

…characterize Al-Qaeda’s attitude on using chemical weapons against Middle Eastern governments.

41

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

42

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

43

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

44

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

45

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

46

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

47

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

48

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

49

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

50

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

51

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

52

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

53

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

54

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

55

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

56

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

57

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

58

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

59

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

60

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

61

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

62

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

63

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

64

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

65

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

66

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

67

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

68

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

69

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

70

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

71

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Advance: Taming Big Text through human-computer collaboration with confidence and correction.

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

3/28/07 Today5/2/11 5/3/11 5/12/11 5/14/11

Summary

Advances in HLT Include:1. Mission-driven Applications that need more than HLT2. Adaptation rather than Configuration3. Move from Indexing Strings to Understanding Things4. Broad Human-Computer Collaboration

Questions?

Questions?

Suggestions:1. How do you envision this story being different 5 years

from now?2. What does it look like to do human-computer

collaboration well?3. Could we someday replace standardizing to

transliterations to standardizing to resolved entities?