Lecture12:Informa1onExtrac1on
ThisLecture
‣ Howdowerepresentinforma1onforinforma1onextrac1on?
‣ OpenInforma1onExtrac1on
‣ Rela1onextrac1on
‣ Slotfilling
‣ Seman1crolelabeling/abstractmeaningrepresenta1on
Represen1ngInforma1on
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
BrutusstabsCaesar
‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
BrutusstabsCaesar stab(Brutus,Caesar)=>true
‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
BrutusstabsCaesar stab(Brutus,Caesar)=>true
‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse
Caesarwasstabbed
Seman1cRepresenta1ons
Examplecredit:AsadSayeed
personBrutusCaesarObamaBush…
stabBrutus Caesar
…
‣ “World”isasetofen11esandpredicates
president
Obama
Bush…
BrutusstabsCaesar stab(Brutus,Caesar)=>true
‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse
Caesarwasstabbed ∃xstab(x,Caesar)=>true
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)∧with(e,knife)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)∧with(e,knife) ∧loca1on(e,theater)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)∧with(e,knife) ∧loca1on(e,theater)
∧1me(e,IdesofMarch)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)
‣ Letsusdescribeeventsashavingproper1es
∧with(e,knife) ∧loca1on(e,theater)
∧1me(e,IdesofMarch)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)
‣ Letsusdescribeeventsashavingproper1es‣ Unifiedrepresenta1onofeventsanden11es:
∧with(e,knife) ∧loca1on(e,theater)
∧1me(e,IdesofMarch)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)
‣ Letsusdescribeeventsashavingproper1es‣ Unifiedrepresenta1onofeventsanden11es:
somecleverdriverinAmerica
∧with(e,knife) ∧loca1on(e,theater)
∧1me(e,IdesofMarch)
Neo-DavidsonianEvents
Examplecredit:AsadSayeed
BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch
∃estabs(e,Brutus,Caesar)
‣ Letsusdescribeeventsashavingproper1es‣ Unifiedrepresenta1onofeventsanden11es:
∃xdriver(x)∧clever(x)∧loca1on(x,America)
somecleverdriverinAmerica
∧with(e,knife) ∧loca1on(e,theater)
∧1me(e,IdesofMarch)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
who?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
who?whichaYernoon?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
who?
???
whichaYernoon?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
‣ Needtoimputemissinginforma1on,resolvecoreference,etc.
who?
???
whichaYernoon?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
RealText
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?
‣ Needtoimputemissinginforma1on,resolvecoreference,etc.
‣ S1llunclearhowtorepresentsomethingspreciselyorhowthatinforma1oncouldbeleveraged(severalprominentRepublicans)
who?
???
whichaYernoon?
∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)
OtherChallenges
BobandAlicewerefriendsunGlhemovedawaytoaHendcollege
OtherChallenges
BobandAlicewerefriendsunGlhemovedawaytoaHendcollege
∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)
OtherChallenges
BobandAlicewerefriendsunGlhemovedawaytoaHendcollege
‣ Howtorepresenttemporalinforma1on?
∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)
OtherChallenges
BobandAlicewerefriendsunGlhemovedawaytoaHendcollege
‣ Howtorepresenttemporalinforma1on?
∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)
BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege
OtherChallenges
BobandAlicewerefriendsunGlhemovedawaytoaHendcollege
‣ Howtorepresenttemporalinforma1on?
‣ Represen1ngtrulyopen-domaininforma1onisverycomplicated!Wedon’thaveaformalrepresenta1onthatcancaptureeverything
∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)
BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege
(Atleast)ThreeSolu1ons
(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…
(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…
‣ Slotfilling:specificontology,populateinforma1oninapredefinedway
(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…
‣ Slotfilling:specificontology,populateinforma1oninapredefinedway
(Earthquake:magnitude=8.0,epicenter=centralItaly,…)
(Atleast)ThreeSolu1ons
‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)
‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…
‣ Slotfilling:specificontology,populateinforma1oninapredefinedway
(Earthquake:magnitude=8.0,epicenter=centralItaly,…)
(Atleast)ThreeSolu1ons
‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)
(LadyGaga,singerOf,BadRomance)
‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…
‣ Slotfilling:specificontology,populateinforma1oninapredefinedway
(Earthquake:magnitude=8.0,epicenter=centralItaly,…)
OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology
‣ Extractstringsandletadownstreamsystemfigureitout
OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.
‣ Extractstringsandletadownstreamsystemfigureitout
OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.
(BarackObama,signed,theAffordableCareact)
‣ Extractstringsandletadownstreamsystemfigureitout
OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology
BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.
(BarackObama,signed,theAffordableCareact)
(SeveralprominentRepublicans,denounce,thenewlaw)
‣ Extractstringsandletadownstreamsystemfigureitout
IE:TheBigPicture
‣ Howdowerepresentinforma1on?Whatdoweextract?
‣ Slotfillers‣ En1ty-rela1on-en1tytriples(fixedontologyoropen)
‣ Seman1croles
‣ Abstractmeaningrepresenta1on
Seman1cRoleLabeling/ AbstractMeaningRepresenta1on
Seman1cRoleLabeling
Seman1cRoleLabeling
FigurefromHeetal.(2017)
Seman1cRoleLabeling
‣ Iden1fypredicate,disambiguateit,iden1fythatpredicate’sarguments
FigurefromHeetal.(2017)
Seman1cRoleLabeling
‣ Iden1fypredicate,disambiguateit,iden1fythatpredicate’sarguments
‣ VerbrolesfromPropbank(Palmeretal.,2005)
FigurefromHeetal.(2017)
Seman1cRoleLabeling
‣ Iden1fypredicate,disambiguateit,iden1fythatpredicate’sarguments
‣ VerbrolesfromPropbank(Palmeretal.,2005)
FigurefromHeetal.(2017)
quicken:
Seman1cRoleLabeling
FigurefromHeetal.(2017)
Seman1cRoleLabeling
FigurefromHeetal.(2017)
‣ Iden1fypredicates(love)usingaclassifier(notshown)
Seman1cRoleLabeling
FigurefromHeetal.(2017)
‣ Iden1fypredicates(love)usingaclassifier(notshown)
‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove
Seman1cRoleLabeling
FigurefromHeetal.(2017)
‣ Iden1fypredicates(love)usingaclassifier(notshown)
‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove
‣ Othersystemsincorporatesyntax,jointpredicate-argumentfinding
SRLforQA
ShenandLapata(2007)
‣ Ques1onandseveralanswercandidates
Q:Whodiscoveredprions?
AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…
AC2:Prionswereresearchedby…
SRLforQA
ShenandLapata(2007)
‣ Ques1onandseveralanswercandidates
Q:Whodiscoveredprions?
AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…
AC2:Prionswereresearchedby…
SRLforQA
ShenandLapata(2007)
‣ Ques1onandseveralanswercandidates
Q:Whodiscoveredprions?
AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…
AC2:Prionswereresearchedby…
SRLforQA
ShenandLapata(2007)
‣ Ques1onandseveralanswercandidates
Q:Whodiscoveredprions?
AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…
AC2:Prionswereresearchedby…
Scorebymatchingexpectedanswerphrase(EAP)againstanswercandidate(AC)
AbstractMeaningRepresenta1on
‣ Graph-structuredannota1on
Theboywantstogo
Banarescuetal.(2014)
AbstractMeaningRepresenta1on
‣ Graph-structuredannota1on
Theboywantstogo
Banarescuetal.(2014)
‣ SupersetofSRL:fullsentenceanalyses,containscoreferenceandmul1-wordexpressionsaswell
AbstractMeaningRepresenta1on
‣ Graph-structuredannota1on
Theboywantstogo
Banarescuetal.(2014)
‣ SupersetofSRL:fullsentenceanalyses,containscoreferenceandmul1-wordexpressionsaswell
‣ F1scoresinthe60s:hard!
AbstractMeaningRepresenta1on
‣ Graph-structuredannota1on
Theboywantstogo
Banarescuetal.(2014)
‣ SupersetofSRL:fullsentenceanalyses,containscoreferenceandmul1-wordexpressionsaswell
‣ F1scoresinthe60s:hard!
‣ Socomprehensivethatit’shardtopredict,buts1lldoesn’thandletenseorsomeotherthings…
Summariza1onwithAMR
Liuetal.(2015)
Summariza1onwithAMR
Liuetal.(2015)
‣MergeAMRsacrossmul1plesentences
Summariza1onwithAMR
Liuetal.(2015)
‣MergeAMRsacrossmul1plesentences
‣ Summariza1on=subgraphextrac1on
Summariza1onwithAMR
Liuetal.(2015)
‣MergeAMRsacrossmul1plesentences
‣ Summariza1on=subgraphextrac1on
‣ Norealsystemsactuallyworkthisway(morewhenwetalkaboutsummariza1on)
SlotFilling
SlotFilling‣Mostconserva1ve,narrowformofIE
FreitagandMcCallum(2000)
SlotFilling‣Mostconserva1ve,narrowformofIE
IndianExpress—Amassiveearthquakeofmagnitude7.3struckIraqonSunday,103kms(64miles)southeastofthecityofAs-Sulaymaniyah,theUSGeologicalSurveysaid,reportsReuters.USGeologicalSurveyiniGallysaidthequakewasofamagnitude7.2,beforerevisingitto7.3.
magnitude time
epicenter
FreitagandMcCallum(2000)
SlotFilling‣Mostconserva1ve,narrowformofIE
IndianExpress—Amassiveearthquakeofmagnitude7.3struckIraqonSunday,103kms(64miles)southeastofthecityofAs-Sulaymaniyah,theUSGeologicalSurveysaid,reportsReuters.USGeologicalSurveyiniGallysaidthequakewasofamagnitude7.2,beforerevisingitto7.3.
magnitude time
epicenter
Speaker:AlanClark
“GenderRolesintheHolyRomanEmpire”
AllagherCenterMainAuditorium
Thistalkwilldiscuss…
speakertitle
location
FreitagandMcCallum(2000)
SlotFilling‣Mostconserva1ve,narrowformofIE
IndianExpress—Amassiveearthquakeofmagnitude7.3struckIraqonSunday,103kms(64miles)southeastofthecityofAs-Sulaymaniyah,theUSGeologicalSurveysaid,reportsReuters.USGeologicalSurveyiniGallysaidthequakewasofamagnitude7.2,beforerevisingitto7.3.
magnitude time
epicenter
Speaker:AlanClark
“GenderRolesintheHolyRomanEmpire”
AllagherCenterMainAuditorium
Thistalkwilldiscuss…
speakertitle
location
FreitagandMcCallum(2000)
‣ Oldwork:HMMs,laterCRFstrainedperrole
SlotFilling:MUC
HaghighiandKlein(2010)
‣ Keyaspect:needtocombineinforma1onacrossmul1plemen1onsofanen1tyusingcoreference
SlotFilling:Forums
‣ Extractproductoccurrencesincybercrimeforums,butnoteverythingthatlookslikeaproductisaproduct
Portnoffetal.(2017),Durrenetal.(2017)Notaproductinthiscontext
Rela1onExtrac1on
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Located_In
Na1onality
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Located_In
Na1onality
‣ UseNER-likesystemtoiden1fyen1tyspans,classifyrela1onsbetweenen1typairswithaclassifier
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Located_In
‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles
Na1onality
‣ UseNER-likesystemtoiden1fyen1tyspans,classifyrela1onsbetweenen1typairswithaclassifier
Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory
ACE(2003-2005)
DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire
Located_In
‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles
Na1onality
‣ Problem:limiteddataforscalingtobigontologies
‣ UseNER-likesystemtoiden1fyen1tyspans,classifyrela1onsbetweenen1typairswithaclassifier
HearstPanerns
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
HearstPanerns
Hearst(1992)
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
HearstPanerns
Hearst(1992)
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
BerlinisacityYisaX
HearstPanerns
Hearst(1992)
Xsuchas[list] ciGessuchasBerlin,Paris,andLondon.
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
BerlinisacityYisaX
HearstPanerns
Hearst(1992)
Xsuchas[list] ciGessuchasBerlin,Paris,andLondon.
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
Berlinisacity
otherciGesincludingBerlin
YisaX
otherXincludingY
HearstPanerns
Hearst(1992)
Xsuchas[list] ciGessuchasBerlin,Paris,andLondon.
‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)
Berlinisacity
otherciGesincludingBerlin
YisaX
otherXincludingY
‣ Totallyunsupervisedwayofharves1ngworldknowledgefortaskslikeparsingandcoreference(BansalandKlein,2011-2012)
DistantSupervision
Mintzetal.(2009)
DistantSupervision
Mintzetal.(2009)
‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata
DistantSupervision
Mintzetal.(2009)
‣ Iftwoen11esinarela1onappearinthesamesentence,assumethesentenceexpressestherela1on
‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata
DistantSupervision
Mintzetal.(2009)
[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story
‣ Iftwoen11esinarela1onappearinthesamesentence,assumethesentenceexpressestherela1on
‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata
Director
DistantSupervision
Mintzetal.(2009)
[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story
‣ Iftwoen11esinarela1onappearinthesamesentence,assumethesentenceexpressestherela1on
‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata
Allisonco-producedtheAcademyAward-winning[SavingPrivateRyan],directedby[StevenSpielberg]
Director
Director
DistantSupervision
Mintzetal.(2009)
‣ Learndecentlyaccurateclassifiersfor~100Freebaserela1ons‣ Couldbeusedtocrawlthewebandexpandourknowledgebase
OpenIE
OpenInforma1onExtrac1on
‣ Typicallynofixedrela1oninventory
‣ “Open”ness—wanttobeabletoextractallkindsofinforma1onfromopen-domaintext
‣ Acquirecommonsenseknowledgejustfrom“reading”aboutit,butneedtoprocesslotsoftext(“machinereading”)
TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs
‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.
Bankoetal.(2007)
TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs
BarackObama,44thpresidentoftheUnitedStates,wasbornonAugust4,1961inHonolulu
=>Barack_Obama,wasbornin,Honolulu
‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.
Bankoetal.(2007)
TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs
BarackObama,44thpresidentoftheUnitedStates,wasbornonAugust4,1961inHonolulu
=>Barack_Obama,wasbornin,Honolulu
‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.
‣ 80xfasterthanrunningaparser(whichwasslowin2007…)
Bankoetal.(2007)
TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs
BarackObama,44thpresidentoftheUnitedStates,wasbornonAugust4,1961inHonolulu
=>Barack_Obama,wasbornin,Honolulu
‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.
‣ 80xfasterthanrunningaparser(whichwasslowin2007…)
Bankoetal.(2007)
‣ Usemul1pleinstancesofextrac1onstoassignprobabilitytoarela1on
Exploi1ngRedundancy
Bankoetal.(2007)
Exploi1ngRedundancy
Bankoetal.(2007)
‣ 9Mwebpages/133Msentences
Exploi1ngRedundancy
Bankoetal.(2007)
‣ 9Mwebpages/133Msentences
‣ 2.2tuplesextractedpersentence,filterbasedonprobabili1es
Exploi1ngRedundancy
Bankoetal.(2007)
‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified
‣ 9Mwebpages/133Msentences
‣ 2.2tuplesextractedpersentence,filterbasedonprobabili1es
Exploi1ngRedundancy
Bankoetal.(2007)
‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified
‣ Hardtoevaluate:canassessprecision ofextractedfacts,buthowdoweknowrecall?
‣ 9Mwebpages/133Msentences
‣ 2.2tuplesextractedpersentence,filterbasedonprobabili1es
ReVerb
Faderetal.(2011)
‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)
ReVerb
Faderetal.(2011)
‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)
‣ Extractmoremeaningfulrela1ons,par1cularlywithlightverbs
ReVerb
Faderetal.(2011)
‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity
‣ Findthenearestargumentsoneithersideoftherela1on
ReVerb
Faderetal.(2011)
‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity
‣ Findthenearestargumentsoneithersideoftherela1on
‣ Annotatorslabeledrela1onsin500documentstoassessrecall
QAfromOpenIE
Choietal.(2015)
Takeaways
‣ Rela1onextrac1on:cancollectdatawithdistantsupervision,usethistoexpandknowledgebases
‣ Slotfilling:1edtoaspecificontology,butgivesfine-grainedinforma1on
‣ OpenIE:extractslotsofthings,buthardtoknowhowgoodorusefultheyare
‣ Cancombinewithstandardques1onanswering
‣ Addnewfactstoknowledgebases
‣ SRL/AMR:handleabunchofphenomena,butmoreorlesslikesyntax++intermsofwhattheyrepresent
‣Many,manyapplica1onsandtechniques