FrameNetFrameNet

The work. The product.The work. The product.

The applications.The applications.

CJFillmore - ICSI/BerkeleyCJFillmore - ICSI/Berkeley

AcknowledgementsAcknowledgements

International Computer Science International Computer Science InstituteInstitute

National Science FoundationNational Science Foundation

Defense Advanced Research Projects Defense Advanced Research Projects AgencyAgency

Frames and Frames and UnderstandingUnderstanding

HypothesisHypothesis: People understand : People understand things by performing mental things by performing mental operations on what they already operations on what they already know. Such knowledge is know. Such knowledge is describable in terms of information describable in terms of information packets called packets called framesframes..

The core work of The core work of FrameNetFrameNet

1.1. characterize framescharacterize frames

2.2. find words that fit the framesfind words that fit the frames

3.3. develop descriptive terminologydevelop descriptive terminology

4.4. extract sample sentencesextract sample sentences

5.5. annotate selected examplesannotate selected examples

6.6. derive "valence" descriptionsderive "valence" descriptions

D I G R E S S I O N

Actually there are two contexts in which you will probably be asked to do FrameNet annotations.

One is for purely lexicographic purposes, where you will choose “good examples” of the use of each word. The other is for full text analysis, where you will analyze every word in a text.

The description that follows concentrates on the lexicographic work

The core work of The core work of FrameNetFrameNet

1.1. characterize framescharacterize frames

2.2. find words that fit the framesfind words that fit the frames

3.3. develop descriptive terminologydevelop descriptive terminology

4.4. extract sample sentencesextract sample sentences

5.5. annotate selected examplesannotate selected examples

6.6. derive "valence" descriptionsderive "valence" descriptions

Finding words that Finding words that belong belong

in a given framein a given frame We look for words in the language We look for words in the language

that bring to mind the individual that bring to mind the individual frames.frames.

We say that the words We say that the words evokeevoke the the frames.frames.

““WordsWords””??

But first thereBut first there’’s an enemy we have to s an enemy we have to deal with: polysemy, lexical deal with: polysemy, lexical ambiguity, multiple meanings of a ambiguity, multiple meanings of a single single ““wordword””..

Instead of words, we have to work Instead of words, we have to work with with lexical units (LUs)lexical units (LUs), each of , each of these being a pairing of a word with a these being a pairing of a word with a sense.sense.

FrameNet is at the FrameNet is at the ““splittingsplitting”” end of the end of the ““splittingsplitting”” versus versus ““lumpinglumping”” continuum continuum when it comes to the monosemy/polysemy.when it comes to the monosemy/polysemy.

What could count as evidence for the What could count as evidence for the separateness of lexical units with the same separateness of lexical units with the same form?form?

Discernible meaning Discernible meaning differences.differences.

If a word communicates different meanings If a word communicates different meanings in different contexts, and the difference isnin different contexts, and the difference isn’’t t explainedexplained by the contexts, maybe the word by the contexts, maybe the word has more than one meaning.has more than one meaning.

1.1. She She earnsearns a lot less than she deserves. a lot less than she deserves.2.2. I made a lot of money, but I I made a lot of money, but I earnedearned it. it.

The second sentence conveys the idea that The second sentence conveys the idea that the amount of money earned was the amount of money earned was appropriate.appropriate.

How many meanings for How many meanings for replacereplace??

put (sth) back where it belongsput (sth) back where it belongs

occupy a position formerly occupied occupy a position formerly occupied by (sth,sbd)by (sth,sbd)

put something in a position formerly put something in a position formerly occupied by (sth,sbd)occupied by (sth,sbd)

John replaced me.

John replaced the telephone.

Just having different argument Just having different argument types in grammatical types in grammatical positions isnpositions isn’’t enough.t enough.

Subject as SpeakerSubject as Speaker: : Mom explained …, you complained …, Mom explained …, you complained …, she said …, I insist …, the dean she said …, I insist …, the dean informed us …informed us …

Subject as MediumSubject as Medium: : chapter 2 explains …, your letter chapter 2 explains …, your letter complains …, the Bible says …, the law complains …, the Bible says …, the law insists …, the editorial informed …insists …, the editorial informed …

Those donThose don’’t require t require separate senses.separate senses.

The The ““Medium-as-SubjectMedium-as-Subject”” examples can examples can be thought of as Metonymy. Thus:be thought of as Metonymy. Thus:

Chapter 2 explains …Chapter 2 explains … = = The author explains in Chapter 2 that The author explains in Chapter 2 that ……

Your letter complains that … = Your letter complains that … = You complain in your letter that …You complain in your letter that …

Speaker as Subject

Medium as Subject

HereHere’’s a different s a different situation:situation:

Some - but not all - Some - but not all - ““verbs of speakingverbs of speaking”” have a have a ““cognitivecognitive”” use, identifying sources use, identifying sources of beliefs or belief-attitudes, with no of beliefs or belief-attitudes, with no communicating implied.communicating implied.

The heavy winds The heavy winds explainexplain the number of the number of windmills around here. (*explicate)windmills around here. (*explicate)

These facts These facts argueargue in favor of your in favor of your hypothesis. (*reason)(*quarrel)hypothesis. (*reason)(*quarrel)

His repeated absence at meetings His repeated absence at meetings suggestssuggests that he that he’’s not happy with the job. s not happy with the job. (*hints)(*hints)

Speaker as Subject

Medium as Subject Fact as Subject

That is, we take the fact that That is, we take the fact that some some but not allbut not all words in a particular words in a particular semantic class have special meaning semantic class have special meaning elaborations elaborations ““argues forargues for”” a polysemy a polysemy interpretation in those cases.interpretation in those cases.

Different Different ComplementationComplementation

Complementation patterns should go Complementation patterns should go with particular meanings of a word.with particular meanings of a word.

Medical senseMedical sense of of complaincomplain::the patient the patient complainedcomplained [ [ofof back pains back pains]]

Official act senseOfficial act sense of of complaincomplain::

we we complainedcomplained [ [toto the manager the manager] ] [[aboutabout X X]]

she she complainedcomplained [ [thatthat her checks were her checks were latelate]]

Argument omissibilityArgument omissibility

We would argue that the ordinary We would argue that the ordinary sense of sense of givegive and the and the ‘‘contributecontribute’’ sense of sense of givegive should be separated, should be separated, since they differ in argument since they differ in argument omissibility:omissibility: Do you want to meet the Red Cross Do you want to meet the Red Cross

representative? - I already gave.representative? - I already gave. Did you remember a present for Did you remember a present for

your daughteryour daughter’’s birthday? s birthday? - *I already gave.- *I already gave.

If a verb has two different event If a verb has two different event noun derivatives, and noun derivatives, and theythey have have different meanings that are also different meanings that are also found in the verb, that verb should found in the verb, that verb should be described as polysemous.be described as polysemous.

Nominalization Nominalization DifferencesDifferences

adhereadhere to a belief: to a belief: adherenceadherenceadhereadhere to your skin: to your skin: adhesionadhesion

observeobserve a rule: a rule: observanceobservanceobserveobserve the kids: the kids: observationobservation

commitcommit to a cause: to a cause: commitmentcommitmentcommit commit to an asylum:to an asylum: commitmentcommitmentcommitcommit a crime: a crime: commissioncommission

deliverdeliver a package: a package: deliverydeliverydeliverdeliver sb. from danger: sb. from danger: deliverancedeliverance

Support verb differences Support verb differences with nominalizationswith nominalizations

argueargue: : quarrel sensequarrel sense associated with associated with havehave an argumentan argument; ; reasoning sensereasoning sense with with makemake an argumentan argument

commitcommit: : dedication sensededication sense associated with associated with makemake a commitment a commitment; ; crime/sin sense & crime/sin sense & incarceration senseincarceration sense, no support verb, no support verb

complaincomplain: : symptom reportsymptom report: : presentpresent a a complaintcomplaint; ; kvetchkvetch: no support verb; : no support verb; officialofficial: : filefile a complaint, a complaint, registerregister a complaint a complaint

Lexical Field Lexical Field MembershipMembership

complaincomplain in medical context links in medical context links with with presént, symptoms, ailmentspresént, symptoms, ailments, , etc.etc.

complaincomplain in official context links in official context links with with charge, grievancecharge, grievance, etc., etc.

complaincomplain in informal context links in informal context links with with bitch, kvetch, gripe, whine, bitch, kvetch, gripe, whine, etc.etc.

FN work: characterizing FN work: characterizing framesframes

LetLet’’s work through the Revenge s work through the Revenge frame.frame.

The Revenge frameThe Revenge frame

The Revenge concept involves a The Revenge concept involves a situation in which situation in which

a)a) A has done something to harm B A has done something to harm B and and

b)b) B takes action to harm A in turnB takes action to harm A in turn

c)c) B's action is carried out B's action is carried out independently of any legal or other independently of any legal or other institutional settinginstitutional setting

Vocabulary for RevengeVocabulary for Revenge

Nouns: Nouns: revenge, vengeance, reprisal, revenge, vengeance, reprisal, retaliationretaliation

Verbs: Verbs: avenge, revenge, retaliate avenge, revenge, retaliate (against),(against), get back (at), get even (with), pay back get back (at), get even (with), pay back

Adjectives: Adjectives: vengeful, vindictivevengeful, vindictive

FN work: choosing FE FN work: choosing FE namesnames

We develop a descriptive vocabulary We develop a descriptive vocabulary for the for the componentscomponents of each frame, of each frame, called called frame elementsframe elements (FEs). (FEs).

We use FE names in labeling the We use FE names in labeling the constituents of sentences exhibiting constituents of sentences exhibiting the frame.the frame.

FEs for RevengeFEs for Revenge Frame DefinitionFrame Definition: Because of some : Because of some injuryinjury to to

something-or-someone important to an something-or-someone important to an avenger avenger (maybe himself), the (maybe himself), the avengeravenger inflicts a inflicts a punishmentpunishment on the on the offenderoffender. The . The offenderoffender is the person responsible for the is the person responsible for the injuryinjury. .

FE ListFE List: : avengeravenger, , offenderoffender, , injuryinjury, , injured_partyinjured_party, , punishmentpunishment..

D I G R E S S I O N

Notice that we use such situation-specific notions as injury, offender, etc., rather than limiting ourselves to some standard list of thematic roles, like agent, patient, goal, etc.First, there aren’t enough of those to go around, and if we had squeeze all the distinctions we find into such a list,

we would waste too much time finding criteria to do the mapping,and we would have to remember what decisions we’d made.

FEs for RevengeFEs for Revenge Frame DefinitionFrame Definition: Because of some : Because of some injuryinjury to to

something-or-someone important to an something-or-someone important to an avenger avenger (maybe himself), the (maybe himself), the avengeravenger inflicts a inflicts a punishmentpunishment on the on the offenderoffender. The . The offenderoffender is the person responsible for the is the person responsible for the injuryinjury. .

FE ListFE List: : avengeravenger, , offenderoffender, , injuryinjury, , injured_partyinjured_party, , punishmentpunishment..

Collecting examplesCollecting examples

We extract from our We extract from our corpuscorpus examples of sentences showing the examples of sentences showing the uses of each word in the frame.uses of each word in the frame.

Our main corpus is the British Our main corpus is the British National Corpus; we have recently National Corpus; we have recently added lots of newswire text from the added lots of newswire text from the Linguistic Data Consortium. Total Linguistic Data Consortium. Total about 200M running words.about 200M running words.

Obviously we need to conduct a more regimented search, grouping examples with related structures.

Examples of simple use are swamped by the idiomatic phrase"with a vengeance".

FN work: annotating FN work: annotating examplesexamples

We select sentences exhibiting We select sentences exhibiting common common collocationscollocations and showing and showing all major syntactic contexts.all major syntactic contexts.

Using the names assigned to FEs in Using the names assigned to FEs in the frame, we label the constituents the frame, we label the constituents of sentences that express these FEs.of sentences that express these FEs.

The next slide shows what our The next slide shows what our software looks like.software looks like.

llist of frame names

llist of FEs for Revenge frame

list of contexts chosen for avenge

sentenceswithavenge

and“death”

annotators’workspace

core

core

core

core

core

FN work: summarizing FN work: summarizing resultsresults

Automatic processes summarize the Automatic processes summarize the results, linking FEs with information results, linking FEs with information about their grammatical realization. about their grammatical realization.

The output is presented in the form The output is presented in the form of various reports in the public of various reports in the public website, in XML format in the data website, in XML format in the data release.release.

I avenged my brother.

I avenged my brother’s death.

Querying the data: meaning Querying the data: meaning to formto form

Through various viewers built on the Through various viewers built on the FN database we can, for example, FN database we can, for example, ask how particular FEs get ask how particular FEs get expressed in sentences evoking a expressed in sentences evoking a given frame.given frame.

By what syntactic means is By what syntactic means is offenderoffender realized? realized?

Sometimes as direct object:Sometimes as direct object: we'll pay we'll pay youyou back for that back for that

Sometimes with the preposition Sometimes with the preposition onon they'll take vengeance they'll take vengeance on youon you

Sometimes with Sometimes with againstagainst we'll retaliate we'll retaliate against themagainst them

Sometimes with Sometimes with withwith she got even she got even with mewith me

Sometimes with Sometimes with atat they got back they got back at youat you

By what syntactic means is By what syntactic means is offenderoffender realized? realized?

Sometimes as direct object:Sometimes as direct object: we'll pay we'll pay youyou back for that back for that

Sometimes with the preposition Sometimes with the preposition onon they'll take vengeance they'll take vengeance on youon you

Sometimes with Sometimes with againstagainst we'll retaliate we'll retaliate against themagainst them

Sometimes with Sometimes with withwith she got even she got even with mewith me

Sometimes with Sometimes with atat they got back they got back at youat you

It's these word-by-wordspecializations inFE-marking that makeautomatic FE recognitiondifficult.

Querying the data: form to Querying the data: form to meaningmeaning

Or, going from the grammar to the Or, going from the grammar to the meaning, we can choose particular meaning, we can choose particular grammatical contexts and ask which grammatical contexts and ask which FEs get expressed in them.FEs get expressed in them.

What FE is expressed by the What FE is expressed by the object of object of avengeavenge??

Sometimes it's the Sometimes it's the injured_partyinjured_party I've got to avenge I've got to avenge my brothermy brother

.Sometimes it's the .Sometimes it's the injuryinjury My life goal is to avenge My life goal is to avenge my brother's my brother's

murdermurder..

EvaluationEvaluation

Lexical coverageLexical coverage. We want to get all . We want to get all of the important words associated of the important words associated with each frame.with each frame.

CombinatoricsCombinatorics. We want to get all of . We want to get all of the syntactic patterns in which each the syntactic patterns in which each word functions to express the frame.word functions to express the frame.

Evaluation, contEvaluation, cont’’dd

We do not ourselves collect frequency We do not ourselves collect frequency data. That will wait until methods of data. That will wait until methods of automatic tagging get perfected.automatic tagging get perfected.

In any case, the results will differ In any case, the results will differ according to the type of corpus - according to the type of corpus - financial news, children's literature, financial news, children's literature, technical manuals, etc.technical manuals, etc.

What do we end up with?What do we end up with?

FramesFrames

Lexical entriesLexical entries

AnnotationsAnnotations

Sample from frames listSample from frames list

Creating, Crime_scenario, Criminal_investigation, Creating, Crime_scenario, Criminal_investigation, Criminal_process, Cure. Custom, Damaging, Criminal_process, Cure. Custom, Damaging, Dead_or_alive, Death, Deciding, Deny_permission, Dead_or_alive, Death, Deciding, Deny_permission, Departing, Desirability, Desiring, Destroying, Departing, Desirability, Desiring, Destroying, Detaining, Differentiation, Difficulty, Dimension, Detaining, Differentiation, Difficulty, Dimension, Direction, Dispersal, Documents, Domain, Direction, Dispersal, Documents, Domain, Duplication, Duration, Eclipse, Duplication, Duration, Eclipse, Education_teaching,Emanating, Emitting, Education_teaching,Emanating, Emitting, Emotion_active, Emotion_directed, Emotion_heat, Emotion_active, Emotion_directed, Emotion_heat, Employing, Employment, Emptying, Encoding, Employing, Employment, Emptying, Encoding, Endangering, Entering_of_plea, Entity, Escaping, Endangering, Entering_of_plea, Entity, Escaping, Evading. Evaluation, Evidence, Excreting, Evading. Evaluation, Evidence, Excreting, Execution,Execution,

Sample from lexical unit Sample from lexical unit listlist

* augmentation.N * augmentation.N (Expansion) (Expansion)

* augur.V (Omen) * augur.V (Omen) * August.N * August.N

(Calendric_unit) (Calendric_unit) * aunt.N (Kinship) * aunt.N (Kinship) * auntie.N (Kinship)* auntie.N (Kinship) * austere.A (Frugality) * austere.A (Frugality) * austerity.N (Frugality) * austerity.N (Frugality) * author.V (Text_creation) * author.V (Text_creation) * authoritarian.A * authoritarian.A

(Strictness)(Strictness)

* authorization.N * authorization.N (Documents)(Documents)

* autobahn.N * autobahn.N (Roadways) (Roadways)

* autobiography.N (Text) * autobiography.N (Text) * automobile.N (Vehicle)* automobile.N (Vehicle) * autumn.N * autumn.N

(Calendric_unit)(Calendric_unit) * avalanche.N (Quantity)* avalanche.N (Quantity) * avenge.V (Revenge)* avenge.V (Revenge) * avenger.N (Revenge) * avenger.N (Revenge) * avenue.N (Roadways) * avenue.N (Roadways) * aver.V (Statement)* aver.V (Statement)

Added Value: frame Added Value: frame relatednessrelatedness

We have ways of linking frames to We have ways of linking frames to each other, through relations ofeach other, through relations of inheritanceinheritance subframesubframe "using""using"

We would like to explore how our We would like to explore how our frame relationships can be mapped frame relationships can be mapped onto ontological relations.onto ontological relations.

Frame-to-frame relationsFrame-to-frame relations

Revenge Revenge inheritsinherits Punishment/RewardPunishment/Reward

Revenge Revenge usesuses the Hostile_encounter the Hostile_encounter frameframe

Added Value: semantic Added Value: semantic typestypes

We also have the means of adding We also have the means of adding semantic typessemantic types to words, frames and to words, frames and frame elements.frame elements.

Some of these:Some of these: negative vs. positive negative vs. positive

((disasterdisaster vs. vs. bonanzabonanza), ), punctual vs. stative punctual vs. stative

((arrivearrive vs. vs. residereside), ), artifact vs. natural kind artifact vs. natural kind

((buildingbuilding vs. vs. treetree).).

Added Value: support Added Value: support verbsverbs

In the case of the In the case of the event nounsevent nouns, we , we keep track of which verbs can keep track of which verbs can combine with which nouns to signal combine with which nouns to signal occurrences of the frame evoked by occurrences of the frame evoked by the noun. the noun. taketake a bath a bath ( (bathebathe)) havehave an argument an argument ( (argueargue)) wreakwreak vengeance, vengeance, taketake revenge, revenge, exactexact retribution. retribution.

Comparison with Comparison with DictionariesDictionaries

American Heritage American Heritage DictionaryDictionary

avengeavenge v. v.1. To inflict a 1. To inflict a punishment or punishment or penalty in return penalty in return for; revengefor; revenge2. To take 2. To take vengeance on vengeance on behalf ofbehalf of

revengerevenge v. v.1. To inflict 1. To inflict punishment in punishment in return for (injury return for (injury or insult)or insult)2. To seek or take 2. To seek or take vengeance for vengeance for (oneself or another (oneself or another person); avengeperson); avenge

American Heritage American Heritage DictionaryDictionary

avengeavenge v. v.1. To inflict a 1. To inflict a punishment or punishment or penalty penalty in return in return forfor; revenge; revenge2. To take 2. To take vengeance vengeance on on behalf ofbehalf of

revengerevenge v. v.1. To inflict 1. To inflict punishment punishment in in return forreturn for (injury (injury or insult)or insult)2. To seek or take 2. To seek or take vengeance vengeance forfor (oneself or another (oneself or another person); avengeperson); avengeThe FEs of the direct objects are expressed prepositionally;

in return for marks the injuryinjury; for or on behalf of marksthe injured_partyinjured_party.

American Heritage American Heritage DictionaryDictionary

avengeavenge v. v.1. To inflict a 1. To inflict a punishment or punishment or penalty penalty in return in return for for [ ]; revenge[ ]; revenge2. To take 2. To take vengeance vengeance on on behalf ofbehalf of [ ] [ ]

revengerevenge v. v.1. To inflict 1. To inflict punishment punishment in in return forreturn for (injury (injury or insult)or insult)2. To seek or take 2. To seek or take vengeance vengeance for for (oneself or another (oneself or another person); avengeperson); avengeThe revenge definer added qualifications on the missing

argument, the avenge definer didn't.

American Heritage American Heritage DictionaryDictionary

avengeavenge v. v.1. To inflict a 1. To inflict a punishment or punishment or penalty in return penalty in return for; for; revengerevenge2. To take 2. To take vengeance on vengeance on behalf ofbehalf of

revengerevenge v. v.1. To inflict 1. To inflict punishment in punishment in return for (injury return for (injury or insult)or insult)2. To seek or take 2. To seek or take vengeance for vengeance for (oneself or another (oneself or another person); person); avengeavenge

avenge definer claims avenge and revenge are synonyms in sense 1; the revenge definer claims avenge and revenge are synonyms in sense 2.

American Heritage American Heritage DictionaryDictionary

avengeavenge v. v.1. To inflict a 1. To inflict a punishment or punishment or penalty in return penalty in return for; revengefor; revenge2. To 2. To take take vengeancevengeance on on behalf ofbehalf of

revengerevenge v. v.1. To inflict 1. To inflict punishment in punishment in return for (injury return for (injury or insult)or insult)2. To seek or 2. To seek or take take vengeancevengeance for for (oneself or another (oneself or another person); avengeperson); avengeBoth definers include "take vengeance" in their definitions, as

if that's more transparent than the simple verb.

Comparison with Comparison with WordNetWordNet

We make fewer We make fewer distinctions.distinctions.

1. 1. revenge, avenge, retaliaterevenge, avenge, retaliate -- (take -- (take revenge for a perceived wrong; "He wants revenge for a perceived wrong; "He wants to avenge the murder of his brother")to avenge the murder of his brother")

2. 2. retaliate, strike backretaliate, strike back -- (make a -- (make a counterattack and return like for like, esp. counterattack and return like for like, esp. evil for evil; "The Empire strikes back"; evil for evil; "The Empire strikes back"; "The Giants struck back and won the "The Giants struck back and won the opener"; "The Israeli army retaliated for opener"; "The Israeli army retaliated for the Hamas bombing")the Hamas bombing")

We make fewer We make fewer distinctions.distinctions.

1. 1. revenge, avenge, retaliaterevenge, avenge, retaliate -- (take -- (take revenge for a perceived wrong; "He wants revenge for a perceived wrong; "He wants to avenge the murder of his brother")to avenge the murder of his brother")

2. 2. retaliate, strike backretaliate, strike back -- (make a -- (make a counterattack and return like for like, esp. counterattack and return like for like, esp. evil for evil; "The Empire strikes back"; evil for evil; "The Empire strikes back"; "The Giants struck back and won the "The Giants struck back and won the opener"; "The Israeli army retaliated for opener"; "The Israeli army retaliated for the Hamas bombing")the Hamas bombing")Hard to figure out what motivates distinguishing two senses;personal vs. institutional?

Does anybody find this Does anybody find this useful?useful?

Frame descriptions as event Frame descriptions as event ontology. (Heidelberg)ontology. (Heidelberg)

FrameNet data for language FrameNet data for language teaching (Sato)teaching (Sato)

FrameNet annotations for machine FrameNet annotations for machine learning (SENSEVAL-3 competition)learning (SENSEVAL-3 competition)

FrameNet parsing for question-FrameNet parsing for question-answering (AQUAINT, others)answering (AQUAINT, others)

FrameNets in other FrameNets in other languages?languages?

Spanish (Barcelona; Carlos Subirats)Spanish (Barcelona; Carlos Subirats)

German (Saarbrücken; Manfred German (Saarbrücken; Manfred Pinkal)Pinkal)

Japanese (Tokyo; Kyoko Ohara)Japanese (Tokyo; Kyoko Ohara)

Swedish (Lund; Ake Viberg)Swedish (Lund; Ake Viberg)

http://www.icsi.berkeley.edu/~framenet