Soar Workshop Semantic Memory Tutorialsoar/tutorial16/Tutorial-2016-SW-smem.pdf · Soar Workshop...

SoarWorkshopSemanticMemoryTutorial

NateDerbinsky

Whilewaiting…downloadWordNethttp://web.eecs.umich.edu/~soar/tutorial16

June72016 SemanticMemoryTutorial 1

Agenda

• Bigpicture• Basicusage• WordNet demo• Additionalresources


Soar9


SymbolicLong-TermMemories

SymbolicWorkingMemory

Procedural

Decision

Procedure

ChunkingReinforcementLearning

Action

Semantic

SemanticLearning

Episodic

EpisodicLearning

Spatial Visual SystemObject-basedcontinuousmetricspace

Perception

SoarBasicFunctions

1. Input fromenvironment2. Elaboratecurrentsituation:parallelrules3. Proposeoperatorsviaacceptable preferences4. Evaluateoperatorsviapreferences:Numericindifferentpreference5. Selectoperator6. Applyoperator:Modifyinternaldatastructures:parallelrules7. Output tomotorsystem[andaccesstolong-termmemories]

OperatorDecisionInput Output

StateElaboration

OperatorProposal

OperatorEvaluation

OperatorElaboration

OperatorApplication

June72016 EpisodicMemoryTutorial 4

SemanticMemory:BigPicture

Supportsdeliberatestorageandretrievaloflong-term“objects,”features,andrelations


ArchitecturalIntegration


ArchitecturalIntegrationStorage






ArchitecturalIntegrationNon-Cue-Based Retrieval


ArchitecturalIntegrationNon-Cue-Based Retrieval


ArchitecturalIntegrationCue-BasedRetrieval


ArchitecturalIntegrationCue-BasedRetrieval


BasicUsage

• Working-memorystructure• Semantic-memoryrepresentation• Controllingsemanticmemory• Storingknowledge• Retrievingknowledge


Working-MemoryStructure

Soarcreatesansmem structureoneachstate– SoarJavaDebugger

• step 5• print --exact (* ^smem *)• print s2

Eachsmem structurehasspecializedsubstructure– command:agent-initiatedactions– result:architecturalfeedback


Semantic-MemoryRepresentation

Similartoworkingmemory:symbolictriples– Allidentifiersinsemanticmemoryarelong-term• Theletter-numberpair(e.g.S5orC7)ispermanentlyassociatedwiththeidentifier• Whenprinted,long-termidentifiersareprefacedwiththe@symbol(e.g.@S5or@C7)• Whendepicted,long-termidentifiersaredoublecircles

– Attributescannotbeidentifiers(currently)– Theresultinggraphisnotnecessarilyconnected


ControllingSemanticMemory

Get/Setaparameter:– smem [-g|--get] <name>– smem [-s|--set] <name> <value>

SMem isdisabled bydefault.Toenableit…1. smem2. smem --set learning on3. smem


StoringKnowledge

ManualMethodofappendingviacommandline(especiallyusefulforloadingexternalKBs)

AgentDeliberate(viarules)addition/modification

Note:bothmethodscanchange existingand/oraddnewknowledgeinsemanticmemory.


ManualStorage

Syntax:similartoproductionRHS

smem --add {(<id1> ̂ attr1 val1 val2 ̂ attr2 val1 … )(<id2> ̂ attr3 <id1> val5 … )(<id3> ̂ attr4.attr5 <id3>)…

}


ManualStorage:ExampleSoarJavaDebugger

1. smem --add {(<a> ^name alice ^friend ) ( ^name bob ^friend <a> <c>)(<c> ^name charley)}

2. smem --print

(@A1 ̂ friend @B1 ̂ name alice [+1.000])(@B1 ̂ friend @A1 @C4 ^name bob [+2.000])(@C4 ̂ name charlie [+3.000])


AgentStorageSyntax

(<smem> ^command <cmd>)(<cmd> ^store <id1> <id2> …)

• Requires thatSMem isenabled (slide16)• Processedatendofphaseinwhichrulefires• Multiple identifiersmaybestoredatonce• Storageisnot recursive

Result(<smem> ^command <cmd> ^result <r>)(<cmd> ^store <id1> <id2> …)(<r> ^success <id1> <id2> …)


AgentStorage:Example• SoarJavaDebugger

1. smem --set learning on2. watch 53. source4. run 4 -p5. print --depth 10 s2

sp {propose*init(state <s> ^superstate nil

-^name)-->

(<s> ̂ operator <op> +)(<op> ̂ name init)

}

sp {apply*init(state <s> ôperator.name init

^smem.command <cmd>)-->

(<s> ̂ name friends)(<cmd> ̂ store <a> <c>)(<a> ̂ name alice ^friend )( ̂ name bob ̂ friend <a> <c>)(<c> ̂ name charley)

}


ExaminingtheTrace=>WM: (30: C4 ^name charley)=>WM: (29: B1 ^friend A1)=>WM: (28: B1 ^friend C4)=>WM: (27: B1 ^name bob)=>WM: (26: A1 ^friend B1)=>WM: (25: A1 ^name alice)=>WM: (24: C2 ^store A1)=>WM: (23: C2 ^store B1)=>WM: (22: C2 ^store C4)=>WM: (21: S1 ^name friends)--- Change Working Memory (PE) ---=>WM: (33: R3 ^success @A1)=>WM: (32: R3 ^success @B1)=>WM: (31: R3 ^success @C4)


Semantic-StoreStatistics

smem --stats• Nodes:numberoflong-termidentifiers• Edges:numberoffeatures/relations• Stores:numberofagentstores


RetrievingKnowledgeNon-Cue-Based

Addthefeatures/relations ofaknownlong-term identifier toworkingmemory

Cue-BasedFindalong-term identifier thathasasetoffeatures/relations andaddittoworkingmemorywithitsfullfeature/relation set

Common Constraints:– Requires thatSMem isenabled (slide16)– Onlyoneperstateperdecision– Processed duringoutput phase– Onlyre-processed ifWMchangestocommands

• Meta-data(status,etc)automaticallycleanedbythearchitecture


Non-Cue-BasedRetrievalSyntax

(<smem> ^command <cmd>)(<cmd> ^retrieve <long-term identifier>)

Result(<smem> ^command <cmd> ^result <r>)(<cmd> ^retrieve <long-term identifier>)(<r> ^<status> <long-term identifier>

^retrieved <long-term identifier>)

Where<status> is…– failure:<long-term identifier> isnotlong-term– success:else(addsallfeatures/relations toWM)


Non-Cue-BasedRetrieval:Example• SoarJavaDebugger

1. smem --set learning on2. smem --add {

(@A1 ^name alice ^friend @B1)(@B1 ^name bob ^friend @A1 @C4)(@C4 ^name charley)}

3. sp {ncb(state <s> ^superstate nil


(<cmd> ^retrieve @B1)}4. run 5 -p5. print --depth 10 s26. smem --stats


Non-Cue-BasedRetrieval:Debrief• Becautiousoflong-term identifiers inrules

– Onlylegalifalready insemanticstore– Willoccurviachunking

• Onlyfeatures/relations of@B1added toWM– Features/relations of@A1,@C4wouldrequireadditionalretrieve

commands

• Statisticskeptaboutnumberofretrieve commandsprocessed– smem --stats

• (“Retrieves”)

• Meta-datacleanedupduringoutput phase


Cue-BasedRetrieval:Syntax(<smem> ^command <cmd>)(<cmd> ^query <q>)(<q> âttr1 val1

âttr2 <val2> âttr3 @V3 …)

Theaugmentationsofthequery formhardconstraint(s),baseduponthevaluetype…

• Constant:exactmatch• Long-Term ID:exactmatch• Short-Term ID:wildcard


Cue-BasedRetrieval:Result(<smem> ^command <cmd> ^result <r>)(<cmd> ^query <q>)(<r> ^<status> <q>

^retrieved <long-term identifier>)

Where<status> is…– failure:nolong-termidentifiersatisfiestheconstraints– success:else(addsallfeatures/relationstoWM)

Tiesarebrokenbyabias(default:recency)– Seeactivation-mode parameterinManual– Whenyouexecutesmem -p,thebiasvalueisindicated


Cue-BasedRetrieval:Example• SoarJavaDebugger



3. sp {cbr(state <s> ^superstate nil


(<cmd> ^query.name alice)}4. run 5 -p5. print --depth 10 s26. smem --stats


Prohibition

Cue-basedretrievalscanoptionallyprohibittheretrievalofone-or-morelong-termidentifiers

Syntax(<smem> ^command <cmd>)(<cmd> ^prohibit <lti-1> <lti-2> …)


Prohibition:Example• SoarJavaDebugger



3. sp {prohibit(state <s> ^superstate nil


(<cmd> ^query.name <some-name>^prohibit @A1 @C4)}

4. run 5 -p5. print --depth 10 s2


AlsoUseful:ManualQuery

smem -q {(<cue> ^name charley)}


WordNetDemohttps://github.com/SoarGroup/Domains-WordNet

• ScriptstoconvertWN-LEXICALtoSMem– Output:smem --add { …• >821Klong-termidentifiers,>3.97Medges,~88MB

– Source:~5-10minutes,~1GBmemory

• SMem usesaSQLitebackend– Hastheabilitytosavesemanticstorestodiskandusedisk-baseddatabases• smem --backup<filename>


WordNet:MakeDiskStore• SoarJavaDebugger– source wn.soar

• ~5-10minutes– smem --stats– smem --backup path/to/filename.db

• ~10seconds

• SoarJavaDebugger– smem --set path path/to/filename.db– smem --set database file– smem --stats


WordNet:Representation


“sense”ofthe“verb”to“soar”

“gloss”withthe“synset-id”200155406

smem -q {(<c> ̂ isa s ^ss-type v ^word soar)}

(@S194181 ̂ isa s ^sense-number 4 ^ss-type v ^synset-id 200155406 ^tag-count 1 ^w-num 1 ^word soar ̂ word-lower soar [+194177.000])

smem -q {(<c> ̂ isa g ^synset-id 200155406)}

(@G270 ^gloss |go or move upward; 'The stock market soared after the

cease-fire was announced'| îsa g ^synset-id 200155406 [+425386.000])

WordNet Taskwn-senses.soar

Findalldefinitions,givenlexicalword/POS– High-levelalgorithm

1. query:̂ isa s ^word lex ^ss-type pos

2. Ifsuccessfula) query:̂ isa g ^synset-id <sense ^synset-id>b) Ifsuccessful

» write <gloss ^gloss>c) prohibit: <sense>d) Loop

3. Elsea) (halt)


Eaters!


AdditionalResources

• Documentation• Readings


Documentation

SeetheSoarManualandTutorial

AdditionalTopics– Detailsofintegrationwithothermechanisms– Retrievalbiases– Performance– Usage:commands,parameters,statistics,etc.…


SelectReadingshttp://soar.eecs.umich.edu/Soar-RelatedResearch

2006– IntegratingSemanticMemoryintoaCognitiveArchitecture

• YongjiaWang,JohnE.Laird(TechnicalReport)

2010– ExtendingSoarwithDissociatedSymbolicMemories

• NateDerbinsky,JohnE.Laird(AISB)– TowardsEfficientlySupportingLargeSymbolicMemories

• NateDerbinsky,JohnE.Laird(ICCM)

2011– PerformanceEvaluationofDeclarativeMemorySystemsinSoar

• JohnE.Laird,NateDerbinsky,JonVoigt(BRIMS)– AFunctional Analysis ofHistoricalMemoryRetrievalBiasintheWord SenseDisambiguationTask.

• NateDerbinsky,JohnE.Laird(AAAI)

2012– Functional InteractionsbetweenMemoryandRecognitionJudgments

• JustinLi,NateDerbinsky,JohnE.Laird(AAAI)

2014– ACaseStudyofKnowledgeIntegrationAcrossMultipleMemoriesinSoar

• JohnE.Laird,Shiwali Mohan(BICA)

Date post:	26-Apr-2018
Category:	Documents
Upload:	trankhanh
View:	223 times
Download:	4 times

Soar Workshop Semantic Memory Tutorialsoar/tutorial16/Tutorial-2016-SW-smem.pdf · Soar Workshop...

Documents