cogsci-tutorial02

7 August 2002Cognitive Science 2002

Fairfax, VA 1

CCCCooooggggnnnniiiittttiiiivvvveeee SSSScccciiiieeeennnncccceeee TTTTuuuuttttoooorrrriiiiaaaallll

AAAAPPPPEEEEXXXX////CCCCPPPPMMMM----GGGGOOOOMMMMSSSSAn Architecture for Modeling HumaPerformance in Applied HCI Domain

RRRRooooggggeeeerrrr RRRReeeemmmmiiiinnnnggggttttoooonnnn,,,, BBBBoooonnnnnnnniiiieeee JJJJoooohhhhnnnn****,,,, AAAAlllloooonnnnssssoooo VVVVeeeerrrraaaa,,,,

MMMMiiiicccchhhhaaaaeeeellll MMMMaaaatttteeeessssssssaaaa ,,,, &&&& MMMMiiiicccchhhhaaaaeeeellll FFFFrrrreeeeeeeedddd,,,, MMMMiiiicccchhhhaaaaeeeellll DDDDaaaallllaaaallll ,,,,

RRRRoooobbbbeeeerrrrtttt HHHHaaaarrrrrrrriiiissss,,,, EEEErrrriiiicccc DDDDaaaahhhhllllmmmmaaaannnn2222,,,,

NASA Ames Research Center*Carnegie Mellon University2Colorado State University


Fairfax, VA 2

WWWWhhhhaaaatttt tttthhhhiiiissss ttttuuuuttttoooorrrriiiiaaaallll wwwwiiiillllllll

BBBBaaaassssiiiiccccssss ooooffff AAAAppppeeeexxxx nnnneeeeeeeeddddeeeedddd ttttoooo bbbbuuuuiiiilllldddd CCCCPPPPMMMM----GGGGOOOOMMMMSSSS mmmmooooddddeeeellllssss

— Hierarchical task decomposition

— Templates for routine task behaviors

— Automatic scheduling of primitive actions

AAAAppppppppllllyyyyiiiinnnngggg AAAAppppeeeexxxx ttttoooo aaaa ssssiiiimmmmpppplllleeee HHHHCCCCIIII eeeexxxxaaaammmmpppplllleeee

— Text editing task

— Use predefined CPM-GOMS templates to predict performance

EEEEnnnnoooouuuugggghhhh ttttoooo aaaalllllllloooowwww yyyyoooouuuu ttttoooo rrrreeeeffffiiiinnnneeee tttthhhheeee mmmmooooddddeeeellllssss ssssuuuuppppppppllllwwwwrrrriiiitttteeee ssssiiiimmmmpppplllleeee mmmmooooddddeeeellllssss ffffoooorrrr HHHHCCCCIIII ttttaaaasssskkkkssss


Fairfax, VA 3

FFFFaaaaiiiirrrr wwwwaaaarrrrnnnniiiinnnngggg

AAAAppppeeeexxxx iiiissss ssssttttiiiillllllll aaaa rrrreeeesssseeeeaaaarrrrcccchhhh ttttoooooooollll— The models supplied will run but are not guaranteed to macorrect predictions

— We are still learning about how to use the architecture timportant classes of HCI tasks (e.g. typing)

— The Apex architecture will change as a result of bug fixefeatures to make it easier to use


Fairfax, VA 4

SSSScccchhhheeeedddduuuulllleeeeOOOOvvvveeeerrrrvvvviiiieeeewwww ooooffff AAAAPPPPEEEEXXXX &&&& CCCCPPPPMMMM----GGGGOOOOMMMMSSSS((((9999::::33330000 ---- 11110000::::00000000))))

TTTTeeeexxxxtttt eeeeddddiiiittttiiiinnnngggg wwwwoooorrrrlllldddd ((((11110000::::00000000 ---- 11111111::::44445555))))— KKKKLLLLMMMM----GGGGOOOOMMMMSSSS

¥ Basic Apex functionality¥ Sequential execution¥ Primitive operators in Apex

— PPPPrrrroooocccceeeedddduuuurrrreeee DDDDeeeessssccccrrrriiiippppttttiiiioooonnnn LLLLaaaannnngggguuuuaaaaggggeeee((((PPPPDDDDLLLL))))

— CCCCMMMMNNNN----GGGGOOOOMMMMSSSS¥ Hierarchical task decompositionin Apex

¥ Selection rules

------------ BBBBrrrreeeeaaaakkkk ((((~~~~11110000::::33330000 ---- 11110000::::44445555)))) --------— CCCCPPPPMMMM----GGGGOOOOMMMMSSSS

¥ CPM-GOMS Templates¥ Resource scheduling in Apex¥ World building

FFFFuuuurrrrtttthhhheeeerrrr eeeexxxxpppplllloooorrrraaaattttiiiioooonnnn ooooffff AAAAppppeeeexxxxffffuuuunnnnccccttttiiiioooonnnnaaaalllliiiittttyyyy ((((11111111::::44445555 ---- 11112222::::11115555))))

WWWWrrrraaaapppp----UUUUpppp ((((11112222::::11115555 ---- 11112222::::33330000))))— Overview of CD ROM & WebPage

— Q & A— Feedback


Fairfax, VA 5

AAAAppppeeeexxxx aaaannnndddd CCCCPPPPMMMM----GGGGOOOOMMMMSSSS

CPM-GOMSComputational Architecture forHuman Performance Modeling— Task Representation Language— Human Resources

— Resource Scheduler

Software System Implemented inLisp

No built-in theory of HumanResource Interaction

Methodology for HumanPerformance Modeling— Task Analysis Method (Goals,

Operators, M ethods, Selection)

No Software Implementation

No automatic resource schedulin

Theory of Human Resources(Cognitive, Perceptual, Motor)


Fairfax, VA 6

AAAAppppeeeexxxxAAAAppppeeeexxxx


Fairfax, VA 7

CCCCoooommmmpppplllleeeexxxx ddddyyyynnnnaaaammmmiiiicccc eeeennnnvvvviiiirrrroooonnnnmmmmeeeennnnttttssss

Time Pressure: UUUUsssseeeerrrrssss mmmmuuuusssstttt mmmmaaaakkkkeeee ttttiiiimmmmeeeellllyyyy iiiinnnnppppuuuuttttssss

Multitasking:::: UUUUsssseeeerrrrssss jjjjuuuugggggggglllleeee mmmmuuuullllttttiiiipppplllleeee ttttaaaasssskkkkssss

Predictability:::: SSSSiiiimmmmiiiillllaaaarrrr ppppaaaatttttttteeeerrrrnnnnssss ooooccccccccuuuurrrr oooovvvveeeerrrr ttttiiiimmmmeeee

Unpredictability:::: IIIInnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnnssss ooooccccccccuuuurrrr

Mixed-initiative:::: DDDDeeeecccciiiissssiiiioooonnnn aaaauuuutttthhhhoooorrrriiiittttyyyy ddddiiiissssttttrrrriiiibbbbuuuutttteeeedddd,,,, iiiinnnncccclllluuuuddddeeeessssooootttthhhheeeerrrr uuuusssseeeerrrrssss aaaannnndddd aaaauuuuttttoooommmmaaaatttteeeedddd ssssyyyysssstttteeeemmmmssss


Fairfax, VA 8

MMMMoooottttiiiivvvvaaaattttiiiioooonnnnssss

CCCCoooonnnnssssttttrrrruuuucccctttt aaaa mmmmooooddddeeeelllliiiinnnngggg ssssyyyysssstttteeeemmmm tttthhhhaaaatttt ccccaaaannnn mmmmaaaakkkkeeee uuuusssseeeeffffpppprrrreeeeddddiiiiccccttttiiiioooonnnnssss aaaabbbboooouuuutttt sssskkkkiiiilllllllleeeedddd ooooppppeeeerrrraaaattttoooorrrr bbbbeeeehhhhaaaavvvviiiioooorrrr iiiiccccoooommmmpppplllleeeexxxx ddddyyyynnnnaaaammmmiiiicccc eeeennnnvvvviiiirrrroooonnnnmmmmeeeennnnttttssss

MMMMaaaakkkkeeee ccccooooggggnnnniiiittttiiiivvvveeee mmmmooooddddeeeelllliiiinnnngggg mmmmoooorrrreeee aaaacccccccceeeessssssssiiiibbbblllleeee ttttoooo nnnnoooonnnnssssppppeeeecccciiiiaaaalllliiiissssttttssss,,,, eeeessssppppeeeecccciiiiaaaallllllllyyyy iiiinnnn tttthhhheeee ddddeeeessssiiiiggggnnnn pppphhhhaaaasssseeee— Reduce model development time

— Simplified cognitive architecture

— Reusable packets of psychological theory that can attach standard task analysis (templates)


Fairfax, VA 9

RRRReeeessssoooouuuurrrrcccceeee AAAAllllllllooooccccaaaattttiiiioooonnnn

AAAAppppeeeexxxx ssssiiiimmmmuuuullllaaaatttteeeessss aaaannnn aaaaggggeeeennnntttt ppppllllaaaannnnnnnniiiinnnngggg aaaannnndddd sssscccchhhheeeedddduuuulllliiiinnnngggglllliiiimmmmiiiitttteeeedddd rrrreeeessssoooouuuurrrrcccceeeessss ttttoooo aaaaccccccccoooommmmpppplllliiiisssshhhh mmmmuuuullllttttiiiipppplllleeee ttttaaaasssskkkk

AAAA mmmmuuuullllttttiiii----ttttaaaasssskkkkiiiinnnngggg aaaaggggeeeennnntttt mmmmuuuusssstttt aaaallllllllooooccccaaaatttteeee rrrreeeessssoooouuuurrrrcccceeeesssspppprrrrooooaaaaccccttttiiiivvvveeeellllyyyy aaaannnndddd rrrreeeeaaaaccccttttiiiivvvveeeellllyyyy— Mechanisms for task suspension and recovery

— Mechanisms for parallel task execution subject to resourceconstraints and logical dependencies

TTTThhhheeeesssseeee mmmmeeeecccchhhhaaaannnniiiissssmmmmssss aaaarrrreeee aaaallllssssoooo iiiimmmmppppoooorrrrttttaaaannnntttt ffffoooorrrr HHHHCCCCIIIIpppprrrreeeeddddiiiiccccttttiiiioooonnnnssss tttthhhhaaaatttt aaaarrrriiiisssseeee ffffrrrroooommmm tttthhhheeee iiiinnnntttteeeerrrrlllleeeeaaaavvvviiiinnnngggg oooopppprrrriiiimmmmiiiittttiiiivvvveeee ccccooooggggnnnniiiittttiiiivvvveeee,,,, ppppeeeerrrrcccceeeeppppttttuuuuaaaallll,,,, &&&& mmmmoooottttoooorrrr aaaaccccttttssss


Fairfax, VA 10

TTTThhhheeee AAAAppppeeeexxxx AAAArrrrcccchhhhiiiitttteeeeccccttttuuuurrrreeee

SSSSiiiimmmm ----


Fairfax, VA 11

GGGGOOOOAAAALLLLSSSS

OOOOPPPPEEEERRRRAAAATTTTOOOORRRRSSSS

MMMMEEEETTTTHHHHOOOODDDDSSSS

SSSSEEEELLLLEEEECCCCTTTTIIIIOOOONNNN

See the following paper on your CD or the Apex ftp site:John, B. E. (in preparation) Information Processing and Skilled Behavior, John M. Carroll (ed.),Toward a multidisciplinary science of human computer interaction. Morgan Kaufman.


Fairfax, VA 12

GGGGOOOOMMMMSSSS CCCCoooommmmppppoooonnnneeeennnnttttssss

Task Analysis— GGGGooooaaaallllssss: Task decomposed into nested hierarchy of goand subgoals

— OOOOppppeeeerrrraaaattttoooorrrrssss: Hierarchy terminates in operators, whoseactions cause transitions between states

— MMMMeeeetttthhhhooooddddssss: Sequences of operators executed toaccomplish a set of subgoals

— SSSSeeeelllleeeeccccttttiiiioooonnnn RRRRuuuulllleeeessss: Rules that determine which method touse

Performance Computation— Operator execution takes time

— Sequence of operators determines sequence of overbehaviors and task time


Fairfax, VA 13

VVVVaaaarrrriiiieeeettttiiiieeeessss ooooffff GGGGOOOOMMMMSSSS

KKKKeeeeyyyyssssttttrrrrooookkkkeeee----LLLLeeeevvvveeeellll----MMMMooooddddeeeellll ((((KKKKLLLLMMMM))))— Flat task structure

— Mentally prepare coupled with primitive

CCCCaaaarrrrdddd----MMMMoooorrrraaaannnn----NNNNeeeewwwweeeellllllll GGGGOOOOMMMMSSSS ((((CCCCMMMMNNNN----GGGGOOOOMMMMSSSS))))— Hierarchical goal decomposition

— Primitive operators in task domain (e.g. move mouse)

CCCCooooggggnnnniiiittttiiiivvvveeee----PPPPeeeerrrrcccceeeeppppttttuuuuaaaallll----MMMMoooottttoooorrrr ((((CCCCPPPPMMMM----GGGGOOOOMMMMSSSS))))— Combines hierarchical goal decomposition with primitive CPMresources based on Model Human Processor


Fairfax, VA 14

TTTTeeeexxxxtttt EEEEddddiiiitttt WWWWoooorrrrlllldddd


Fairfax, VA 15

TTTThhhheeee ffffooooxxxx jjjjuuuummmmppppeeeedddd oooovvvveeeerrrr tttthhhheeee

llllaaaazzzzyyyy qqqquuuuiiiicccckkkk bbbbrrrroooowwwwnnnn ddddoooogggg

SSSSeeeevvvveeeerrrraaaallll mmmmeeeetttthhhhooooddddssss eeeexxxxiiiisssstttt ffffoooorrrr mmmmoooovvvviiiinnnngggg tttteeeexxxxtttt— Cut and paste from edit menu

— Cut and paste using keyboard shortcuts

— Delete intervening text and retype¥ BBBBaaaacccckkkkssssppppaaaacccceeee oooovvvveeeerrrr tttteeeexxxxtttt

¥ HHHHiiiigggghhhhlllliiiigggghhhhtttt aaaannnndddd ccccuuuutttt

¥ HHHHiiiigggghhhhlllliiiigggghhhhtttt aaaannnndddd ddddeeeelllleeeetttteeee

WWWWeeee wwwwiiiillllllll mmmmooooddddeeeellll ccccuuuuttttttttiiiinnnngggg aaaannnndddd ppppaaaassssttttiiiinnnngggg ffffrrrroooommmm tttthhhheeeeeeeeddddiiiitttt mmmmeeeennnnuuuu


Fairfax, VA 16

HHHHiiiigggghhhhlllliiiigggghhhhtttt tttteeeexxxxtttt


Fairfax, VA 17

SSSSeeeelllleeeecccctttt EEEEddddiiiitttt mmmmeeeennnnuuuu


Fairfax, VA 18

SSSSeeeelllleeeecccctttt CCCCuuuutttt


Fairfax, VA 19

PPPPoooossssiiiittttiiiioooonnnn tttteeeexxxxtttt ccccuuuurrrrssssoooorrrr


Fairfax, VA 20

SSSSeeeelllleeeecccctttt EEEEddddiiiitttt


Fairfax, VA 21

SSSSeeeelllleeeecccctttt PPPPaaaasssstttteeee


Fairfax, VA 22

EEEEddddiiiitttt ccccoooommmmpppplllleeeetttteeee


Fairfax, VA 23

KKKKLLLLMMMM----GGGGOOOOMMMMSSSS MMMMooooddddeeeellll::::SSSSeeeeqqqquuuueeeennnnttttiiiiaaaallll eeeexxxxeeeeccccuuuuttttiiiioooonnnn iiiinnnn AAAApppp

KKKKLLLLMMMM----GGGGOOOOMMMMSSSS MMMMooooddddeeeellll::::SSSSeeeeqqqquuuueeeennnnttttiiiiaaaallll eeeexxxxeeeeccccuuuuttttiiiioooonnnn iiiinnnn AAAApppp


Fairfax, VA 24

KKKKeeeeyyyyssssttttrrrrooookkkkeeee LLLLeeeevvvveeeellll MMMMooooddddeeeellll ((((KKKKLLLLMMMM

AAAAlllllllloooowwwwssss ddddeeeessssiiiiggggnnnneeeerrrr ttttoooo ccccrrrreeeeaaaatttteeee aaaa ssssiiiimmmmpppplllleeee mmmmooooddddeeeellll ooooffff ccccooooHHHHCCCCIIII ttttaaaasssskkkkssss iiiinnnnvvvvoooollllvvvviiiinnnngggg kkkkeeeeyyyy ssssttttrrrrooookkkkeeeessss

AAAAllllllll ooooppppeeeerrrraaaattttoooorrrrssss aaaarrrreeee pppprrrriiiimmmmiiiittttiiiivvvveeeessss tttthhhhaaaatttt ccccaaaannnn bbbbeeee aaaassssssssiiiiggggccccoooommmmpppplllleeeettttiiiioooonnnn ttttiiiimmmmeeeessss

OOOOnnnneeee mmmmeeeennnnttttaaaallll ooooppppeeeerrrraaaattttoooorrrr ppppllllaaaacccceeeedddd wwwwiiiitttthhhh 5555 hhhheeeeuuuurrrriiiissssttttiiiiccccssss

FFFFllllaaaatttt ssssttttrrrruuuuccccttttuuuurrrreeee wwwwiiiitttthhhh aaaassssssssuuuummmmppppttttiiiioooonnnn ooooffff sssseeeeqqqquuuueeeennnnttttiiiiaaaallll eeeemmmmaaaakkkkeeeessss iiiitttt eeeeaaaassssyyyy


Fairfax, VA 25

KKKKLLLLMMMM mmmmooooddddeeeellll Description Operator Duration (sec)Mentally prepare (Heuristic Rule 0) M 1.35Move cursor to “quick” (Heuristic Rule 1) P 1.10Double-click mouse button K 0.40Move cursor to “brown” (Heuristic Rule 1) P 1.10Shift-click mouse button K 0.40Mentally prepare (Heuristic Rule 0) M 1.35Move cursor to Edit menu (Heuristic Rule 1) P 1.10Click mouse button K 0.20Move cursor to Cut menu item (Heuristic Rule 1) P 1.10Click mouse button K 0.20Mentally prepare (Heuristic Rule 0) M 1.35Move cursor to before “fox” (Heuristic Rule 1) P 1.10Click mouse button K 0.20Mentally prepare (Heuristic Rule 0) M 1.35Move cursor to Edit menu (Heuristic Rule 1) P 1.10Click mouse button K 0.20Move cursor to Paste menu item (Heuristic Rule 1) P 1.10Click mouse button K 0.20

TOTAL PREDICTED TIME 14.90


Fairfax, VA 26

MMMMaaaaiiiinnnn nnnnoooonnnn----pppprrrriiiimmmmiiiittttiiiivvvveeee PPPPDDDDLLLL pppprrrroooocccceeee

(procedure :sequential(index (edit sentence))(mentally-prepare highlight-text-to-be-moved)(move-cursor-1100 first-word-quick)(double-click-mouse first-word-quick)(move-cursor-1100 last-word-brown)(shift-click-mouse last-word-brown)(mentally-prepare cut)(move-cursor-1100 Edit-menu)(click-mouse Edit-menu)(move-cursor-1100 Cut-item)(click-mouse Cut-item)(mentally-prepare highlight-destination)(move-cursor-1100 destination-space)(click-mouse destination-space)(mentally-prepare paste)(move-cursor-1100 Edit-menu)(click-mouse Edit-menu)(move-cursor-1100 Paste-item)(click-mouse Paste-item)

)

When this step is "eeeennnnaaaabbbblllleeeedddd"it looks for a procedurewhose index clause

matches "cccclllliiiicccckkkk----mmmmoooouuuusssseeee"

When this step is "eeeennnnaaaabbbblllleeeedddd"it looks for a procedurewhose index clause

matches "cccclllliiiicccckkkk----mmmmoooouuuusssseeee"

The iiiinnnnddddeeeexxxx clause is thepattern used to matchprocedure calls.

The iiiinnnnddddeeeexxxx clause is thepattern used to matchprocedure calls.

::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll is used toindicate that steps areexecuted in the order listed

::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll is used toindicate that steps areexecuted in the order listed


Fairfax, VA 27

TTTToooopppp lllleeeevvvveeeellll PPPPDDDDLLLL pppprrrroooocccceeeedddduuuurrrreeee

AAAAllllllll AAAAppppeeeexxxx mmmmooooddddeeeellllssss bbbbeeeeggggiiiinnnn wwwwiiiitttthhhh aaaa hhhhiiiigggghhhh----lllleeeevvvveeeellll pppprrrroooocccceeeeddddtttthhhhaaaatttt iiiinnnnvvvvooookkkkeeeessss """"ddddoooo----ddddoooommmmaaaaiiiinnnn"""" aaaalllloooonnnngggg wwwwiiiitttthhhh tttthhhheeee ttttoooopppp----lllleeeeddddoooommmmaaaaiiiinnnn pppprrrroooocccceeeedddduuuurrrreeeessss

ssssttttoooopppp is a special commandto terminate the

simulation

ssssttttoooopppp is a special commandto terminate the

simulation

(procedure :sequential

(index (do-domain))

(edit sentence)

(stop))


Fairfax, VA 28

PPPPrrrriiiimmmmiiiittttiiiivvvveeee pppprrrroooocccceeeedddduuuurrrreeeessss

(procedure(index (mentally-prepare ?activity))(profile memory)(step s1 (start-activity memory memory-act :duration 1350 => ?a))(step s2 (terminate) (waitfor (completed ?a))))

(procedure(index (move-cursor-1100 ?target))(profile right-hand)(step s1 (start-activity right-hand mouse-move-act :object ?target

:duration 1100 => ?a))(step t (terminate) (waitfor (completed ?a))))

Duration specifies the time tby this activity to complete

by previous research

Duration specifies the time tby this activity to complete

by previous research

Procedures that usresources must conta

"pppprrrrooooffffiiiilllleeee" clause

Procedures that usresources must conta

"pppprrrrooooffffiiiilllleeee" clause

"tttteeeerrrrmmmmiiiinnnnaaaatttteeee" generates anevent signalling the end

of a procedure

"tttteeeerrrrmmmmiiiinnnnaaaatttteeee" generates anevent signalling the end

of a procedure

"wwwwaaaaiiiittttffffoooorrrr" specifies conditionsfor step execution

"wwwwaaaaiiiittttffffoooorrrr" specifies conditionsfor step execution

The default is ::::ccccoooonnnnccccuuuurrrrrrrreeeennnnttttThe default is ::::ccccoooonnnnccccuuuurrrrrrrreeeennnntttt


Fairfax, VA 29

RRRRuuuunnnnnnnniiiinnnngggg AAAAppppeeeexxxx

Double-click"ApexApp"

Double-click"ApexApp"


Fairfax, VA 30

RRRRuuuunnnnnnnniiiinnnngggg SSSShhhheeeerrrrppppaaaa

LispListener

LispListener

Sherpainterface

SherpainterfaceStart Sherpa by

clicking the"Start" button

Start Sherpa byclicking the"Start" button


Fairfax, VA 31

SSSSiiiimmmmwwwwoooorrrrlllldddd mmmmeeeennnnuuuu

Click hereto see

availablesimworlds

Click hereto see

availablesimworlds


Fairfax, VA 32

LLLLooooaaaaddddiiiinnnngggg ffffrrrroooommmm SSSShhhheeeerrrrppppaaaa

Select """"FFFFooooxxxxKKKKLLLLMMMM"""" from thelist. The name of the

simworld must be in the"aaaallllllllwwwwoooorrrrllllddddssss....lllliiiisssspppp" file.

Select """"FFFFooooxxxxKKKKLLLLMMMM"""" from thelist. The name of the

simworld must be in the"aaaallllllllwwwwoooorrrrllllddddssss....lllliiiisssspppp" file.


Fairfax, VA 33

RRRRuuuunnnnnnnniiiinnnngggg tttthhhheeee KKKKLLLLMMMM mmmmooooddddeeeellll

RRRRuuuunnnnRRRRuuuunnnnRRRReeeesssseeeettttRRRReeeesssseeeetttt

PPPPaaaauuuusssseeeePPPPaaaauuuusssseeee

SSSStttteeeeppppSSSStttteeeepppp


Fairfax, VA 34

KKKKLLLLMMMM ttttrrrraaaacccceeee


Fairfax, VA 35

IIIInnnnssssppppeeeeccccttttiiiinnnngggg tttthhhheeee ttttrrrraaaacccceeee

Double-click on the""""TTTTaaaasssskkkk"""" label toinspect a task

Double-click on the""""TTTTaaaasssskkkk"""" label toinspect a task


Fairfax, VA 36

GGGGeeeennnneeeerrrraaaattttiiiinnnngggg aaaa PPPPEEEERRRRTTTT cccchhhhaaaarrrrtttt

Click here togenerate aPERT chart

Click here togenerate aPERT chart


Fairfax, VA 37

KKKKLLLLMMMM PPPPEEEERRRRTTTT cccchhhhaaaarrrrtttt


Fairfax, VA 38

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ::::HHHHiiiieeeerrrraaaarrrrcccchhhhiiiiccccaaaallll ttttaaaasssskkkk ddddeeeeccccoooommmmppppoooossssiiiitt

iiiinnnn AAAAppppeeeexxxx

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ::::HHHHiiiieeeerrrraaaarrrrcccchhhhiiiiccccaaaallll ttttaaaasssskkkk ddddeeeeccccoooommmmppppoooossssiiii

iiiinnnn AAAAppppeeeexxxx


Fairfax, VA 39

EEEElllleeeemmmmeeeennnnttttssss ooooffff aaaa CCCCMMMMNNNN----GGGGOOOOMMMMSSSS mmmmooooddddeeeellll

TTTToooopppp----lllleeeevvvveeeellll ggggooooaaaallll Edit manuscript

SSSSuuuubbbbggggooooaaaallllssss e.g., eeeeddddiiiitttt----uuuunnnniiiitttt----ttttaaaasssskkkk,,,, aaaaccccqqqquuuuiiiirrrreeee----uuuunnnniiiitttt----ttttaaaasssskkkk,,,,eeeexxxxeeeeccccuuuutttteeee----uuuunnnniiiitttt----ttttaaaasssskkkk,,,, mmmmoooo ddddiiiiffffyyyy----tttteeeexxxxtttt,,,,vvvveeeerrrriiiiffffyyyy----eeeeddddiiiitttt,,,, mmmmoooovvvveeee----tttteeeexxxxtttt,,,, ccccuuuutttt----tttteeeexxxxtttt,,,,ppppaaaasssstttteeee----tttteeeexxxxtttt,

MMMM eeeetttthhhhooooddddssss e.g., modify text by moving words, ordeleting phrases, or inserting words;highlight text as a phrase, or asarbitrary text,

SSSSeeeelllleeeeccccttttiiiioooonnnn e.g., if the text to be highlighted is aphrase made up of words, usehhhhiiiigggghhhhlllliiiigggghhhhtttt----pppphhhhrrrraaaasssseeee----ccccoooommmm pppprrrriiiisssseeeedddd----ooooffff----wwwwoooo rrrrddddssss,else use hhhhiiiigggghhhhlllliiiigggghhhhtttt----aaaarrrrbbbbiiiittttrrrraaaarrrryyyy----tttteeeexxxxtttt


Fairfax, VA 40

TTTToooopppp----lllleeeevvvveeeellll GGGGOOOOMMMMSSSS

goal: edit-manuscript

. goal: edit-unit-task ...repeat until no more unit tasks

. . goal: acquire unit-task ...if task not remembered

. . goal: execute-unit-task ...if a unit task was found


Fairfax, VA 41





. . . goal: turn-page ...if at end of manuscript page

. . . goal: get-from-manuscript



Fairfax, VA 42








. . . goal: modify-text

. . . . verify-edit 1.35


Fairfax, VA 43









. . . . [select: goal: move-text* ...if text is to be moved

. . . . goal: delete-phrase ...if a phrase is to be deleted

. . . . goal: insert-word] ...if a word is to be inserted

. . . . verify-edit 1.35


Fairfax, VA 44

EEEExxxxppppaaaannnnssssiiiioooonnnn ooooffff mmmmoooovvvveeee----tttteeeexxxxtttt

goal: move-text

. goal: cut-text

. goal: paste-text


Fairfax, VA 45


goal: move-text

. goal: cut-text

. . goal: highlight-text

. . goal: issue-cut-command

. goal: paste-text


Fairfax, VA 46


goal: move-text

. goal: cut-text



. . . move-cursor-to-edit-menu 1.10

. . . click-mouse-button 0.20

. . . move-mouse-to-cut-item 1.10

. . . verify-highlight 1.35


. goal: paste-text


Fairfax, VA 47

FFFFuuuullllllll mmmmoooovvvveeee----tttteeeexxxxtttt

goal: move-text

. goal: cut-text


. . . [select**:

goal: highlight-phrase-comprised-of-words

. . . . move-cursor-to-first-word 1.10

. . . . double-click-mouse-button 0.40

. . . . move-cursor-to-last-word 1.10

. . . . shift-click-mouse-button 0.40

. . . . verify-highlight 1.35

. . . goal: highlight-arbitrary-text

. . . . move-cursor-to-beginning-of-text

. . . . press-mouse-button

. . . . move-cursor-to-end-of-text

. . . . release-click-mouse-button

. . . . verify-highlight

]




. . . move-mouse-to-cut-item 1.10



. goal: paste-text

. . goal: position-cursor-at-insertion-point

. . . move-cursor-to-insertion-point1.10


. . . verify-position 1.35

. . goal: issue-paste-command



. . . move-mouse-to-paste-item 1.10




Fairfax, VA 48

TTTToooopppp----lllleeeevvvveeeellll CCCCMMMMNNNN PPPPDDDDLLLL((((pppprrrroooocccceeeedddduuuurrrreeee ::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll

((((iiiinnnnddddeeeexxxx ((((ddddoooo----ddddoooommmmaaaaiiiinnnn))))))))

((((sssseeeetttt----vvvvaaaarrrrssss----iiiinnnniiiittttiiiiaaaallll))))

((((eeeeddddiiiitttt mmmmaaaannnnuuuussssccccrrrriiiipppptttt))))

((((ssssttttoooopppp))))

))))((((pppprrrroooocccceeeedddduuuurrrreeee ::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll

((((iiiinnnnddddeeeexxxx ((((sssseeeetttt----vvvvaaaarrrrssss----iiiinnnniiiittttiiiiaaaallll))))))))

((((sssseeeetttt ****ttttaaaasssskkkk**** rrrreeeemmmmeeeemmmmbbbbeeeerrrreeeedddd))))

((((sssseeeetttt ****eeeeddddiiiitttt----ttttaaaasssskkkk**** mmmmoooovvvveeee----tttteeeexxxxtttt))))

((((sssseeeetttt ****tttteeeexxxxtttt----ttttoooo----bbbbeeee----mmmmoooovvvveeeedddd**** aaaallllllll----wwwwoooorrrrddddssss))))

((((sssseeeetttt ****ffffiiiirrrrsssstttt----wwwwoooorrrrdddd----ttttoooo----bbbbeeee----mmmmoooovvvveeeedddd**** qqqquuuuiiiicccckkkk))))

((((sssseeeetttt ****llllaaaasssstttt----wwwwoooorrrrdddd----ttttoooo----bbbbeeee----mmmmoooovvvveeeedddd**** bbbbrrrroooowwwwnnnn))))

((((sssseeeetttt ****ddddeeeessssttttiiiinnnnaaaattttiiiioooonnnn**** ssssppppaaaacccceeee----bbbbeeeeffffoooorrrreeee----ffffooooxxxx))))

))))

State vector withglobal variables

State vector withglobal variables


Fairfax, VA 49

TTTToooopppp----lllleeeevvvveeeellll GGGGOOOOMMMMSSSS iiiinnnn PPPPDDDDLLLL

goal: eeeeddddiiiitttt----mmmmaaaannnnuuuussssccccrrrriiiipppptttt


. . goal: aaaaccccqqqquuuuiiiirrrreeee uuuunnnniiiitttt----ttttaaaasssskkkk ...if task not remembered

. . goal: eeeexxxxeeeeccccuuuutttteeee----uuuunnnniiiitttt----ttttaaaasssskkkk ...if a unit task was found

((((pppprrrroooocccceeeedddduuuurrrreeee

((((iiiinnnnddddeeeexxxx ((((eeeeddddiiiitttt mmmmaaaannnnuuuussssccccrrrriiiipppptttt))))))))

((((sssstttteeeepppp ssss1111 ((((????tttthhhhiiiissss----sssstttteeeepppp))))

((((sssseeeelllleeeecccctttt ????tttthhhhiiiissss----sssstttteeeepppp

((((ddddeeeeppppeeeennnnddddssss----oooonnnn ’’’’****ttttaaaasssskkkk**** ’’’’((((((((rrrreeeemmmmeeeemmmmbbbbeeeerrrreeeedddd nnnnoooo----oooopppp))))

((((ffffoooorrrrggggooootttttttteeeennnn aaaaccccqqqquuuuiiiirrrreeee----uuuunnnniiiitttt----ttttaaaasssskkkk))))))))))))))))))))

((((sssstttteeeepppp ssss2222 ((((eeeexxxxeeeeccccuuuutttteeee----uuuunnnniiiitttt----ttttaaaasssskkkk)))) ((((wwwwaaaaiiiittttffffoooorrrr ????ssss1111))))))))

((((sssstttteeeepppp tttt ((((tttteeeerrrrmmmmiiiinnnnaaaatttteeee)))) ((((wwwwaaaaiiiittttffffoooorrrr ????ssss1111 ????ssss2222))))))))))))

The sssseeeelllleeeecccctttt clause ineeeeddddiiiitttt mmmmaaaannnnuuuussssccccrrrriiiipppptttt

implements an "if"selection rule

The sssseeeelllleeeecccctttt clause ineeeeddddiiiitttt mmmmaaaannnnuuuussssccccrrrriiiipppptttt

implements an "if"selection rule

????tttthhhhiiiissss----sssstttteeeepppp is a variable that bound to aaaaccccqqqquuuuiiiirrrreeee----uuuunnnniiiitttt----ttttaaaasssskkkk

????tttthhhhiiiissss----sssstttteeeepppp is a variable that bound to aaaaccccqqqquuuuiiiirrrreeee----uuuunnnniiiitttt----ttttaaaasssskkkk


Fairfax, VA 50

NNNNeeeewwww PPPPDDDDLLLL CCCCoooonnnnssssttttrrrruuuuccccttttsssspppprrrroooocccceeeedddduuuurrrreeee::::

— ::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll steps executed serially in the order listed

— :ccccoooonnnnccccuuuurrrrrrrreeeennnntttt steps executed in parallel, subject to resourceconstraints and logical dependencies

iiiinnnnddddeeeexxxx: unique name of a procedure used to match stored proced

sssstttteeeepppp: a sub-procedure of a larger procedure

sssstttteeeepppp ttttaaaagggg: unique label for each step, required only in ::::ccccoooonnnnccccuuuurrrrrrrreeeennnntttt

wwwwaaaaiiiittttffffoooorrrr: enables sequencing of steps in a :concurrent procedurindicating dependencies -- events that satisfy conditions forexecution

sssseeeelllleeeecccctttt:::: step-level clause that conditions the execution of thatthe evaluation of an expression

tttteeeerrrrmmmmiiiinnnnaaaatttteeee:::: causes an event signaling the end of a procedure


Fairfax, VA 51

EEEExxxxeeeeccccuuuutttteeee uuuunnnniiiitttt ttttaaaasssskkkk. . goal: eeeexxxxeeeeccccuuuutttteeee uuuunnnniiiitttt ttttaaaasssskkkk

. . .goal: mmmmooooddddiiiiffffyyyy----tttteeeexxxxtttt

. . . . [select: goal: move-text*

. . . . goal: delete-phrase

. . . . goal: insert-word]

. . . . vvvveeeerrrriiiiffffyyyy----eeeeddddiiiitttt

((((pppprrrroooocccceeeedddduuuurrrreeee ((((iiiinnnnddddeeeexxxx ((((eeeexxxxeeeeccccuuuutttteeee----uuuunnnniiiitttt----ttttaaaasssskkkk)))))))) ((((sssstttteeeepppp ssss1111 ((((mmmmooooddddiiiiffffyyyy----tttteeeexxxxtttt ????mmmmooooddddiiiiffffiiiiccccaaaattttiiiioooonnnn----ttttaaaasssskkkk)))) ((((sssseeeelllleeeecccctttt ????mmmmooooddddiiiiffffiiiiccccaaaattttiiiioooonnnn----ttttaaaasssskkkk ((((sssseeeeccccoooonnnndddd ((((aaaassssssssoooocccc ’’’’****eeeeddddiiiitttt----ttttaaaasssskkkk**** vvvvaaaarrrrlllliiiisssstttt****)))))))))))))))) ((((sssstttteeeepppp ssss2222 ((((vvvveeeerrrriiiiffffyyyy eeeeddddiiiitttt)))) ((((wwwwaaaaiiiittttffffoooorrrr ????ssss1111)))))))) ((((sssstttteeeepppp tttt ((((tttteeeerrrrmmmmiiiinnnnaaaatttteeee))))((((wwwwaaaaiiiittttffffoooorrrr ????ssss1111 ????ssss2222))))))))))))

????mmmmooooddddiiiiffffiiiiccccaaaattttiiiioooonnnn----ttttaaaasssskkkkbound to value of*edit-task* which is

mmmmoooovvvveeee----tttteeeexxxxtttt

????mmmmooooddddiiiiffffiiiiccccaaaattttiiiioooonnnn----ttttaaaasssskkkkbound to value of*edit-task* which is

mmmmoooovvvveeee----tttteeeexxxxtttt


Fairfax, VA 52

MMMMooooddddiiiiffffyyyy tttteeeexxxxtttt bbbbyyyy mmmmoooovvvviiiinnnngggg


. . . . goal: move-text*

. . . . . goal: cut-text

. . . . . goal: paste-text

((((pppprrrroooocccceeeedddduuuurrrreeee ::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll

((((iiiinnnnddddeeeexxxx ((((mmmmooooddddiiiiffffyyyy----tttteeeexxxxtttt mmmmoooovvvveeee----tttteeeexxxxtttt))))))))

((((ccccuuuutttt----tttteeeexxxxtttt))))

((((ppppaaaasssstttteeee----tttteeeexxxxtttt))))))))


Fairfax, VA 53

CCCCuuuutttt tttteeeexxxxtttt

goal: cut-text

. goal: highlight-text

. goal: issue-cut-command


((((iiiinnnnddddeeeexxxx ((((ccccuuuutttt----tttteeeexxxxtttt))))))))

((((hhhhiiiigggghhhhlllliiiigggghhhhtttt----tttteeeexxxxtttt))))

((((iiiissssssssuuuueeee----mmmmeeeennnnuuuu----ccccoooommmmmmmmaaaannnndddd EEEEddddiiiitttt----mmmmeeeennnnuuuu CCCCuuuutttt----iiiitttteeeemmmm))))))))


Fairfax, VA 54

VVVVeeeerrrriiiiffffyyyy hhhhiiiigggghhhhlllliiiigggghhhhtttt::::pppprrrriiiimmmmiiiittttiiiivvvveeee pppprrrroooocccceeeedddduuuurrrreeeessss

. . . verify-highlight1.35

((((vvvveeeerrrriiiiffffyyyy hhhhiiiigggghhhhlllliiiigggghhhhtttt ????MMMMeeeennnnuuuu----iiiitttteeeemmmm))))

((((pppprrrroooocccceeeedddduuuurrrreeee

((((iiiinnnnddddeeeexxxx ((((vvvveeeerrrriiiiffffyyyy ????ttttyyyyppppeeee ????iiiitttteeeemmmm))))))))

((((pppprrrrooooffffiiiilllleeee mmmmeeeemmmmoooorrrryyyy))))

((((sssstttteeeepppp ssss1111 ((((ssssttttaaaarrrrtttt----aaaaccccttttiiiivvvviiiittttyyyy mmmmeeeemmmmoooorrrryyyy mmmmeeeemmmmoooorrrryyyy----aaaacccctttt ::::dddduuuurrrraaaattttiiiioooonnnn 1111333355550000

((((sssstttteeeepppp tttt ((((tttteeeerrrrmmmmiiiinnnnaaaatttteeee)))) ((((wwwwaaaaiiiittttffffoooorrrr ((((ccccoooommmmpppplllleeeetttteeeedddd ????aaaa))))))))))))))))

::::dddduuuurrrraaaattttiiiioooonnnn in a ssssttttaaaarrrrtttt----aaaaccccttttiiiivvvviiiittttyyyy step specifiecompletion time inmilliseconds

::::dddduuuurrrraaaattttiiiioooonnnn in a ssssttttaaaarrrrtttt----aaaaccccttttiiiivvvviiiittttyyyy step specifiescompletion time inmilliseconds


Fairfax, VA 55

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS iiiinnnn PPPPDDDDLLLLllllooooooookkkkssss aaaa llllooootttt lllliiiikkkkeeee GGGGLLLLEEEEAAAANNNN

GGGGLLLLEEEEAAAANNNN wwwwaaaassss aaaa GGGGOOOOMMMMSSSS ttttoooooooollll ccccrrrreeeeaaaatttteeeedddd bbbbyyyy DDDDaaaavvvveeee KKKKiiiieeeerrrraaaassss aaaannnnddddhhhhiiiissss ccccoooolllllllleeeeaaaagggguuuueeeessss aaaatttt tttthhhheeee UUUUnnnniiiivvvveeeerrrrssssiiiittttyyyy ooooffff MMMMiiiicccchhhhiiiiggggaaaannnn iiiissss

— Natural GOMS language, NGOMSL

— Available for download from David Kierass web pages

— Ask Scott Wood (instructor at a tutorial this afternyou want more information -- he was a major develope

Kieras, D. E., Wood, S. D., Abotel, K., & Hornof, A. (1995). GLEAN: AComputer-Based Tool for Rapid GOMS Model Usability Evaluation Interface Designs. UIST95 Proceedings.


Fairfax, VA 56

CCCCMMMMNNNN pppprrrriiiimmmmiiiittttiiiivvvveeeessssCCCCaaaannnn bbbbeeee aaaatttt aaaannnnyyyy lllleeeevvvveeeellll ooooffff ggggrrrraaaannnnuuuullllaaaarrrriiiittttyyyy

— Operator execution assumed to be sequential

UUUUssssuuuuaaaallllllllyyyy eeeevvvveeeennnnttttssss iiiinnnn tttthhhheeee ttttaaaasssskkkk ddddoooommmmaaaaiiiinnnn— Mouse movement

— Mouse clicking

— Key presses

FFFFoooorrrr rrrreeeeaaaallllllllyyyy sssskkkkiiiilllllllleeeedddd bbbbeeeehhhhaaaavvvviiiioooorrrr tttthhhheeee aaaassssssssuuuummmmppppttttiiiioooonnnn ooooffff ssssooooppppeeeerrrraaaattttoooorrrr eeeexxxxeeeeccccuuuuttttiiiioooonnnn bbbbrrrreeeeaaaakkkkssss ddddoooowwwwnnnn— Parallelism -- actions overlap to various degrees

— Need to go deeper in the cognitive architecture to cthe parallelism that leads to overlap


Fairfax, VA 57

CCCCPPPPMMMM----GGGGOOOOMMMMSSSS ::::IIIInnnntttteeeerrrrlllleeeeaaaavvvviiiinnnngggg tttteeeemmmmppppllllaaaatttteeeessss ttttoooo aaaaccccppppaaaarrrraaaalllllllleeeellll aaaannnndddd sssseeeerrrriiiiaaaallll eeeexxxxeeeeccccuuuuttttiiiiccccooooggggnnnniiiittttiiiivvvveeee,,,, ppppeeeerrrrcccceeeeppppttttuuuuaaaallll,,,, aaaannnndddd mmmm

ooooppppeeeerrrraaaattttoooorrrrssss

CCCCPPPPMMMM----GGGGOOOOMMMMSSSS ::::IIIInnnntttteeeerrrrlllleeeeaaaavvvviiiinnnngggg tttteeeemmmmppppllllaaaatttteeeessss ttttoooo aaaaccccppppaaaarrrraaaalllllllleeeellll aaaannnndddd sssseeeerrrriiiiaaaallll eeeexxxxeeeeccccuuuuttttiiiiccccooooggggnnnniiiittttiiiivvvveeee,,,, ppppeeeerrrrcccceeeeppppttttuuuuaaaallll,,,, aaaannnndddd mmmm

ooooppppeeeerrrraaaattttoooorrrrssss


Fairfax, VA 58

GGGGooooaaaallll ooooffff CCCCPPPPMMMM----GGGGOOOOMMMMSSSS

MMMMooooddddeeeellll tttthhhheeee ttttiiiimmmmeeee ffffoooorrrr hhhhiiiigggghhhhllllyyyy sssskkkkiiiilllllllleeeedddd ppppeeeeoooopppplllleeee ttttoooo aaaaccccttttaaaasssskkkkssss bbbbyyyy uuuussssiiiinnnngggg mmmmeeeetttthhhhooooddddssss mmmmaaaaddddeeee uuuupppp ooooffff eeeelllleeeemmmmeeeennnnttttaaaarrrryyyyCCCCooooggggnnnniiiittttiiiivvvveeee,,,, PPPPeeeerrrrcccceeeeppppttttuuuuaaaallll,,,, aaaannnndddd MMMMoooottttoooorrrr ooooppppeeeerrrraaaattttoooorrrrssss

CCCCrrrreeeeaaaatttteeee ccccooooggggnnnniiiittttiiiivvvveeeellllyyyy----ppppllllaaaauuuussssiiiibbbblllleeee,,,, rrrreeeeuuuussssaaaabbbblllleeee tttteeeemmmmppppllllaaaatttteeeessss tttthhhhaaaattttccccaaaappppttttuuuurrrreeee tttthhhheeee ppppaaaarrrraaaalllllllleeeelllliiiissssmmmm aaaannnndddd ccccoooonnnnssssttttrrrraaaaiiiinnnnttttssss iiiinnnn tttthhhhmmmmeeeetttthhhhooooddddssss

IIIInnnntttteeeeggggrrrraaaatttteeee tttteeeemmmmppppllllaaaatttteeeessss iiiinnnnttttoooo aaaa mmmmooooddddeeeellll tttthhhhaaaatttt aaaalllllllloooowwwwsssspppprrrreeeeddddiiiiccccttttiiiioooonnnnssss ttttoooo fffflllloooowwww ffffrrrroooommmm aaaa CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ttttaaaasssskkkk hhhhiiiieeeerrrr— Shield the analyst from the complexity of templates

— Keep the analyst in the task domain


Fairfax, VA 59

HHHHiiiigggghhhhllllyyyy SSSSkkkkiiiilllllllleeeedddd

KKKKLLLLMMMM aaaannnndddd CCCCMMMMNNNN----GGGGOOOOMMMMSSSS pppprrrreeeeddddiiiicccctttt hhhhuuuummmmaaaannnn bbbbeeeehhhhaaaavvvviiiioooorrrr wwwweeeellllllll— When the user knows the procedures of a domain well presented with a new task

— When operators can be assumed to work sequentially

CCCCPPPPMMMM----GGGGOOOOMMMMSSSS iiiissss nnnneeeeeeeeddddeeeedddd— When task becomes so routine that users perform actin parallel to achieve faster execution time

— Examples in the lab:

¥ Card, Moran & Newell, 1983, Chapter 8, Section 4.-- Te

¥ Baskin & John, 1998 -- CAD

¥ John, et. al., 2002 -- ATM

— Example in the field

¥ Gray, et. al., 1993 -- Project Ernestine: telephone op


Fairfax, VA 60

PPPPeeeeddddaaaaggggooooggggiiiiccccaaaallll ggggooooaaaallllssss ffffoooorrrr tttthhhheeeeCCCCPPPPMMMM----GGGGOOOOMMMMSSSS sssseeeeccccttttiiiioooonnnn

SSSShhhhoooowwww tttthhhheeee rrrreeeellllaaaattttiiiioooonnnnsssshhhhiiiipppp bbbbeeeettttwwwweeeeeeeennnn CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ((((wwwwiiiitttthhhh iiiiaaaassssssssuuuummmmppppttttiiiioooonnnn ooooffff sssseeeerrrriiiiaaaallll ooooppppeeeerrrraaaattttoooorrrrssss)))) aaaannnndddd CCCCPPPPMMMM----GGGGOOOOMMMMSSSS rrrreeeellllaaaaxxxxeeeessss tttthhhhaaaatttt aaaassssssssuuuummmmppppttttiiiioooonnnn))))

SSSShhhhoooowwww hhhhoooowwww ttttoooo ggggoooo ffffrrrroooommmm CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ttttoooo CCCCPPPPMMMM----GGGGOOOOMMMMSSSSuuuussssiiiinnnngggg AAAAppppeeeexxxx— Templates of common behaviors

— Interweaving of templates

— Sherpas PERT chart generator

SSSShhhhoooowwww hhhhoooowwww ttttoooo ffffiiiinnnneeeesssssssseeee aaaannnn iiiinnnntttteeeerrrraaaaccccttttiiiivvvveeee wwwwoooorrrrlllldddd iiiinnnn AAAAppppeeeexxxx bbbbyyyyuuuussssiiiinnnngggg AAAAppppeeeexxxxBBBBuuuuiiiillllddddeeeerrrr aaaannnndddd aaaa gggglllloooobbbbaaaallll vvvvaaaarrrriiiiaaaabbbblllleeee lllliiiisssstttt,,,,*varlist*— We ll do this first


Fairfax, VA 61

IIIInnnntttteeeerrrraaaaccccttttiiiivvvveeee WWWWoooorrrrlllldddd SSSSiiiimmmmuuuullllaaaattttiiii

RRRReeeeqqqquuuuiiiirrrreeeemmmmeeeennnnttttssss— Objects that can behave

¥ Can be perceived by Apex

¥ Can be acted on by Apex

¥ Can change either in response to actions or by themsel

— Expressed in a form that Apex can recognize them

AAAA ssssiiiimmmmpppplllleeee ffffiiiinnnneeeessssssssiiiinnnngggg ooooffff tttthhhheeeesssseeee rrrreeeeqqqquuuuiiiirrrreeeemmmmeeeennnnttttssss— Html storyboards define the objects, built with ApexBuilderextensions to DreamWeaver

— ApexConvertor translates this html into Apex-compatibl

— Global list of attribute-value pairs and procedures and change these to simulate interactivity


Fairfax, VA 62

CCCCaaaarrrrnnnneeeeggggiiiieeee MMMMeeeelllllllloooonnnn UUUUnnnniiiivvvveeeerrrrssssiiiittttyyyyssssMMMMaaaasssstttteeeerrrrssss ooooffff HHHHCCCCIIII &&&&

MMMMaaaasssstttteeeerrrrssss ooooffff SSSSooooffffttttwwwwaaaarrrreeee EEEEnnnnggggiiiinnnneeeeeeeerrrrpppprrrroooojjjjeeeeccccttttssss tttthhhhiiiissss yyyyeeeeaaaarrrr((((ccccoooommmmpppplllleeeetttteeeedddd 2222aaaauuuugggg00002222))))

CCCChhhhaaaarrrrggggeeee:::: MMMMaaaakkkkeeee iiiitttt—easy to build simple worlds in Apex and

—possible to hook up to external world simul

(the next few slides come directly from thepresentations, and you have their easy-to-usystem on the CD)


Fairfax, VA 63

AAAAnnnn AAAAppppeeeexxxx WWWWoooorrrrlllldddd


Fairfax, VA 64

WWWWoooorrrrlllldddd vvvviiiissssuuuuaaaalllliiiizzzzaaaattttiiiioooonnnn

You have to run somemodel to get it to buildthe world just to get itto understand that thereis a world.—CI participant


Fairfax, VA 65


Fairfax, VA 66


Fairfax, VA 67


Fairfax, VA 68


Fairfax, VA 69


Fairfax, VA 70


Fairfax, VA 71

A few minutes later


Fairfax, VA 72


Fairfax, VA 73


Fairfax, VA 74

Converting a world created with ApexBuilder intoApex-compatible LISP


Fairfax, VA 75


Fairfax, VA 76


Fairfax, VA 77


Fairfax, VA 78


Fairfax, VA 79


Fairfax, VA 80


Fairfax, VA 81

Modifying a World:Using custom images or default iconic images


Fairfax, VA 82


Fairfax, VA 83


Fairfax, VA 84


Fairfax, VA 85


Fairfax, VA 86

IIIInnnniiiittttiiiiaaaalllliiiizzzzeeee ffffiiiilllleeee ffffoooorrrr tttthhhheeee ffffoooo((((iiiinnnniiiittttiiiiaaaalllliiiizzzzeeee----ssssiiiimmmmuuuullllaaaattttiiiioooonnnn

((((lllleeeetttt****

((((((((wwwwoooorrrrlllldddd ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’llllooooccccaaaalllleeee ::::nnnnaaaammmmeeee ’’’’wwwwoooorrrrlllldddd))))))))

((((HHHHuuuummmmaaaannnn ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’HHHHuuuummmmaaaannnn ::::nnnnaaaammmmeeee ’’’’aaaaggggeeeennnntttt ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd

::::llllooooccccaaaattttiiiioooonnnn ’’’’((((0000 0000 444400000000))))))))))))

((((MMMMoooouuuusssseeee ((((ccccrrrreeeeaaaatttteeee----MMMMoooouuuusssseeee wwwwoooorrrrlllldddd))))))))

((((qqqquuuuiiiicccckkkk ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’qqqquuuuiiiicccckkkk ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd

::::ppppoooossss ’’’’((((222255558888 55559999)))) ::::ddddiiiimmmmeeeennnnssssiiiioooonnnnssss ’’’’((((44440000 11119999))))))))))))

((((bbbbrrrroooowwwwnnnn ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’bbbbrrrroooowwwwnnnn ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd


((((EEEEddddiiiitttt----mmmmeeeennnnuuuu ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’EEEEddddiiiitttt----mmmmeeeennnnuuuu ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd


((((FFFFiiiilllleeee----mmmmeeeennnnuuuu ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’FFFFiiiilllleeee----mmmmeeeennnnuuuu ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd


((((CCCCuuuutttt----iiiitttteeeemmmm ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’CCCCuuuutttt----iiiitttteeeemmmm ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd


((((ssssppppaaaacccceeee----bbbbeeeeffffoooorrrreeee----ffffooooxxxx ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’ssssppppaaaacccceeee----bbbbeeeeffffoooorrrreeee----ffffooooxxxx ::::llllooooccccaaaa


((((PPPPaaaasssstttteeee----iiiitttteeeemmmm ((((mmmmaaaakkkkeeee----iiiinnnnssssttttaaaannnncccceeee ’’’’iiiinnnntttteeeerrrrffffaaaacccceeee----oooobbbbjjjjeeeecccctttt ::::nnnnaaaammmmeeee ’’’’PPPPaaaasssstttteeee----iiiitttteeeemmmm ::::llllooooccccaaaalllleeee wwwwoooorrrrlllldddd

::::ppppoooossss ’’’’((((111144446666 99998888)))) ::::ddddiiiimmmmeeeennnnssssiiiioooonnnnssss ’’’’((((111144445555 11117777))))))))))))))))

((((mmmmaaaappppcccc ####’’’’aaaasssssssseeeemmmmbbbblllleeee ((((lllliiiisssstttt HHHHuuuummmmaaaannnn MMMMoooouuuusssseeee qqqquuuuiiiicccckkkk bbbbrrrroooowwwwnnnn EEEEddddiiiitttt----mmmmeeeennnnuuuu FFFFiiiilllleeee----mmmmeeeennnnuuuu CCCCuuuutttt----iiiitttteeeemmmm ssssppppaaaacccceeee----bbbbPPPPaaaasssstttteeee----iiiitttteeeemmmm))))))))))))))))

Words inthe text

Words inthe text

Menus andmenu items

Menus andmenu items

Places ofinterest inthe text

Places ofinterest inthe text


Fairfax, VA 87

SSSSiiiimmmmpppplllleeee IIIInnnntttteeeerrrraaaaccccttttiiiivvvviiiittttyyyy::::UUUUssssiiiinnnngggg *VARLIST*

UUUUsssseeee aaaa gggglllloooobbbbaaaallllllllyyyy----aaaacccccccceeeessssssssiiiibbbblllleeee lllliiiisssstttt ooooffff aaaattttttttrrrriiiibbbbuuuutttteeee----vvvvaaaatttthhhhaaaatttt ccccaaaannnn bbbbeeee rrrreeeeaaaadddd aaaannnndddd cccchhhhaaaannnnggggeeeedddd tttthhhhrrrroooouuuugggghhhh PPPPDDDDLLLL aaaassss aaaassssiiiimmmmpppplllleeee ssssiiiimmmmuuuullllaaaattttiiiioooonnnn ooooffff iiiinnnntttteeeerrrraaaaccccttttiiiioooonnnn iiiinnnn tttthhhheeee wwwwoooorrrrlllldddd

IIIInnnn tttthhhheeee ffffooooxxxx eeeexxxxaaaammmmpppplllleeee— The words start out visible and change to highlightethe are double- or shift-clicked

— The menu names are always visible, but the menu itemchange from invisible to visible when the menu nameclicked

— The destination space, i.e., the space-before-fox, visible


Fairfax, VA 88

AAAAddddddddiiiittttiiiioooonnnnssss ttttoooo ((((sssseeeetttt----vvvvaaaarrrrssss----iiiinnnniiiittttiiiiaaaallll))))


((((iiiinnnnddddeeeexxxx ((((sssseeeetttt----vvvvaaaarrrrssss----iiiinnnniiiittttiiiiaaaallll))))))))

;;;;;;;; VVVVaaaarrrriiiiaaaabbbblllleeeessss tttthhhhaaaatttt eeeennnnccccooooddddeeee iiiinnnnffffoooorrrrmmmmaaaattttiiiioooonnnn aaaabbbboooouuuutttt tttthhhheeee hhhhuuuummmmaaaannnn uuuusssseeeerrrr

;;;;;;;; jjjjuuuusssstttt lllliiiikkkkeeee iiiinnnn tttthhhheeee CCCCMMMMNNNN----GGGGOOOOMMMMSSSS mmmmooooddddeeeellll ((((sssseeeeeeee sssslllliiiiddddeeee 55554444))))

;;;;;;;; VVVVaaaarrrriiiiaaaabbbblllleeeessss tttthhhhaaaatttt eeeennnnccccooooddddeeee iiiinnnnffffoooorrrrmmmmaaaattttiiiioooonnnn aaaabbbboooouuuutttt tttthhhheeee iiiinnnniiiittttiiiiaaaallll sssstttt

;;;;;;;; TTTThhhheeeesssseeee vvvvaaaarrrriiiiaaaabbbblllleeeessss mmmmuuuusssstttt mmmmaaaattttcccchhhh tttthhhheeee nnnnaaaammmmeeeessss ooooffff tttthhhheeee iiiinnnntttteeeerrrrffffaaaacccceeee

;;;;;;;; tttthhhheeee iiiinnnniiiittttiiiiaaaalllliiiizzzzeeee ffffiiiilllleeee

((((sssseeeetttt qqqquuuuiiiicccckkkk vvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt bbbbrrrroooowwwwnnnn vvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt EEEEddddiiiitttt----mmmmeeeennnnuuuu vvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt FFFFiiiilllleeee----mmmmeeeennnnuuuu vvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt CCCCuuuutttt----iiiitttteeeemmmm iiiinnnnvvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt ssssppppaaaacccceeee----bbbbeeeeffffoooorrrreeee----ffffooooxxxx vvvviiiissssiiiibbbblllleeee))))

((((sssseeeetttt PPPPaaaasssstttteeee----iiiitttteeeemmmm iiiinnnnvvvviiiissssiiiibbbblllleeee))))))))

We ll write PDL thatchanges these valuesas the model interacts

with the world

We ll write PDL thatchanges these valuesas the model interacts

with the world


Fairfax, VA 89

IIIInnnntttteeeerrrraaaaccccttttiiiinnnngggg tttthhhhrrrroooouuuugggghhhh *varlist*((((ttttoooo bbbbeeee ddddiiiiggggeeeesssstttteeeedddd aaaatttt yyyyoooouuuurrrr lllleeeeiiiissssuuuurrrreeee

AAAAppppeeeexxxx hhhhaaaassss tttthhhheeee aaaabbbbiiiilllliiiittttyyyy ttttoooo ccccaaaallllllll oooouuuutttt ttttoooo lllliiiisssspppp ttttoooo rrrreeeemmmmaaaannnniiiippppuuuullllaaaatttteeee tttthhhheeee *varlist*— See primitives-special.lisp on the CD or on the Apex

RRRReeeeaaaaddddiiiinnnngggg vvvvaaaalllluuuueeeessss,,,, lllliiiisssspppp oooorrrr PPPPDDDDLLLL— (depends-on <var> <val> <meth-list>) is a lisp function in the select clause (seen on slides 55 & 57)

— (extract ?info) is a PDL procedure that returns the the attribute ?info in *varlist*

— (variable ?var ?val) is an event that Apex can waitfor

CCCChhhhaaaannnnggggiiiinnnngggg aaaa vvvvaaaalllluuuueeee iiiinnnn *varlist*— (set ?var ?val) is a call to a PDL procedure that sets of the attribute ?var to be ?val. It also causes an event thApex can understand so it knows that the value has bchanged. This event is the (variable ?var ?val) above.


Fairfax, VA 90

SSSSuuuummmmmmmmaaaarrrryyyy ooooffff WWWWoooorrrrlllldddd BBBBuuuuiiiillllddddiiiinnnngggg

WWWWeeee hhhhaaaavvvveeee jjjjuuuusssstttt sssseeeeeeeennnn aaaa ssssiiiimmmmpppplllliiiiffffiiiieeeedddd mmmmooooddddeeeellll ooooffff eeeexxxxtttteeeerrrrnnnnaaaallll wwwwoooorrrrlllldddd— ApexBuilder -> ApexConverter -> initialize.lisp– *varlist* to hold the state of the world

— Several special primitives and lisp functions to reachange the *varlist*

— Suitable approach for many HCI tasks

AAAAppppeeeexxxx aaaallllssssoooo ssssuuuuppppppppoooorrrrttttssss ccccoooommmmmmmmuuuunnnniiiiccccaaaattttiiiioooonnnn wwwwiiiitttthhhh aaaa ccccoooommmmpppplllleeeetttteeee iiiinnnntttteeeerrrraaaaccccttttiiiivvvveeee wwwwoooorrrrlllldddd wwwwhhhheeeennnn yyyyoooouuuu nnnneeeeeeee— Build any world you wish in lisp within the Apex sy

— Have Apex operate an external simulation (e.g., CMU students have controlled a browser and the AMBR ATC through HLA)

— Both approaches are beyond the scope of this tutoria


Fairfax, VA 91

PPPPeeeeddddaaaaggggooooggggiiiiccccaaaallll ggggooooaaaallllssss ffffoooorrrr tttthhhheeeeCCCCPPPPMMMM----GGGGOOOOMMMMSSSS sssseeeeccccttttiiiioooonnnn

SSSShhhhoooowwww tttthhhheeee rrrreeeellllaaaattttiiiioooonnnnsssshhhhiiiipppp bbbbeeeettttwwwweeeeeeeennnn CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ((((wwwwiiiitttthhhh iiiiaaaassssssssuuuummmmppppttttiiiioooonnnn ooooffff sssseeeerrrriiiiaaaallll ooooppppeeeerrrraaaattttoooorrrrssss)))) aaaannnndddd CCCCPPPPMMMM----GGGGOOOOMMMMSSSS rrrreeeellllaaaaxxxxeeeessss tttthhhhaaaatttt aaaassssssssuuuummmmppppttttiiiioooonnnn))))

SSSShhhhoooowwww hhhhoooowwww ttttoooo ggggoooo ffffrrrroooommmm CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ttttoooo CCCCPPPPMMMM----GGGGOOOOMMMMSSSSuuuussssiiiinnnngggg AAAAppppeeeexxxx— Templates of common behaviors

— Interweaving of templates

— Sherpas PERT chart generator

SSSShhhhoooowwww hhhhoooowwww ttttoooo ffffiiiinnnneeeesssssssseeee aaaannnn iiiinnnntttteeeerrrraaaaccccttttiiiivvvveeee wwwwoooorrrrlllldddd iiiinnnn AAAAppppeeeexxxx bbbbyyyyuuuussssiiiinnnngggg AAAAppppeeeexxxxBBBBuuuuiiiillllddddeeeerrrr aaaannnndddd aaaa gggglllloooobbbbaaaallll vvvvaaaarrrriiiiaaaabbbblllleeee lllliiiisssstttt,,,,*varlist*


Fairfax, VA 92

TTTThhhheeee rrrreeeellllaaaattttiiiioooonnnnsssshhhhiiiipppp bbbbeeeettttwwwweeeeeeeennnnCCCCMMMMNNNN----GGGGOOOOMMMMSSSS aaaannnndddd CCCCPPPPMMMM----GGGGOOOOMMMMSSSS

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS ooooppppeeeerrrraaaattttoooorrrrssss— Can be at any level from milliseconds to seconds to

— As long as seriality & independence of history are maintai

CCCCPPPPMMMM----GGGGOOOOMMMMSSSS ooooppppeeeerrrraaaattttoooorrrrssss— Are at the level of single cognitive, perceptual, aactions, in the tens of milliseconds

— The cognitive, perceptual and motor processors are within themselves but parallel with respect to each

— Combine these into psychologically plausible, reusapatterns called templates using task analysis and theconstraints of the Model Human Processor (Card, MorNewell, 1983)

— Templates then implement the CMN-GOMS operators (Jo& Gray, CHI Tutorials, 1992-1995)


Fairfax, VA 93

AAAAnnnn eeeexxxxaaaammmmpppplllleeee tttteeeemmmmppppllllaaaatttteeee::::FFFFaaaasssstttt----mmmmoooovvvveeee----cccclllliiiicccckkkk

logical and resourcedependenciesSTART

initiate-move-cursor

perceive-target

290

0

50 50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

mouseDn

100

initiate-mouseDn

50

mouseUp

100

new-cursor-locationworld

vision

cognition

right hand

eye move from Gray and Boehm-Davis (2000)

MHP resourcedependencies

logicaldependencies

attend-target

initiate-POG


Fairfax, VA 94

CCCCoooommmmppppoooossssiiiinnnngggg TTTTeeeemmmmppppllllaaaatttteeeessss::::AAAA ttttaaaasssskkkk mmmmaaaayyyy rrrreeeeqqqquuuuiiiirrrreeee ttttwwwwoooo FFFFaaaasssstttt

iiiinnnn ssssuuuucccccccceeeessssssssiiiioooonnnn

STARTinitiate-move-

cursor

perceive-target

290

0

attend-target

50

initiate-POG

50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

FAST M/C

new-cursor-location

mouseDn

mouseUp

STARTinitiate-move-

cursor

perceive-target

290

0

attend-target

50

initiate-POG

50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

new-cursor-location

mouseDn

mouseUp

FAST M/C


Fairfax, VA 95

BBBBuuuutttt ppppeeeeoooopppplllleeee sssseeeeeeeemmmm ttttooooiiiinnnntttteeeerrrrwwwweeeeaaaavvvveeee tttteeeemmmmppppllllaaaatttteeeessss

wwwwhhhheeeennnn tttthhhheeeeyyyy bbbbeeeeccccoooommmmeeee ssssuuuuffffffffiiiicccciiiieeeennnnttttsssskkkkiiiilllllllleeeedddd aaaatttt aaaa ttttaaaasssskkkk

STARTinitiate-move-

cursor

perceive-target

290

0

attend-target

50

initiate-POG

50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

FAST M/C

new-cursor-location

mouseDn

mouseUp

STARTinitiate-move-

cursor

perceive-target

290

0

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

new-cursor-location

mouseDn

mouseUp

FAST M/C

attend-target

50

initiate-POG

50


Fairfax, VA 96

WWWWeeee uuuusssseeeedddd ttttoooo ddddoooo iiiinnnntttteeeerrrrwwwweeeeaaaavvvviiiinnnnggggppppaaaaiiiinnnnssssttttaaaakkkkiiiinnnnggggllllyyyy bbbbyyyy hhhhaaaannnndddd iiiinnnn MMMMaaaaccccPPPPrrrroooojjjjeeeecccctttt

NNNNoooowwww AAAAppppeeeexxxx wwwwiiiillllllll ddddoooo tttthhhhiiiissss aaaauuuuttttoooommmmaaaattttiiiiccccaaaalllllllluuuussss tttthhhhrrrroooouuuugggghhhh ddddyyyynnnnaaaammmmiiiicccc rrrreeeessssoooouuuurrrrcccceeee sssscccchhhheeeedddduuuu

STARTinitiate-move-

cursor

perceive-target

290

0

attend-target

50

initiate-POG

50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

FAST M/C

new-cursor-location

mouseDn

mouseUp

STARTinitiate-move-

cursor

perceive-target

290

0

verify-target

pos

50

move-cursor

590 (FL)

POG

30

100

initiate-mouseDn

50

100

new-cursor-location

mouseDn

mouseUp

FAST M/C

attend-target

50

initiate-POG

50


Fairfax, VA 97

BBBBaaaassssiiiicccc pppprrrroooocccceeeedddduuuurrrreeee

CCCCrrrreeeeaaaatttteeee aaaa CCCCMMMMNNNN----GGGGOOOOMMMMSSSS----lllliiiikkkkeeee mmmmooooddddeeeellll tttthhhhaaaatttt bbbboooottttttttoooommmmssss oooouuuutttt ccccaaaallllllllssss ttttoooo pppprrrreeee----eeeessssttttaaaabbbblllliiiisssshhhheeeedddd tttteeeemmmmppppllllaaaatttteeeessss

AAAAlllllllloooowwww aaaallllllll pppprrrriiiimmmmiiiittttiiiivvvveeee ooooppppeeeerrrraaaattttoooorrrrssss ttttoooo ccccoooonnnntttteeeennnndddd ffffoooorrrr rrrr((((eeee....gggg....,,,, vvvviiiissssiiiioooonnnn,,,, aaaauuuuddddiiiittttiiiioooonnnn,,,, ccccooooggggnnnniiiittttiiiioooonnnn,,,, hhhhaaaannnnddddssss,,,, vvvvoooo— Apex has mechanisms to dynamically schedule resourceof which is used in CPM-GOMS models

— The CMN goal hierarchy guides Apex to assign the reto the appropriate primitives to achieve cognitivelyinterweaving

— Templates have been created for using a mouse, typinreacting to a sound or visual signal, all included templates.lisp file with the Apex system(see the Templates Manual included on the CD and on site)


Fairfax, VA 98

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS PPPPDDDDLLLL(procedure (index (edit manuscript)) (step s1 (?this-step) (select ?this-step (depends-on ’*task* ’((remembered no-op) (forgotten acqu) (step s2 (execute-unit-task) (waitfor ?s1)) (step t (terminate) (waitfor ?s1 ?s2)))

CCCCoooonnnnvvvveeeerrrrttttiiiinnnngggg CCCCMMMMNNNN----GGGGOOOOMMMMSSSS PPPPDDDDLLLL iiiinnnnttttooooCCCCPPPPMMMM----GGGGOOOOMMMMSSSS PPPPDDDDLLLL

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS PPPPDDDDLLLL ---->>>> CCCCPPPPMMMM----GGGGOOOOMMMMSSSS(procedure (index (edit manuscript)) (step s1 (?this-step) (select ?this-step (depends-on ’*task* ’((remembered no-op) (forgotten acqu) ((((rrrraaaannnnkkkk 1111)))))))) (step s2 (execute-unit-task) ((((rrrraaaannnnkkkk 2222))))) (step t (terminate) (waitfor ?s1 ?s2)))

AAAA nnnneeeewwww ccccoooonnnncccceeeepppptttt ccccaaaalllllllleeeedddd rrrraaaannnnkkkk

The rrrraaaannnnkkkk clause inin each step tellsApex how to

resolve resourceconflicts

The rrrraaaannnnkkkk clause inin each step tellsApex how to

resolve resourceconflicts

This rrrraaaannnnkkkk was a wwwwaaaaiiiittttffffoooorrrr.... There will rarelybe waitfors except in terminate steps in

CPM-GOMS models

This rrrraaaannnnkkkk was a wwwwaaaaiiiittttffffoooorrrr.... There will rarelybe waitfors except in terminate steps in

CPM-GOMS models


Fairfax, VA 99

AAAA ssssiiiimmmmpppplllliiiiffffiiiieeeedddd ssssyyyynnnnttttaaaaxxxx::::TTTThhhheeee ::::rrrraaaannnnkkkkeeeedddd ttttyyyyppppeeee ooooffff pppprrrroooocccceeeedddduuuu

CMN-GOMS(procedure :sequential (index (modify-text move-text)) (cut-text) (paste-text))

CPM-GOMS(procedure :ranked (index (modify-text move-text)) (cut-text) (paste-text))

Just change::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll to

::::rrrraaaannnnkkkkeeeedddd and Apexfills in the rest

Just change::::sssseeeeqqqquuuueeeennnnttttiiiiaaaallll to

::::rrrraaaannnnkkkkeeeedddd and Apexfills in the rest


Fairfax, VA 100

BBBBoooottttttttoooommmm oooouuuutttt iiiinnnn pppprrrreeee----eeeessssttttaaaabbbblllliiiisssshhhhtttteeeemmmmppppllllaaaatttteeee sssstttteeeeppppssss

CCCCMMMMNNNN----GGGGOOOOMMMMSSSS(procedure :sequential (index (issue-menu-command ?Menu ?Menu-item)) ((((mmmmoooovvvveeee----ccccuuuurrrrssssoooorrrr----1111111100000000 ????MMMMeeeennnnuuuu)))) ((((cccclllliiiicccckkkk----mmmmoooouuuusssseeee ????MMMMeeeennnnuuuu)))) (move-cursor-1100 ?Menu-item) (verify highlight ?Menu-item) (click-mouse ?Menu-item))

CCCCPPPPMMMM----GGGGOOOOMMMMSSSS(procedure :ranked (index (issue-menu-command ?Menu ?Menu-i ((((ffffaaaasssstttt----mmmmoooovvvveeee----cccclllliiiicccckkkk

::::ttttaaaarrrrggggeeeetttt ????MMMMeeeennnnuuuu ::::eeeeffffffffeeeecccctttteeeedddd----oooobbbbjjjjeeeecccctttt ????MMMMeeeennnnuuuu----iiiitttteeeemmmm ::::eeeeffffffffeeeecccctttt----oooonnnn----oooobbbbjjjjeeeecccctttt vvvviiiissssiiiibbbblllleeee))))

(fast-move-click :target ?Menu-item

:effected-object ?Menu-item :effect-on-object selected)

A mmmmoooovvvveeee operatorand a cccclllliiiicccckkkk operator

change to theffffaaaasssstttt----mmmmoooovvvveeee----cccclllliiiicccckkkk

operatorestablished by Grayand Boehm-Davis

A mmmmoooovvvveeee operatorand a cccclllliiiicccckkkk operator

change to theffffaaaasssstttt----mmmmoooovvvveeee----cccclllliiiicccckkkk

operatorestablished by Grayand Boehm-Davis

Parameters arepassed that relate to

the world

Parameters arepassed that relate to

the world

A change under the hoodMovement time will be

calculated with Fittss Lawinstead of CMN s estimate

A change under the hoodMovement time will be

calculated with Fittss Lawinstead of CMN s estimate


Fairfax, VA 101

RRRRuuuunnnn tttthhhheeee mmmmooooddddeeeellllCCCClllliiiicccckkkk oooonnnn tttthhhheeee PPPPEEEERRRRTTTT CCCChhhhaaaarrrrtttt bbbbuuuutttt


Fairfax, VA 102

RRRReeeemmmmeeeemmmmbbbbeeeerrrr FFFFaaaasssstttt----mmmmoooovvvveeee----cccclllliiiicccckkkk????NNNNoooowwww wwwweeee llllllll iiiimmmmpppplllleeeemmmmeeeennnntttt iiiitttt iiiinnnn PPPP

logical and resourcedependenciesSTART

initiate-move-cursor

perceive-target

290

0

50 50

verify-target

pos

50

move-cursor

590 (FL)

POG

30

mouseDn

100

initiate-mouseDn

50

mouseUp

100

new-cursor-locationworld

vision

cognition

right hand

eye move from Gray and Boehm-Davis (2000)

MHP resourcedependencies

logicaldependencies

attend-target

initiate-POG


Fairfax, VA 103

;FAST-MOVE-CLICK-R-HAND-ON-MOUSE(procedure (index (fast-move-click-R-hand-on-mouse :target ?target :effected-object ?effected-object :effect-on-object ?effect)) (step c1 (initiate-move-cursor ?target)) (step m1 (move-cursor ?target) (waitfor ?c1)) (step c2 (attend-target ?target)) (step c3 (initiate-eye-movement ?target) (waitfor ?c2)) (step m2 (eye-movement ?target) (waitfor ?c3)) (step p1 (perceive-target-complex ?target) (waitfor ?m2 (variable ?target visible)))

(step c4 (verify-target-position ?target) (waitfor ?c3 ?p1)) (step c5 (initiate-click ?target) (waitfor ?c4 ?m1)) (step m3 (mouse-down ?target) (waitfor ?m1 ?c5)) (step m4 (mouse-up ?target) (waitfor ?m3)) (step t (terminate) (waitfor ?m4 ?rvr1 ?rvr2)))

UUUUnnnnddddeeeerrrr tttthhhheeee hhhhooooooooddddAAAA qqqquuuuiiiicccckkkk ppppeeeeaaaakkkk aaaatttt aaaa tttteeeemmmmppppllllaaaatttt

Steps are either cognitive,perceptual, or motor

Labeled cccc, pppp, or mmmm for convenience

Steps are either cognitive,perceptual, or motor

Labeled cccc, pppp, or mmmm for convenience

A wwwwaaaaiiiittttffffoooorrrr encodes thelogical dependencies seen

in the PERT chart(resource dependencies

are emergent)

A wwwwaaaaiiiittttffffoooorrrr encodes thelogical dependencies seen

in the PERT chart(resource dependencies

are emergent)

A step can wwwwaaaaiiiittttffffoooorrrr anoccurrence in the world

A step can wwwwaaaaiiiittttffffoooorrrr anoccurrence in the world


Fairfax, VA 104




(step w1 (WORLD 0 ?target fixated-upon) (waitfor ?p1))

(step w2 (WORLD 0 ?effected-object ?effect) (waitfor ?m3))

WWWWoooorrrrlllldddd steps set anattribute in the *varlist*to a value (and can tak

time to do so)

WWWWoooorrrrlllldddd steps set anattribute in the *varlist*to a value (and can take

time to do so)


Fairfax, VA 105

(step hvr1 (hold-resource right-hand-block :ancestor 1) (waitfor ?c1))

(step hvr2 (hold-resource vision-block :ancestor 1) (waitfor ?c2))

(step rvr2 (release-resource vision-block :ancestor 1) (waitfor ?p1))

(step rvr1 (release-resource right-hand-block :ancestor 1) (waitfor ?m4))



(step w1 (WORLD 0 ?target fixated-upon) (waitfor ?p1))

(step w2 (WORLD 0 ?effected-object ?effect) (waitfor ?m3))


Virtual resources encode theintention to use a resource la

in the template

Virtual resources encode theintention to use a resource la

in the template

RRRReeeemmmmeeeemmmmbbbbeeeerrrr,,,, oooouuuurrrr iiiinnnntttteeeennnnttttiiiioooonnnn iiiiaaaannnnaaaallllyyyyssssttttssss nnnneeeevvvveeeerrrr hhhhaaaavvvveeee ttttoooo

uuuunnnnddddeeeerrrr tttthhhheeee hhhhoooooooodddd!!!!


Fairfax, VA 106

TTTThhhheeee CCCCPPPPMMMM----GGGGOOOOMMMMSSSS mmmmooooddddeeeellllsssswwwweeee rrrreeee pppprrrroooovvvviiiiddddiiiinnnngggg

FFFFooooxxxx----CCCCPPPPMMMM— Follows this tutorial and the John (in preparation) chapter provided on the CD and at the ftp site

AAAATTTTMMMM----CCCCPPPPMMMM----wwwwoooorrrrlllldddd— The models discussed in our recent CHI paper(John, et. al. 2002), also provided

CCCCAAAADDDD----wwwwoooorrrrlllldddd ((((tttthhhhiiiissss iiiissss ccccoooooooollll,,,, cccchhhheeeecccckkkk iiiitttt oooouuuutttt))))— A model of drawing an L-shape in a CAD system (BaskJohn, 1998)

— This contains both mousing templates and typing

— The template-level PDL code for typing¥ Is simply (type-string any string you want)

¥ Is automatically generated with lisp code under the ho

¥ Implements TYPIST (John, 1996)


Fairfax, VA 107

DDDDoooo CCCCPPPPMMMM----GGGGOOOOMMMMSSSS mmmmooooddddeeeellllssss bbbbuuuuiiiilllltttt wwwwiiiittttAAAAppppeeeexxxx mmmmaaaattttcccchhhh hhhhuuuummmmaaaannnn ppppeeeerrrrffffoooorrrrmmmmaaaannnncccceeeeFFFFooooxxxx----CCCCPPPPMMMM

— We have no data yet

AAAATTTTMMMM----CCCCPPPPMMMM----wwwwoooorrrrlllldddd— Match to data reported in our recent CHI paper (see

CCCCAAAADDDD----wwwwoooorrrrlllldddd— Model matches the data in of Baskin & John (1998) asthe hand-done CPM-GOMS models did

— Makes predictions of errors, which have been observeanalysis of Baskin & John data, still in progress)

TTTTYYYYPPPPIIIISSSSTTTT— Automatically-generated template-level PDL implementtheory that matched many experiments in transcriptio(but individual experiments not modeled yet)


Fairfax, VA 108

HHHHuuuummmmaaaannnn----mmmmooooddddeeeellll ccccoooommmmppppaaaarrrriiiissssoooonnnnssss

0

200

400

600

800

1000

1200

1400

No-Interleaving Model

CPM-GOMS Model

Mean for Subjects

Fitts's Law


Fairfax, VA 109

SSSSuuuummmmmmmmaaaarrrryyyy ooooffff GGGGOOOOMMMMSSSS iiiinnnn AAAAppppeeeexxxx

MMMMaaaaiiiinnnn ppppooooiiiinnnnttttssss ttttoooo rrrreeeemmmmeeeemmmmbbbbeeeerrrr—Apex can express three common versions of Gusing PDL: KLM, CMN-GOMS and CPM-GOMS

—Apex can generate CPM-GOMS modelsaaaauuuuttttoooommmmaaaattttiiiiccccaaaallllllllyyyy from PDL that bottoms out in established templates

—Cognitively plausible, reusable templates aprovided for constructing CPM-GOMs models

—So far, the CPM-GOMS models built in Apex mhuman data as well as the same modelsconstructed by hand


Fairfax, VA 110

KKKKnnnnoooowwwwnnnn bbbbuuuuggggssss

SSSSeeeelllleeeecccctttt ccccllllaaaauuuusssseeeessss iiiinnnn aaaannnn iiiinnnntttteeeerrrraaaaccccttttiiiivvvveeee wwwwoooorrrrlllldddd ((((ddddiiiissssccccoooovvvvllllaaaasssstttt wwwweeeeeeeekkkk))))— Select clauses are giving odd behavior when they muglobal variables that change during task execution

— The templates in the templates.lisp file work for Aand fox-worlds, but may display this odd behavior inmodels

— We have worked around this problem in the CAD-world the CD (if you really want to know how, ask Bonnie JMike Matessa off line)

PPPPEEEERRRRTTTT cccchhhhaaaarrrrtttt— Dependency lines are not drawn completely correctlydependency lines from world events and sometimes actemplates

MMMMuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg UUUUnnnnddddeeeerrrr TTTTiiiimmmmeeee----PPPPrrrreeeessssssssuuuurrrrUUUUnnnncccceeeerrrrttttaaaaiiiinnnnttttyyyy

MMMMuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg UUUUnnnnddddeeeerrrr TTTTiiiimmmmeeee----PPPPrrrreeeessssssssuuuurrrrUUUUnnnncccceeeerrrrttttaaaaiiiinnnnttttyyyy


Fairfax, VA 112

MMMMuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg sssskkkkiiiillllllll

DDDDeeeellllaaaayyyy aaaannnnsssswwwweeeerrrriiiinnnngggg pppphhhhoooonnnneeee uuuunnnnttttiiiillll ffffiiiinnnniiiisssshhhheeeedddd ttttyyyyppppiiiinnnngggg sssseeeennnn

hhhheeeeuuuurrrriiiissssttttiiiicccc:::: prefer to delay interrupt until good st

PPPPuuuullllllll oooovvvveeeerrrr ttttoooo ssssiiiiddddeeee ooooffff rrrrooooaaaadddd bbbbeeeeffffoooorrrreeee ssssttttuuuuddddyyyyiiiinnnngggg mmmmaaaapppp

DDDDrrrriiiivvvveeee bbbbaaaacccckkkk oooonnnnttttoooo rrrrooooaaaadddd ((((bbbbuuuutttt ddddoooonnnntttt ddddrrrriiiivvvveeee ttttoooo ssssttttaaaarrrrtttt ppppooooiiiinnnntttt))))

DDDDoooo ssssoooommmmeeeetttthhhhiiiinnnngggg uuuusssseeeeffffuuuullll wwwwhhhheeeennnn ssssttttooooppppppppeeeedddd aaaatttt aaaa rrrreeeedddd lllliiiigggghhhhtttt

Multitasking can be viewed as skilled behavior for managing taskbased on learned ttttaaaaccccttttiiiiccccssss — domain-dependent applications of general heu


Fairfax, VA 113

CCCChhhhaaaalllllllleeeennnnggggeeee

CCCCrrrreeeeaaaatttteeee aaaaggggeeeennnnttttssss wwwwiiiitttthhhh hhhhuuuummmmaaaannnn----lllleeeevvvveeeellll aaaabbbbiiiilllliiiittttyyyy ttttoooo eeeemmmmppppllllooooddddiiiivvvveeeerrrrsssseeee mmmmuuuullllttttiiiittttaaaasssskkkk mmmmaaaannnnaaaaggggeeeemmmmeeeennnntttt ttttaaaaccccttttiiiiccccssss

¥ GGGGeeeennnneeeerrrraaaallll hhhheeeeuuuurrrriiiissssttttiiiiccccssss uuuunnnnddddeeeerrrrllllyyyyiiiinnnngggg ttttaaaaccccttttiiiiccccssssaaaarrrrcccchhhhiiiitttteeeeccccttttuuuurrrreeee mmmmeeeecccchhhhaaaannnniiiissssmmmmssss

¥ TTTTaaaasssskkkk----ssssppppeeeecccciiiiffffiiiicccc kkkknnnnoooowwwwlllleeeeddddggggeeeessssppppeeeecccciiiiaaaalllliiiizzzzeeeedddd rrrreeeepppprrrreeeesssseeeennnnttttaaaattttiiiioooonnnn eeeelllleeeemmmmeeeennnnttttssssttttaaaasssskkkk rrrreeeepppprrrreeeesssseeeennnnttttaaaattttiiiioooonnnn mmmmeeeetttthhhhooooddddoooollllooooggggyyyy


Fairfax, VA 114

Human-level competencein aviation tasks

Interface evaluation based on CPM-GOMS

Autonomous robots

Apex projects: all involve multi


Fairfax, VA 115


Fairfax, VA 116

AAAAccccttttiiiioooonnnn sssseeeelllleeeeccccttttiiiioooonnnn aaaarrrrcccchhhhiiiitttteeeeccccttttrrrreeeeqqqquuuuiiiirrrreeeemmmmeeeennnnttttssss

CCCCooooppppeeee wwwwiiiitttthhhh ttttiiiimmmmeeee----pppprrrreeeessssssssuuuurrrreeee— Cant deliberate endlessly

CCCCooooppppeeee wwwwiiiitttthhhh uuuunnnncccceeeerrrrttttaaaaiiiinnnnttttyyyy— Cant completely know or predict world state

— Actions may fail or produce undesirable side-effects

— Preconditions may become unsatisfied

— Resource requirements may change during execution

— New, urgent tasks can arise at any time

MMMMaaaannnnyyyy ddddoooommmmaaaaiiiinnnnssss ooooffff pppprrrraaaaccccttttiiiiccccaaaallll iiiinnnntttteeeerrrreeeesssstttt aaaarrrreeee ddddeeeemmmmaaaannnnddddiiiinnnntttthhhheeee sssseeeennnnsssseeee tttthhhhaaaatttt aaaa sssskkkkiiiilllllllleeeedddd aaaaggggeeeennnntttt mmmmuuuusssstttt ::::


Fairfax, VA 117

TTTTwwwwoooo aaaapppppppprrrrooooaaaacccchhhheeeessss tttthhhhaaaatttt ddddoooonnnntttt wwwwoooorrrrkkkk

CCCCllllaaaassssssssiiiiccccaaaallll ppppllllaaaannnnnnnneeeerrrrssss- input: current world state, goal state- output: detailed action sequence to achieve goal state- can find solutions to hard problems

CCCCllllaaaassssssssiiiiccccaaaallll sssscccchhhheeeedddduuuulllleeeerrrrssss- input: set of actions to do and constraints on order/timing- output: schedule specifying when to do each action- can seek optimal solutions

PPPPrrrroooobbbblllleeeemmmmssss:::: ((((1111)))) sssslllloooowwww;;;; ((((2222)))) iiiinnnnttttoooolllleeeerrrraaaannnntttt ooooffff uuuunnnncccceeeerrrrttttaaaaiiiinnnnttttyyyy


Fairfax, VA 118

RRRReeeeaaaaccccttttiiiivvvveeee PPPPllllaaaannnnnnnneeeerrrrssss

CCCCooooppppiiiinnnngggg wwwwiiiitttthhhh ttttiiiimmmmeeee----pppprrrreeeessssssssuuuurrrreeee— Stored plan library

— Heuristic or single-rule plan refinement

CCCCooooppppiiiinnnngggg wwwwiiiitttthhhh uuuunnnncccceeeerrrrttttaaaaiiiinnnnttttyyyy— Action decisions deferred until just before execution

— Integrated contingency handling

bbbbuuuutttt nnnnooootttt vvvveeeerrrryyyy ggggoooooooodddd aaaatttt ddddiiiissssccccoooovvvveeeerrrriiiinnnngggg ooooppppttttiiiimmmmaaaallll ssssoooolllluuuuttttiiiioooonnnnssss oooorrrrssssoooollllvvvviiiinnnngggg hhhhaaaarrrrdddd,,,, nnnnoooovvvveeeellll pppprrrroooobbbblllleeeemmmmssss


Fairfax, VA 119

(procedure (index (hold-altitude using mcp)) (profile right-hand) (step s1 (clear right-hand)) (step s2 (find-loc alt-hold-button => ?loc)) (step s3 (press-button ?loc right-hand) (waitfor (empty right-hand) (location alt-hold-button ?loc))) (step end (terminate) (waitfor (illuminated alt-hold-button)) (step aux1 (restart ?self) (waitfor (resumed ?self))))

PPPPrrrroooocccceeeedddduuuurrrreeee DDDDeeeessssccccrrrriiiippppttttiiiioooonnnn LLLLaaaannnngggguuuuaaaa((((PPPPDDDDLLLL))))

¥ concurrency¥ reactivity¥ hierarchy¥ contingency-handl


Fairfax, VA 120

MMMMuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg iiiinnnn AAAAppppeeeexxxx

CCCCoooonnnnccccuuuurrrrrrrreeeennnnccccyyyy ccccoooonnnnttttrrrroooollll

RRRRaaaattttiiiioooonnnnaaaallll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppttttiiiioooonnnn

GGGGrrrraaaacccceeeeffffuuuullll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppttttiiiioooonnnn

EEEEffffffffiiiicccciiiieeeennnntttt uuuusssseeee ooooffff rrrreeeessssoooouuuurrrrcccceeeessss


Fairfax, VA 121

CCCCoooonnnnccccuuuurrrrrrrreeeennnnccccyyyy CCCCoooonnnnttttrrrroooollll::::PPPPDDDDLLLL iiiiddddiiiioooommmmssss

Converge

(procedure (index (do-it)) (step s1 (do-A) (step s2 (do-B) (step s3 (do-C) (waitfor ?s1 ?s2) (step s4 (terminate) (waitfor ?s3)))

Race

(procedure (index (do-it)) (step s1 (do-A) (step s2 (do-B) (step s3 (do-C) (waitfor ?s1) (waitfor ?s2)) (step s4 (terminate) (waitfor ?s3)))

Synchronize

(procedure (index (do-it)) (step s1 (do-A)) (step s2 (do-B) (waitfor (started ?s1))) (step s3 (terminate) (waitfor ?s1 ?s2)))


Fairfax, VA 122

PPPPrrrrooooffffiiiilllleeee ccccllllaaaauuuusssseeee ddddeeeeccccllllaaaarrrreeeessss rrrreeeessssoooouuuurrrrcccceeee rrrreeeeqqqquuuuiiiirrrreeeemmmmeeeennnnttttssss

((((pppprrrrooooffffiiiilllleeee ((((<<<<rrrreeeessssoooouuuurrrrcccceeee>>>> [[[[ttttoooolllleeeerrrraaaannnncccceeee]]]])))) ))))

SSSSoooommmmeeee ttttaaaasssskkkkssss ttttoooolllleeeerrrraaaatttteeee bbbbrrrriiiieeeeffff iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnnssss

CCCCoooonnnnfffflllliiiicccctttt eeeexxxxiiiissssttttssss bbbbeeeettttwwwweeeeeeeennnn ttttaaaasssskkkkssss AAAA aaaannnndddd BBBB iiiiffff— AAAA aaaannnndddd BBBB bbbbooootttthhhh rrrreeeeqqqquuuuiiiirrrreeee rrrreeeessssoooouuuurrrrcccceeee RRRR,,,, aaaannnndddd

— EEEExxxxppppeeeecccctttteeeedddd DDDDuuuurrrraaaattttiiiioooonnnn ((((AAAA)))) >>>> TTTToooolllleeeerrrraaaannnncccceeee ((((BBBB))))

oooorrrr EEEExxxxppppeeeecccctttteeeedddd DDDDuuuurrrraaaattttiiiioooonnnn ((((BBBB)))) >>>> TTTToooolllleeeerrrraaaannnncccceeee ((((AAAA))))

RRRRaaaattttiiiioooonnnnaaaallll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmDDDDeeeetttteeeerrrrmmmmiiiinnnniiiinnnngggg iiiiffff ttttaaaasssskkkkssss ccccoooonnnnfffflllliiii


Fairfax, VA 123

CCCCoooommmmppppuuuutttteeee pppprrrriiiioooorrrriiiittttyyyy bbbbaaaasssseeeedddd oooonnnn ttttaaaasssskkkk &&&& ssssiiiittttuuuuaaaattttiiiioooonnnnaaaallll ffffaaaacccc— urgency (U): measure of time until deadline

— importance (I): cost of missing deadline (time cost)

— subjective workload (S): measure of task crowding

UUUUrrrrggggeeeennnnccccyyyy ddddoooommmmiiiinnnnaaaatttteeeessss iiiiffff ttttiiiimmmmeeee eeeennnnoooouuuugggghhhh ttttoooo ddddoooo eeeevvvveeeerrrryyyytttthhhhiiiinnnn

IIIImmmmppppoooorrrrttttaaaannnncccceeee ddddoooommmmiiiinnnnaaaatttteeeessss iiiiffff ssssoooommmmeeee ddddeeeeaaaaddddlllliiiinnnneeeessss ccccaaaannnnnnnnooootttt bbbbeeeemmmmeeeetttt

RRRRaaaattttiiiioooonnnnaaaallll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppRRRReeeessssoooollllvvvviiiinnnngggg ttttaaaasssskkkk ccccoooonnnnfffflllliiiiccccttttssss


Fairfax, VA 124

SSSSiiiimmmmpppplllleeee PPPPrrrriiiioooorrrriiiittttyyyy ==== SSSS****IIII ++++ ((((SSSSmmmmaaaaxxxx ---- SSSS))))****UUUU— Highest priority task gets resources

— Other tasks aborted or delayed

PPPPrrrriiiioooorrrriiiittttyyyy vvvvaaaalllluuuueeeessss sssseeeetttt wwwwiiiitttthhhh pppprrrriiiioooorrrriiiittttyyyy ccccllllaaaauuuusssseeee— (priority <urgency> <importance>)

RRRRaaaattttiiiioooonnnnaaaallll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppRRRReeeessssoooollllvvvviiiinnnngggg ttttaaaasssskkkk ccccoooonnnnfffflllliiiiccccttttssss


Fairfax, VA 125

IIIInnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn ttttoooolllleeeerrrraaaannnncccceeee

IIIInnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn ssssuuuupppppppprrrreeeessssssssiiiioooonnnn— ((((iiiinnnntttteeeerrrrrrrruuuupppptttt----ccccoooosssstttt <<<<ccccoooosssstttt>>>>))))

TTTTrrrraaaannnnssssiiiittttiiiioooonnnn bbbbeeeehhhhaaaavvvviiiioooorrrrssss— Interrupt-time, suspension-time, resume-time

— Illustrates contingency-handling

GGGGrrrraaaacccceeeeffffuuuullll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppCCCCaaaappppaaaabbbbiiiilllliiiittttiiiieeeessss


Fairfax, VA 126

GGGGrrrraaaacccceeeeffffuuuullll iiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn aaaannnndddd rrrreeeessssuuuummmmppppPPPPDDDDLLLL iiiiddddiiiioooommmmssss ffffoooorrrr ttttrrrraaaannnnssssiiiittttiiiioooonnnn bbbbeeeehhhhaaaavvvv

(procedure (index (fly-cruise-leg using manual-control)) (step s1 (maintain-altitude) (interrupt-cost 5))

... (step s12 (handoff-to-pilot-not-flying) (priority (importance 10) (urgency 10))) (waitfor (interrupted ?self))) (step s13 (monitor-pilot-not-flying) (waitfor (completed ?s12))) (step s14 (request-role-pilot-flying) (waitfor (resumed ?self))) ...)


Fairfax, VA 127

CCCCoooommmmbbbbiiiinnnneeee rrrreeeedddduuuunnnnddddaaaannnntttt ttttaaaasssskkkkssss— ((((mmmmeeeerrrrggggeeee <<<<ccccoooonnnnddddiiiittttiiiioooonnnn>>>> [[[[<<<<ttttaaaasssskkkk ppppaaaatttttttteeeerrrrnnnn>>>>]]]]))))

OOOOnnnnlllliiiinnnneeee sssscccchhhheeeedddduuuulllliiiinnnngggg ttttoooo eeeexxxxppppllllooooiiiitttt ssssllllaaaacccckkkk— Using slack time a scheduling problem

— Apex scheduling mechanisms

¥ Concurrent recursive decomposition => tasks

¥ Priority-based allocation => schedule

— Non-deliberative use of scheduler unusual!

EEEEffffffffiiiicccciiiieeeennnntttt uuuusssseeee ooooffff rrrreeeessssoooouuuurrrrcccceeee


Fairfax, VA 128

AAAApppppppplllliiiiccccaaaattttiiiioooonnnn----ddddrrrriiiivvvveeeennnn llllaaaannnngggguuuuaaaaggggeeee ddddeeeevvvveeee

NNNNeeeewwww ssssyyyynnnnttttaaaaxxxx ttttoooo ssssiiiimmmmpppplllliiiiffffyyyy////aaaabbbbbbbbrrrreeeevvvviiiiaaaatttteeee ccccoooommmmmmmmoooonnnn ppppaaaatttttttteeeerrrr

eeee....gggg.... sssseeeeqqqquuuueeeennnnttttiiiiaaaallll pppprrrroooocccceeeedddduuuurrrreeeessss

DDDDeeeeffffaaaauuuulllltttt bbbbeeeehhhhaaaavvvviiiioooorrrrssss ttttoooo aaaavvvvooooiiiidddd ppppaaaatttthhhhoooollllooooggggiiiiccccaaaallll bbbbeeeehhhhaaaavvvviiiioooo

eeee....gggg.... wwwweeeeaaaakkkk ppppeeeerrrrssssiiiisssstttteeeennnncccceeee tttteeeennnnddddeeeennnnccccyyyy

NNNNeeeewwww aaaarrrrcccchhhhiiiitttteeeeccccttttuuuurrrreeee ffffuuuunnnnccccttttiiiioooonnnnaaaalllliiiittttyyyy aaaannnndddd PPPPDDDDLLLL ccccoooonnnnssssttttrrrruuuuccccaaaacccccccceeeessssssss iiiitttt wwwwhhhheeeennnn nnnneeeeeeeeddddeeeedddd bbbbeeeehhhhaaaavvvviiiioooorrrr ddddiiiiffffffffiiiiccccuuuulllltttt ttttoooo rrrreeee

eeee....gggg.... rrrraaaannnnkkkk iiiinnnnsssstttteeeeaaaadddd ooooffff pppprrrriiiioooorrrriiiittttyyyy

DDDDooooccccuuuummmmeeeennnntttt nnnneeeewwww iiiiddddiiiioooommmmssss aaaassss iiiinnnnvvvveeeennnntttteeeedddd

TTTThhhheeeerrrreeee iiiissss nnnnoooo ccccoooommmmmmmmiiiittttmmmmeeeennnntttt ttttoooo kkkkeeeeeeeepppp tttthhhheeee llllaaaannnngggguuuuaaaaggggeeee aaaassss----iiiisssseeeevvvvoooollllvvvviiiinnnngggg aaaassss AAAAppppeeeexxxx mmmmooooddddeeeelllleeeerrrrssss nnnneeeeeeeeddddssss bbbbeeeeccccoooommmmeeee bbbbeeeetttttttteeeerrrr uuuunnnn


Fairfax, VA 129

SSSSuuuummmmmmmmaaaarrrryyyy

MMMMuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg aaaabbbbiiiilllliiiittttyyyy ffffoooouuuunnnnddddeeeedddd oooonnnn ttttaaaaccccttttiiiiccccaaaallll kkkknnnnoooowwwwlllleeeeddddeeeerrrriiiivvvveeeedddd ffffrrrroooommmm ggggeeeennnneeeerrrraaaallll hhhheeeeuuuurrrriiiissssttttiiiiccccssss

RRRReeeeaaaaccccttttiiiivvvveeee ppppllllaaaannnnnnnneeeerrrrssss ccccaaaannnn bbbbeeee eeeexxxxtttteeeennnnddddeeeedddd ttttoooo eeeexxxxeeeeccccuuuutttteeee tttthhhhhhhheeeeuuuurrrriiiissssttttiiiiccccssss iiiinnnn uuuunnnncccceeeerrrrttttaaaaiiiinnnn////ttttiiiimmmmeeee----pppprrrreeeessssssssuuuurrrreeeedddd eeeennnnvvvviiiirrrroooo

SSSSppppeeeecccciiiiffffiiiiccccaaaallllllllyyyy,,,, eeeexxxxtttteeeennnnssssiiiioooonnnnssss ffffoooorrrr ccccoooonnnnccccuuuurrrrrrrreeeennnnccccyyyy ccccoooonnnnttttrrrrooooiiiinnnntttteeeerrrrrrrruuuuppppttttiiiioooonnnn hhhhaaaannnnddddlllliiiinnnngggg aaaannnndddd rrrreeeessssoooouuuurrrrcccceeee mmmmaaaannnnaaaaggggeeeemmmmeeeennnnttttffffaaaacccciiiilllliiiittttaaaatttteeee uuuusssseeee ooooffff mmmmuuuullllttttiiiittttaaaasssskkkkiiiinnnngggg ttttaaaaccccttttiiiiccccssss

UUUUnnnnddddeeeerrrrssssttttaaaannnnddddiiiinnnngggg ooooffff wwwwhhhhaaaatttt nnnneeeeeeeeddddssss ttttoooo bbbbeeee rrrreeeepppprrrreeeesssseeeennnntttteeeedddd aannnnoooottttaaaattttiiiioooonnnn iiiissss bbbbeeeesssstttt ffffoooorrrr tttthhhhiiiissss ppppuuuurrrrppppoooosssseeee aaaarrrreeee iiiimmmmpppprrrroooovvvviiiiAAAAppppeeeexxxx aaaapppppppplllliiiiccccaaaattttiiiioooonnnnssss aaaarrrreeee ddddeeeevvvveeeellllooooppppeeeedddd


Fairfax, VA 130

WWWWrrrraaaapppp----uuuuppppWWWWrrrraaaapppp----uuuupppp


Fairfax, VA 131

CCCCDDDD RRRROOOOMMMM

TTTThhhheeee CCCCDDDD RRRROOOOMMMM ccccoooonnnnttttaaaaiiiinnnnssss AAAAppppeeeexxxx 2222....2222bbbb4444 pppplllluuuussss aaaaddddddddiiiittttiiiioooonnnnaaaallllssssiiiimmmmwwwwoooorrrrllllddddssss,,,, ddddooooccccuuuummmmeeeennnnttttaaaattttiiiioooonnnn,,,, aaaannnndddd ppppaaaappppeeeerrrrssss— Folder "StudentModels" in "Apex Worlds" folder contain modelsfrom Bonnie John’s class that have not all been tested wiversion of Apex

— To run the student models you must modify the allworlds.lisp file byeliminating the commenting semicolons before the world yoto run

— The "kitchen world" world was developed for an earlier veApex and only partly runs, but it does show a more complesimworld

— "Apex reference manual" documents the system

— Documentation of Apex Builder and papers are in the "Apexfolder


Fairfax, VA 132

EEEExxxxtttteeeennnnssssiiiioooonnnnssss ffffoooollllddddeeeerrrr

TTTThhhheeee eeeexxxxtttteeeennnnssssiiiioooonnnnssss ffffoooollllddddeeeerrrr iiiinnnn yyyyoooouuuurrrr AAAAppppeeeexxxx ddddiiiirrrreeeeccccttttoooorrrryyyy iiiittttoooo bbbbeeee uuuusssseeeedddd ffffoooorrrr ccccooooddddeeee tttthhhhaaaatttt aaaadddddddd ttttoooo tttthhhheeee ssssyyyysssstttteeeemmmm oooorrrrmmmmooooddddiiiiffffiiiiccccaaaattttiiiioooonnnnssss yyyyoooouuuu mmmmaaaakkkkeeee ttttoooo eeeexxxxiiiissssttttiiiinnnngggg ffffuuuunnnnccccttttiiiioooonnnnssss— Is read last so functions you write will overwrite existi

— If you write code you think will enhance the system let uwe will look into incorporating it


Fairfax, VA 133

WWWWeeeebbbbssssiiiitttteeee

ffffttttpppp::::////////eeeeoooossss....aaaarrrrcccc....nnnnaaaassssaaaa....ggggoooovvvv////oooouuuuttttggggooooiiiinnnngggg////aaaappppeeeexxxx////aaaappppeeeexxxx— Latest versions of Apex (Apex 2.2b4)

— Macintosh and PC

— Some of the worlds

— Documentation

— Instructions on downloading and running

— Patches

— We are trying to update it regularly to keep it cur


Fairfax, VA 134

HHHHuuuummmmaaaannnn////MMMMooooddddeeeellll CCCCoooommmmppppaaaarrrriiiissssoooonnnnssss::::CCCCPPPPMMMM----GGGGOOOOMMMMSSSS mmmmooooddddeeeellll bbbbuuuuiiiilllltttt wwwwiiiitttthhhh AAAApppp

0

200

400

600

800

1000

1200

1400C

ard

Slo

t 4 9 0 1

OK

With

dra

w

Che

ckin

g 8 0

Co

rre

ct

Cas

h S

lot

No

Car

d S

lot

Cas

h S

lot

Tim

e (m

s)

No-Interleaving ModeFitts’s LawCPM-GOMS ModelS1- Mean for Trials S2- Mean for Trials

TTTTiiiimmmmeeee ((((mmmmssss))))

CCCCaaaarrrrdddd SSSSllllooootttt

4444 9999 0000 1111

OOOO KKKK

WWWWiiiitttthhhhddddrrrraaaawwww

CCCChhhheeeecccckkkkiiiinnnngggg

8888 0000

CCCCoooorrrrrrrreeeecccctttt

CCCCaaaasssshhhh SSSSllllooootttt

NNNNoooo




Fairfax, VA 135

HHHHuuuummmmaaaannnn////MMMMooooddddeeeellll CCCCoooommmmppppaaaarrrriiiissssoooonnnnssss::::NNNNoooo IIIInnnntttteeeerrrrwwwweeeeaaaavvvviiiinnnngggg

0

200

400

600

800

1000

1200

1400

Fitts’s LawNo-Interleaving ModeCPM-GOMS ModelS1- Mean for Trials S2- Mean for Trials



4444 9999 0000 1111

OOOO KKKK



8888 0000



NNNNoooo




Fairfax, VA 136

HHHHuuuummmmaaaannnn////MMMMooooddddeeeellll CCCCoooommmmppppaaaarrrriiiissssoooonnnnssss::::FFFFiiiittttttttssss ssss LLLLaaaawwww oooonnnnllllyyyy

0

200

400

600

800

1000

1200

1400

Fitts’s LawNo-Interleaving ModeCPM-GOMS ModelS1- Mean for Trials S2- Mean for Trials



4444 9999 0000 1111

OOOO KKKK



8888 0000



NNNNoooo



Date post:	24-Oct-2014
Category:	Documents
Upload:	hoa-phuong
View:	22 times
Download:	1 times

cogsci-tutorial02

Documents