Moduleoverview
[3.1&3.2]EvaluationofinteractionwithAI
Overview
Task-orientedevaluation
Abilitybasedevaluation
UserExperience,ValuesandAI
[3.3&3.4]Human- AIpartnership
Human-robotteams
TaskdistributionbetweenhumansandAI
Levelsofautomation
Human-in-the-loopandsituationawareness
[3.5&3.6]Lessonslearnedfromstudiesofhuman– AIinteractionPersonalityofrobotsandtrust
Empathywithalgorithms
Evaluationinthelaband"inthewild"
Evaluationinindustrycontext
[3.7&3.8]Writingworkshop
[3.3&3.4]Human- AIpartnership
• Human-robotteams• TaskdistributionbetweenhumansandAI• Levelsofautomation• Human-in-the-loopandsituationawareness
• SometasksincludinganexamplefromtheAirTrafficManagement• Assignments
What isAI?
Artificialintelligence(AI)systemsaresoftware(andpossiblyalsohardware)systemsdesignedbyhumansthat,givenacomplexgoal,actinthephysicalordigitaldimensionbyperceivingtheirenvironmentthroughdataacquisition,interpretingthecollectedstructuredorunstructureddata,reasoningontheknowledge,orprocessingtheinformation,derivedfromthisdataanddecidingthebestaction(s)totaketoachievethegivengoal.Asascientificdiscipline,AIincludesseveralapproachesandtechniques,suchasmachinelearning(ofwhichdeeplearningandreinforcementlearningarespecificexamples),machinereasoning(whichincludesplanning,scheduling,knowledgerepresentationandreasoning,search,andoptimization),androbotics(whichincludescontrol,perception,sensorsandactuators,aswellastheintegrationofallothertechniquesintocyber-physicalsystems)
HIGH-LEVELEXPERTGROUPONARTIFICIALINTELLIGENCE,EUCommissionhttps://ec.europa.eu/digital-single-market/en/news/definition-artificial-intelligence-main-capabilities-and-scientific-disciplines
Bigquestion– 5minutes
• WhichtasksdoYOUthinkcouldbedonebyAI?• WhichtasksdoYOUthinkshouldnotbedonebyAI?
• Discussioninthegroups
Robotsrole:designandfosteringtrust(Philipsatal.2016)
6
• Arobotisateammemberinsteadofatool• Peoplesmentalmodelsofrobotsdoesn'tfitrealityleadingtodistrustordiscountingusingtheautomatedsystems
Robotsrole:designandfosteringtrust(Philipsatal.2016)
7
• Replacephysicalcapabilities• BigDogrobot
• Multiplyphysicalcapabilities• Industrialrobot
• Augment/ExtendphysicalCapabilities• AMAROB'sfriendrobot
SINTEFs friendly robot
• https://www.sintef.no/en/latest-news/a-friendly-robot/• https://www.youtube.com/watch?v=sUp3EL-8xgE&feature=youtu.be
Robotsrole:designandfosteringtrust(Philipsatal.2016)
9
• Providecomfort• Parorobot
• Inform/Augmentemotionalcapabilities• NAOrobot,Romibo robot• Teachingsocialskills,• Therapeutichorseriding(autism)
Paro helping elderly
https://www.bing.com/videos/search?q=paro+robot+elderly&view=detail&mid=6DDD0D7EE6BD0D7D01D36DDD0D7EE6BD0D7D01D3&FORM=VIRE
Chatbotasafriend
https://gemini.no/2019/10/kan-man-bli-venn-eller-kjaereste-med-en-chatbot/
Robotsrole:designandfosteringtrust(Philipsatal.2016)
12
• Multiplycognitivecapabilities• Additionalsensoryinformation
• Extendcognitivecapabilities• robotshelpinginnucleardisaster
• Human-dogsnarcoticssearchteam• reciprocalinterdependencies:handlerprovidessearchguidelines,dogprovidessensory
alerts,teamprovideslocationofnarcotics
What isAI?
Artificialintelligence(AI)systemsaresoftware(andpossiblyalsohardware)systemsdesignedbyhumansthat,givenacomplexgoal,actinthephysicalordigitaldimensionbyperceivingtheirenvironmentthroughdataacquisition,interpretingthecollectedstructuredorunstructureddata,reasoningontheknowledge,orprocessingtheinformation,derivedfromthisdataanddecidingthebestaction(s)totaketoachievethegivengoal.Asascientificdiscipline,AIincludesseveralapproachesandtechniques,suchasmachinelearning(ofwhichdeeplearningandreinforcementlearningarespecificexamples),machinereasoning(whichincludesplanning,scheduling,knowledgerepresentationandreasoning,search,andoptimization),androbotics(whichincludescontrol,perception,sensorsandactuators,aswellastheintegrationofallothertechniquesintocyber-physicalsystems)
HIGH-LEVELEXPERTGROUPONARTIFICIALINTELLIGENCE,EUCommission
14
Decisionmakingincomplextime-criticaldomains
Steag
Decisionsupportsystemisasystemsupportingdecision-makingactivities.
Typeofproblemswheredecisionsupportsystemscanbeusefulandwaysforinvolvinghumans
15
• Combinatorialproblems;largesearchspace– humanscanhelppruningadecisiontree• Computationallyintensiveproblems;humanscanguidecomputationandweightcost/benefitsoffurthercomputations• Heuristic-heavyproblems;humanshelpselectingheuristics• Visualproblems;abstractproblemsthatmightberepresentedvisually:imageclassification,geographicalclustering;visualpresentationhelphumans(hold-on,freeze)
Malasky,J.S,HumanMachineCollaborativeDecisionMakinginaComplexOptimizationSystem,MIT,2003
What isthe problem?
…anAmericanAirlinesflightcrashedinthemountainsofColombiain1996killingallaboardduetoamixtureofprogrammingerror,overrelianceontheautomation,andpoorfeedbackdeprivingthepilotsofanunderstandingofwhattheautomationwasdoing
(Endsley,2004)
Approachestotaskallocation
17
• Adhocallocation• Formalandbalancedapproachincludingcomparativeassessmentofhumanandmachineperformance;usingKeyPerformanceIndicators(performance,situationawareness,costs,cognitivetaskload,trust,humantendencyforboredom,keepingskills,recoveryfromsystemfailure,teamdynamic…)andknowledgeaboutman/machinecapabilities• Takeintoaccountpolitical,ethicalandlegalreasons
Approachestotaskallocation
18
• SheridanandVerplank's 10levelAutonomyscale• Level1– humanstakealldecisions• Level2– Computeraidsinhighlightingkeyinformationonscreenordeclutteringirrelevantinformation• Level3- Systemgatherskeyinformationandintegrates• Level4- Computeraidsindoingeachactionasinstructed• Level5- Computercompletelycarriesoutsingularorsetsoftaskscommandedbyhuman• Level6- Computerandhumangeneratedecisionoptions,humandecidesandcarriesoutwithsupport• Level7- Computergeneratesrecommendedoptions,humandecides(orinputownchoice)andsystemcarriesout
• Level8– informsthehumanonlyifasked• Level9– informsthehumanonlyifthecomputerdecidesto• Level10– thecomputersactsautonomouslyignoringthehuman
Sheridan,T.B.,Verplank,W.,HumanandComputerControlofUnderseaTeleoperators,MIT,1978
Adaptiveautomation
Decisionofwhentopasscontrolfromautomationtothehumanbasedon:• Aconsistenttimeinterval• Theoccurrenceofcriticalevents• Detectionofhumanperformancebelowacertaincriterionlevel• Useofpsychophysiologicalmonitoringtodetectlossesofarousalorother
cuesofpoorperformance(e.g.,lossofconsciousness)• Theuseofmodelsofhumanperformancetopredictthebesttimesto
intervene
Acompanyintroducesanintelligentagent(robot)thatwilltakecareofrecruitmentandhiringnewemployees.Describethefunctionalitythatsuchagentshouldhave.Whichtaskcoulditperform?Whendoingthisconsidernotonlycurrenttechnologybutalsotechnologythatwillcomeinrelativelynearfuture(5-10years).Thenconsidertwoscenarioswherethisagenthavetwodifferentautomationlevels.Inthefirstscenariotheagentwillhavealevelofautomation6or7.Inthesecondscenariotheagentwillhavealevelofautomationbetween8,9or10.Whichtasksshouldtheagentperform,andwhichtasksshouldhumansperform?Whatareadvantagesanddisadvantagesrelatedtothistaskdistribution?Whatarethepossibleproblemsthatmightoccur?Howtoovercomethem?
Task– tobedoneintheclassroom(15minutes)
Youhaveanintelligentagent(canbearobot)asyourpersonalassistant.Describethefunctionalitythatsuchagentshouldhave.Whichtaskcoulditperform?Whendoingthisconsidernotonlycurrenttechnologybutalsotechnologythatwillcomeinrelativelynearfuture(5-10years).Thendiscusstwoscenarioswherethisagenthavetwodifferentautomationlevels.Inthefirstscenariotheagentwillhavealevelofautomation6or7.Inthesecondscenariotheagentwillhavealevelofautomationbetween8,9or10.Discusswhichtaskstheagentperformandwhichtasksshouldhumansperform.Whatareadvantagesanddisadvantagesrelatedtothistaskdistribution?Whatarethepossibleproblemsthatmightoccur?Howtoovercomethem?
Task– tobedoneintheclassroom(20minutes)
“theperceptionoftheelementsintheenvironmentwithinavolumeoftimeandspace,thecomprehensionoftheirmeaning,andtheprojectionoftheirstatusinthenearfuture”(Endsley,1988).
Situationawareness
23
Importantincomplextime-criticaldomains
Steag
• Importantwithorwithoutautomation• Differentlevelsofautomatonleadtodifferentchallenges• Out-of-the-loopsyndrome– whatifautomationfails,boredom,fatigue
• Loosingthecompetenceandabilitytoadequatelyreactinnon-nominalsituations
•GOTOhttp://www.freegames.net/game/air-traffic-control.htmlandplayforawhile•Evaluate situation awarenes inthe group byusingthe givenquestionnaire andasimpleinterview
Task – tobedoneinthe classroom (15minutes)
ATMexampleEvaluationof DACwith ATCOs
25
26
Layoutof the exercise
27
ATCOs CWPstatic approach ATCOs CWPDAC
Datacollection
• Observations• Logfiles(simulator,UI)• Screencaptures• Videorecordingofscreens• Interviews(audiorecords)• AudiorecordsofthecommunicationbetweentheATCOsandpilots• Questionnaires
28
29
Module3– Groupassignment– Appendix3–deadline15.11.2019Eachgroupistoevaluatetheonewidelyusedsystemforevaluation(Netflixrecommendationengine,googlemapsinstruction,ruter…)orthesystemyouhavebeenworkingonduringthefirsttwomodules.Process:• Decidethesubjectandthescopeoftheevaluation.Whatareyougoingtoevaluate?Whyhaveyouselectedthissystem?• MakeaplanforevaluatingthesystemusingtheguidelinesforHuman-AIInteraction.Howareyougoingtoevaluatethesystem?• Evaluatethesystemover3-4days• Describewhathaveyoufound
Deliverable:• Describebrieflytheevaluationplan,theevaluationresultsandlessonslearntfromusingtheguidelines(3-4pages).Thisshouldbe
includedasincludeasAppendix3inthefinalreport
Expectedworkload:• 4-8hoursworkforeachgroupmemberIncaseofproblems,emailAmela([email protected]).
Module3– Groupassignment– Finalreport
• Adescriptionofthegroup,whoyouare- names.• Adescriptionofwhatareaof“interactionwithAI”youareinterestedinworkingwith.• Backgroundsection:Positionyourworkrelativetoexistingknowledgeandpractice• Minimum1maximum2questionsthatyouwanttoaddress.Pleasewritesomesentencesaboutthequestions.Thesequestions
canchangeandevolvelaterinthemidtermreportandinthefinalreport- asyougoaboutinvestigatingyourquestions.• Methodsection– overallapproach,designprocess(optional,butencouraged),datacollection methods• Sketchesand/orprototypes(optional,butencouraged)• Findings(progress,initialoutcomes)• (new)Discussion• (new)Conclusion• (new)LessonsLearned• Minimumseven referencestoliterature.
.
Collaborationandlevels of automation
Philipsatal.(2016)giveataxonomyandexamplesofhuman-robotscollaboration.Choose2-3examples,describetheirlevelsofautonomyasdescribedin(Endsley,2004;chapter10.5.2),andreflectonadvantagesanddisadvantagesifwedecrease/increasetheircurrentlevelofautonomy.Pages2-4
Module3– Individualassignment– deadline15.11.2019