Ethics andAI:Stateoftheartandperspectives
NadiaAbchiche-Mimouni
1 May05,2019- Venice,ItalyADAPTIVE2019
IBISCLab.Univ.Evry,Université Paris-Saclay
Plan
Generalethics anddefinitionsWhy is Artificial Intelligenceconcerned with ethical issues?Ethics inArtificial Intelligence
Institutionnal initiativesResearch works
Perspectivesandopendiscussion
2
Generalethics (1/6)
• Ethics• Setofvalueswhose purpose generates thegood,is looking fortheGood(Aristote)
• Relativize thenotionofgood/bad action• Reflection argued forthewell-act /be beautiful
• Moral• Good/bad action• Setofstandardsspecific toanindividual,asocialgrouporapeople• Conceptofrights,duties andprohibitions
• Deontology• SetofRules andDutiesGoverning aProfession
3
Definitions andvisionsfrommoralphilosophy
1. Normativeethics (substantial ethics)à allow todetermine,between twoactions,which is morally better
2. Metaethicsà philosophical analysis ofethical discourse andits epistemologicalandmetaphysical presuppositions
3. Appliedethicsà analysis ofconcrete situationsraising ethical issuesfordecision-making
4
Generalethics (2/6)Definitions andvisionsfrommoralphilosophy
GeneraldefinitionEthics proposes toquestionmoralvaluesandmoralprinciples that should guideour actions,indifferent situations,inorder toact inaccordancewith them.([Mill,JohnStuart 1998],Kant)
5
Generalethics (3/6)Definitions andvisionsfrommoralphilosophy
1.Normativeethics:
a) Ethical ormoralnihilism:asserts that there is nothingmorally rightorwrong.Itarguesthat:1. Ajudgments such as"Thekillingofinnocentpeopleis always morally wrong"
can notbe true orfalsetotheextent that moraljudgments havenologicalvalue.
2. Astatement like "Thisstoneweighs 30kg"hasalogical valuetotheextent thatthis can be true orfalse.
b) Ethical relativism:ethical constructivism,ethical subjectivismc) Ethical realism:ethical naturalism,ethical non-naturalism
6
• Ethical ormoralnihilism:asserts that there is nothingmorally rightorwrong.Itarguesthat judgments such as"Thekillingofinnocentpeopleis always morally wrong"can notbe true orfalsetotheextent that moraljudgments havenological value.Astatementlike "Thisstoneweighs 30kg"hasalogical valuetotheextent that this can be true orfalse.
• Ethical relativism:ethical constructivism,ethical subjectivism• Ethical realism:ethical naturalism,ethical non-naturalism
Generalethics (4/6)Definitions andvisionsfrommoralphilosophy
2.Metaethics:
7
• Bioethics• human procreation (assisted procreation,abortion,gamete donation,prenataldiagnosis,cloning ...);• endoflife(palliativecare,therapeutic relentlessness,euthanasia...);• genomics;• publichealth;• neuroscienceandneuropsychiatry;
• Theethics oftheenvironment• sustainable development/responsibility towards futuregenerations;• managementofnatural resources (water,forests,subsoils ...);• wastemanagement;• industrial andagriculturalpollution;• animalrights;• geneticallymodified organisms (GMOs);• biodiversity /ecosystemconservation;• etc.
Generalethics (5/6)3.Applied ethics
Generalethics (6/6)
8
ExampleInBookIofPlato’s Republic,Cephalus defines ‘justice’as"speaking thetruth"and"payingone’sdebts".Socrates quickly refutes this bysuggesting that it would be wrong torepay certaindebts—forexample,toreturnaborrowedweapon toafriend who is notinhis rightmind.Conflict between two moralnorms:
1. Repayingone’s debts2. Protectingothers from harm
Definition• Situationsinwhich any available choice leadstotransgressing someaccepted ethical principle
andyet adecision hastobe made,[Kirkpatrick,2015].• Anethical principle is unable togive adifferent valuation (apreference)between two options:
each optionis supported byethical reasons,given that theexecution ofboth is notpossible[McConnell2014].
Ethical dilemmas
Why andhowis AIconcernedwith ethical issues?
9
• Selfdrivingcars• Algorithmicdiscrimination• Dataownership• …
chombosan/Alamy StockPhotohttps://twitter.com/technicolorr/status/747823696811745281
Jobsreplacement…
10
Industry 5.0
Why andhowis AIconcernedwith ethical issues?
Ethical questions• Algorithmstransparency
• Ethicsofpersonalizationtechnologies
• Encodinglegislationintomachine• Responsibility
• Valuealignment• SustainableAIsystems
• …
11
Openletter for:• Research Priorities forRobust andBeneficial Artificial Intelligence ([StuartRussell&al.,2015])
Why andhowis AIconcernedwith ethical issues?
SocietalrecommendationsDeclarationofMontrealforaresponsibledevelopmentofAI
12
Yoshua Bengio,andYannLeCunawardedtheTuringprize,27thmars2019
Why andhowis AIconcernedwith ethical issues?
13
TheDeclaration sparked publicdebate andencouraged aprogressiveandinclusiveorientationtothedevelopmentofAI.
Why andhowis AIconcernedwith ethical issues?SocietalrecommendationsDeclarationofMontrealforaresponsibledevelopmentofAI
https://www.montrealdeclaration-responsibleai.com/
Ethics inArtificial Intelligence
• Hybrid research effortandphilanthropic fund that seeks toensure thattechnologiesofautomationandmachinelearning areresearched,developed,anddeployed inaway which vindicate socialvaluesoffairness,human autonomy,andjustice.
• Ajointproject oftheMITMediaLab andtheHarvardBerkman-KleinCenterforInternetandSociety.
• Projects onthree domains:1. AIandJustice2. InformationQuality3. AutonomyandInteraction
14
Institutional initiatives(1/5)
Ethics andGovernance ofAIInitiative(Launched in2017)
Moving “FromPrinciples toPractice”with standardsprojects,certificationprograms,andglobalconsensusbuilding toinspiretheEthically Aligned Design ofautonomous andintelligenttechnologies
Ethically Aligned Design, https://standards.ieee.org/industry-connections/ec/autonomous-systems.html
1.HumanRights2.Well-being3.DataAgency4.Effectiveness5.Transparency6.Accountability7.Awareness8.Competence 15
Institutional initiatives(2/5)Ethics inArtificial Intelligence
TheIEEEGlobalInitiativeonEthics ofAutonomous andIntelligentSystems,https://standards.ieee.org/industry-connections/ec/autonomous-systems.html
Worldeconomic forumhttps://www.weforum.org/agenda/2016/10/top-10-ethical-issues-in-artificial-intelligence/
Top9ethical issuesinartificial intelligence1. Unemployment.What happens after theendofjobs?2. Inequality.Howdowe distribute thewealth created bymachines?3. Humanity.Howdomachinesaffectour behaviour andinteraction?4. Artificial stupidity.Howcan we guard against mistakes?5. Racist robots.Howdowe eliminate AIbias?6. Security.Howdowe keep AIsafe from adversaries?7. Evil genies.Howdowe protect against unintended consequences?8. Singularity.Howdowe stay incontrolofacomplex intelligentsystem?9. Robotrights.Howdowe define thehumanetreatment ofAI?
16
Institutional initiatives(3/5)Ethics inArtificial Intelligence
Futureoflifeinstitute,https://futureoflife.org/
17
Institutional initiatives(4/5)Ethics inArtificial Intelligence
What we really need todois make surethat lifecontinuesinto thefuture.[…]It’s besttotry toprevent anegativecircumstance from occurring than towait forit tooccur andthen be reactive.”
-Elon Musk onkeeping AIsafe andbeneficial
(*)InstituteforEthics inArtificial Intelligence(FacebookandTechnical University ofMunich)(*)https://newsroom.fb.com/news/2019/01/tum-institute-for-ethics-in-ai/(*)DateScienceCentral(*)https://www.datasciencecentral.com/profiles/blogs/ethics-in-artificial-intelligence(*)https://www.information-age.com/ethics-artificial-intelligence-123475134/(*)https://www.information-age.com/ethics-artificial-intelligence-123475134/(*)http://www.ethicsandai.com/(*)European AIAlliancehttps://ec.europa.eu/futurium/en/ai-alliance-consultation/guidelines#Top(*)TheEthics OfAlgorithms,ethicsofalgorithms.com,Drexel university,Philadelphia,Pennsylvania,USA(*)CIFARPan-Canadian Artificial IntelligenceStrategyhttps://www.cifar.ca/ai/pan-canadian-artificial-intelligence-strategy(*)Onlineethicscenterforengineeringandscience,https://www.onlineethics.org/
18
Institutional initiatives(5/5)Ethics inArtificial Intelligence
AtaxonomyofintegrationAIandEthics([Yu&al.,2018],IJCAI)4axes:
1. ExploringEthicalDilemmas2. IndividualEthicalDecisionFrameworks3. CollectiveEthicalDecisionFrameworks4. EthicsinHuman-AIInteractions
19
Current research works (1/)
• Twoexamples:1. GenEth ethicaldilemmaanalyzer([AndersonandAnderson,2014],AAAI)
• Throughadialogwithethicists,helpscodifyethicalprinciplesinanygivendomainbyproposingasetofrepresentationschemasforframingthediscussionsonAIethicswhichincludes:Features,duties,actions,casesandprinciples.
2. MoralMachineproject (http://moralmachine.mit.edu/)• AllowsparticipantstojudgevariousethicaldilemmasfacingAutonomousVehiculeswhichhavemalfunctioned,andselectwhichoutcomestheyprefer.
• Thedecisionsareanalyzedaccordingtodifferentconsiderationsincluding:1)savingmorelives,2)protectingpassengers,3)upholdingthelaw,4)avoidingintervention,5)genderpreference,6)speciespreference,7)agepreference,and8)socialvaluepreference.
• Theprojectprovidesauserinterfaceforparticipantstodesigntheirownethicaldilemmastoelicitopinionsfromothers.
20
Current research worksExploringethicaldilemmas
• Formal verification ofmoralvaluesinMAS([BONNET&al.2017])• Considerwhether moralrules shared bymany ofusarefollowedbytheagents.
• Hardproblembecause most ofthemoralrules areoften notcompatible.Insuch cases,humans usually follow ethical rules topromote onemoralrule oranother.
• Using formal verification toensure that anagentfollowsagiven ethical rulecould helpinincreasing theconfidence inartificial agents.
• Asetofformal properties through anethical rule ordering conflictingmoralrules with respecttoavaluesystem.
• Ifthebehaviourofanagentverifies these properties (which can be provenusing anexisting proofframework),it means that this agentfollows thisethical rule.
21
Current research worksIndividualEthicalDecisionFrameworks
• MoralDM:MoralDecisionMaking,([BlassandForbus,2015])• Moraldecision-makingbyhumansnotonlyinvolvesutilitarianconsiderations,butalsomoralrules
• Rulesareacquiredfrompastexamplecasesandareoftenculturallysensitive• Agentsresolveethicaldilemmasbyleveragingontwomechanisms:
1. First-principlesreasoning2. Analogicalreasoning
22
Current research worksIndividualEthicalDecisionFrameworks
• Ethical Judgment ofAgents’Behaviors inMulti-AgentSystems:([Cointe&al.2016])
• Explicit representationofethics• Explicitprocessofethicaljudgment• Considerbothindividualandcollectivereasoningonvarioustheoriesofgoodandright
• Ethicsconsistsinconciliatingdesires,moralsandabilities• GenericEthicalJudgmentProcess(EJP)useevaluation,moralandethicalknowledge.ItisstructuredalongAwareness,Evaluation,GoodnessandRightnessprocesses
• ContextofaBDImodel,usingmentalstatessuchasbeliefsanddesires• Thejudgmentprocessisusefulforanagenttojudgeit’sownbehaviorandtojudgethebehaviorsofotheragents
23
Current research worksIndividualEthicalDecisionFrameworks
• Combining2waysofmoraldecisionmakingframeworksforartificialintelligence,([Conitzer etal.,2017])
• Machinelearningbasedethicaldecision-making,thekeyapproachistoclassifywhetheragivenactionunderagivenscenarioismorallyrightorwrong.
• Well-labeledtrainingdata,possiblyfromhumanjudgementsisacquired.• Gametheoryiscombinedwithmachinelearning:gametheoreticanalysisofethicsisusedasafeaturetotrainmachinelearningapproaches,
• Whilemachinelearninghelpsgametheoryidentifyethicalaspectswhichareoverlooked.
24
Current research worksIndividualEthicalDecisionFrameworks
• Event-BasedandScenario-BasedCausalityforComputationalEthics([Fiona & al., 2018])
• Causalmodelbasedapproach• Moralresponsibility• Modellingactionsandomissions• Matrixofcausalrelations(supportingandopposingrelations)
• Scenario-basedtrace(contextandthecauseofthecause)
25
Current research worksCollectiveEthicalDecisionFrameworks
• Nooptimalsolutiontosolveethicaldilemma• EnsurethatAIisdevelopedresponsiblyincorporatingsocialandethicalvalues
• SocietalconcernsabouttheethicsofAImustbereflectedindesign• Threeprinciples(ART):
1. Accountability:answerability,blameworthinessandliability;2. Responsibility:beingincharge,orbeingthecausebehindwhether
somethingsucceedsorfails;3. Transparency:opennessofdata,processesandresultsforinspectionand
monitoring.
26
Current research works
Responsible Autonomy ([Dignum,2017])
CollectiveEthicalDecisionFrameworks
Responsible Autonomy ([Dignum,2017])
• Whoisresponsibletothedecision:fourpossiblelevelsofautonomyandregulation:1. Humancontrol:apersonorgroupofpersonsareresponsible forthedecision;
2. Regulation:thedecisionisincorporated inthesystemicinfrastructureof theenvironment;
3. ArtificialMoralAgents(AMA):systemsincorporatemoralreasoningintheirdeliberationandtoexplaintheirbehaviorintermsofmoralconcepts;
4. Random:theautonomous systemrandomlychoosesitsactionwhenfacedwitha(moral)decision
• Howdecisionsaredependentondifferentmoralandsocietalvalues:• Determinewhichmoralvaluestoaimforandwhichethicalprinciples toadheretoinagivencircumstance;
• Basicvaluesrefertodesirablegoalsthatmotivateactionandtranscendspecificactionsandsituations.
• Valuesarequiteconsistentacrosscultures.Classifiedinto4dimensions: (i)Openness tochange,(ii) Self-enhancement, (iii)Conservation, (iv)Self-transcendence.
• Prioritizedifferentmoralandsocietalvalues,depending onindividual andsocio-culturalenvironment;
• Valuesserveascriteriatoguide theselectionorevaluationofactions,takingintoaccounttherelativepriorityofvalues. 27
Current research worksCollectiveEthicalDecisionFrameworks
28
Current research works
Computational and ART consequences of ethical deliberation mechanisms
CollectiveEthicalDecisionFrameworksResponsible Autonomy ([Dignum,2017])
29
Perspectivesandopendiscussion
• EthicsinAIraisemanyscientificchallenges• Alldomainsofcomputersciencewillbeconcerned(softwareengineering,modelling,optimization,formalmethods,security,machinelearning…)
• Thisisnolessarevolutioninthescienceofautomation• Wearemovingtowardsnewperspectivestore-enchantourresearchprofession
30
THANKYOUFORYOURATTENTION!
Bibliography
• [Cointe&al.,2016]NicolasCointe,GrégoryBonnetandOlivierBoissier,Ethical JudgmentofAgents’Behaviors inMulti-AgentSystems,Proceedings ofthe15thInternationalConferenceonAutonomousAgentsandMultiagent Systems (AAMAS2016),J.Thangarajah,K.Tuyls,C.Jonker,S.Marsella (eds.),May9–13,2016,Singapore.
• [Conitzer etal.,2017]VincentConitzer,WalterSinnott-Armstrong,JanaSchaich Borg,YuanDeng,andMaxKramer.Moraldecisionmakingframeworksforartificialintelligence.InAAAI,pages4831–4835,2017.
• EmmanuelKant(1724-1804)KönigsbergAllemagne.• [Fiona & al., 2018] Fiona Berreby, Gauvain Bourgne, Jean-Gabriel Ganascia:
Event-Based and Scenario-Based Causality for Computational Ethics. AAMAS 2018: 147-155
• [Mill,JohnStuart 1998]Mill,JohnStuart (1998)Utilitarianism [archive]OxfordUniversityPress(ISBN 0-19-875163-X)
• [McConnell,2014]T.McConnell.Moraldilemmas.InEdwardN.Zalta,editor,TheStanfordEncyclopedia ofPhilosophy.Fall edition,2014.,https://plato.stanford.edu/entries/moral-dilemmas/#ConMorDil
31
•
Bibliography
1. [AndersonandAnderson,2014]MichaelAndersonandSusanLeighAnderson.GenEth:Ageneralethicaldilemmaanalyzer.InAAAI,pages253–261,2014.
2. [Berreby &al.2018]FionaBerreby,Gauvain Bourgne,andJean-GabrielGanascia.2018.Event-BasedandScenario-BasedCausalityforComputationalEthics.InProc.ofthe17thInternationalConferenceonAutonomousAgentsandMultiagentSystems(AAMAS2018),Stockholm,Sweden,July10–15,2018,IFAAMAS,9pages.
3. [Dignum,2017]VirginiaDignum,Responsible Autonomy.InIJCAI, pp.4698-4704,2017.4. [StuartRussell &al.,2015]StuartRussell,DanielDewey.AndMaxTegmark,Research Priorities
forRobust andBeneficial Artificial Intelligence,Copyright©2015,AssociationfortheAdvancement ofArtificial Intelligence.Allrights reserved.ISSN0738-4602.https://futureoflife.org/data/documents/research_priorities.pdf?x60419
5. [BONNET&al.,2017]GaëlBONNET,BrunoMERMETandGaëlleSIMONFormal verification ofmoralvaluesinMAS,ARTICLEVOL31/4- 2017 - pp.449-470- doi:10.3166/ria.31.449-470
6. [BlassandForbus,2015]JosephA.BlassandKennethD.Forbus.Moraldecision-makingbyanalogy:Generalizationsversusexemplars.InAAAI,pp.501–507,2015.
7. [Yu&al.,2018]HanYu,Zhiqi Shen,ChunyanMiao,CyrilLeung,VictorR.LesserandQiang Yang,BuildingEthicsintoArtificialIntelligence,InProceedingsoftheTwenty-SeventhInternationalJointConferenceonArtificialIntelligence(IJCAI-18)pp.5527-5533,2018.
32