Norms as a Basis for Governing Sociotechnical SystemsIJCAI Journal Track Presentation
Munindar P. Singh
North Carolina State [email protected]
31 July 2015
c© Singh (NCSU) Norms for Governance 31 July 2015 1
A Sociotechnical System (STS) is a MicrosocietyTraditional view: A “system” is an artifact, e.g., a computer
Principal Principal
InternalPolicy
InternalPolicy
TechnicalArchitecture
Microsociety (Org)
Norms
apply applyemploy employ
c© Singh (NCSU) Norms for Governance 31 July 2015 2
STS Setting: Collaboration in the Internet of ThingsEach agent represents an autonomous party, contains a reasoner; interact within Org
Org
UserInterface
UserInterface
KnowledgeBase
Agent AgentKnowledge
Base
StreamProcessing
StreamProcessing
Adapter& Thing
Adapter& Thing
c© Singh (NCSU) Norms for Governance 31 July 2015 3
STS Setting: Participants and Artifacts in SecurityGreatest challenges arise in the upper two; most past effort is on technical architecture
Stakeholders Adversaries
SocialArchitecture
Users
TechnicalArchitecture
Promulgation Subversion
Participation Deception
DevelopmentAdministration
Intrusion
c© Singh (NCSU) Norms for Governance 31 July 2015 4
Internet of Oceans: Global Hybrid Profile Mooring Launch
c ©T
om
Kle
ind
inst
,W
HO
I
c© Singh (NCSU) Norms for Governance 31 July 2015 5
Internet of Oceans: Glider Being Launched
c ©C
raig
Hay
slip
,O
reg
on
Sta
teU
niv
ersi
ty
c© Singh (NCSU) Norms for Governance 31 July 2015 6
Schema for IoT Resource Sharing: Four ProtocolsWhat are the normative requirements or meanings behind these protocols?
Moderator Community Member
CommunityMembership
ResourceDiscovery
ResourceContribution
ResourceNegotiation
Resource
modID
mID
mcID
modID
cID
mID
mcID
rID
episodeID
rID
mcID
contributionID
rID
UsermcID
OwnermcID
usageIDrID
c© Singh (NCSU) Norms for Governance 31 July 2015 7
Governance Challenges: Autonomy and DynamismCapturing norms is essential to addressing these challenges
I Support configurational adaptation, for exampleI Resource sharing: Offer ocean instrument for sharingI Affiliation: Add new laboratoriesI Sanction: Allow external sharing of results to fulfill deliverables
I Support operational adaptation, for exampleI Resource sharing: Preempt low-priority users in case of oil spillI Affiliation: Forbid unilateral publishing of resultsI Sanction: Absolve researcher who reveals results to prevent public
endangerment (extenuating circumstances)
I Research challengesI Abstractions to capture rules of encounterI Methods to design and analyze such abstractionsI Methods to implement such abstractions
c© Singh (NCSU) Norms for Governance 31 July 2015 8
Governance
CurrentPractice
Managerial
Controlfocused
Regimented
Obstructsuser needs
ManualNot
scalable
Error-prone
Hidesrationales
Not main-tainable
Norm-Based
Collab-orative
Commu-nicationfocused
Regulated
Supportsflexibility
Compu-tational
Scalable
Adaptive
Main-tainable
c© Singh (NCSU) Norms for Governance 31 July 2015 9
Social Architecture for Governance of Secure CollaborationPrincipals and Orgs
InternalPolicy Individual
RoleFacade
Principal Org
Liability Privilege Qualification Role
imposes grants requires
includes
applies
realizes
plays
c© Singh (NCSU) Norms for Governance 31 July 2015 10
Normative Relationships for GovernanceEach norm type is a directed relationship: crucial for accountability
Org
Principal Norm Antecedent
PracticallyCommit
Consequent
DialecticallyCommit
Commit Authorize Prohibit Sanction Empower
context
subject
object
c© Singh (NCSU) Norms for Governance 31 July 2015 11
Norms as Facades
Norm Subject’s Facade Object’s Facade
Commitment Liability PrivilegeAuthorization Privilege LiabilityPower Privilege LiabilityProhibition Liability PrivilegeSanction Liability Privilege
c© Singh (NCSU) Norms for Governance 31 July 2015 12
Life Cycle for Norms: 1Using a variant of the UML state diagram notation
Null Satisfied Violated
Conditional In Force Pending
antecedent
create
terminate
suspend
reactivate
Active
Terminated
Norm
c© Singh (NCSU) Norms for Governance 31 July 2015 13
Life Cycle for Norms: 2Substate of a terminated norm
If terminated in Thenant con Com Aut Pro San Pow
false false null null null null nullfalse true sat vio null null nulltrue false vio null sat null viotrue true sat sat vio sat sat
c© Singh (NCSU) Norms for Governance 31 July 2015 14
Governance and Policies: Two Kinds of InteractionConversations with autonomous parties; control over resources
InternalPolicy
Principal
Interaction:Conversation
PrincipalQua Self
PrincipalQua Other
CommunicativeAct
Interaction:Control
appliesconsiders
determines
actor of
contentcontext
c© Singh (NCSU) Norms for Governance 31 July 2015 15
Vocabulary for Governance and PoliciesAttributes of principals, their relationships, resource states and capabilities
Action Stative
Organization Resource Communication Participation Resource Norm State
Participation RegistrationNorm
Operation
MemberRegistrandOwns. . .
CapableIn State. . .
CreatedViolated
Satisfied. . .
EjectAdmit. . .
ContributeWithdraw. . .
CreateDelegateAssign. . .
InformRequest
Query. . .
Property
c© Singh (NCSU) Norms for Governance 31 July 2015 16
Challenges and Partial Recent Progress
I Fully declarative model of communication [AAMAS 2011, 2012]I Storing and retrieving events to determine the state of a norm
I Mapping commitments to relational algebra [AAAI 2015]
I Maintaining alignment of views despite decentralizationI Communications to guarantee (eventual) alignment [AAMAS 2015]I TBD: maximizing partial or “quick” alignment
I Designing protocols and Org contexts for monitorabilityI Failure of compositionality of monitorability [IJCAI 2015]I Automatically close a context to ensure monitorability
I Designing protocols and Org for robustness and resilienceI Typology of sanctions and sanctioning processes [Draft]I TBD: Formalization of normative robustness and resilienceI TBD: Reasoning about sanctions for design of Orgs
I Design processes conducive to autonomyI Abstract formal model of a sociotechnical design process [RE 2014]I TBD: Methodologies
c© Singh (NCSU) Norms for Governance 31 July 2015 17
An Information Model and Commitment Specification
TakeCharge ( tcID , nuID , phID , patID , t c T h r e s h o l d ) key tc IDC a r d i a c E v e n t ( ceID , nuID , phID , patID , ceMagnitude ) key ceIDCPR( cprID , nuID , phID , patID , c p r D u r a t i o n ) key cpr ID
commitment C a r d i o C a r e nuID to phIDcreate TakeChargedetach C a r d i a c E v e n t [ , TakeCharge + 1 8 0 ]
where ceMagnitude >= t c T h r e s h o l ddischarge CPR [ , C a r d i a c E v e n t + 5 ]
A Cardio Care commitment from a nurse to a physician is
I created upon Take Charge;I detached if a CardiacEvent for this patient happens above the
specified threshold within 180 minutesI Else the commitment expires
I discharged if CPR on this patient happens within five minutes of theCardiac Event (else violated)
c© Singh (NCSU) Norms for Governance 31 July 2015 18
Generate Log SchemaCREATE TABLE TakeCharge (
tc ID VARCHAR( 1 0 ) , nuID VARCHAR( 1 0 ) , phID VARCHAR( 1 0 ) ,pat ID VARCHAR( 1 0 ) , t c T h r e s h o l d VARCHAR( 1 0 ) ,
stamp DATETIME,PRIMARY KEY( tc ID )
) ;
CREATE TABLE C a r d i a c E v e n t (ceID VARCHAR( 1 0 ) , nuID VARCHAR( 1 0 ) , phID VARCHAR( 1 0 ) ,
pat ID VARCHAR( 1 0 ) , ceMagnitude VARCHAR( 1 0 ) ,stamp DATETIME,PRIMARY KEY( ceID )
) ;
CREATE TABLE CPR (cpr ID VARCHAR( 1 0 ) , nuID VARCHAR( 1 0 ) , phID VARCHAR( 1 0 ) ,
pat ID VARCHAR( 1 0 ) , c p r D u r a t i o n VARCHAR( 1 0 ) ,stamp DATETIME,PRIMARY KEY( cpr ID )
) ;
c© Singh (NCSU) Norms for Governance 31 July 2015 19
Generate Canonical Queries for Accountability CheckingIn relational algebra (Jun Yang’s notation)
Query for which Cardio Care commitments are detached( (\ s e l e c t {( stamp >= stamp38 ) } (
( TakeCharge ) \ j o i n(\ rename { ceID , nuID , phID , patID , ceMagnitude , stamp38}
(\ s e l e c t { ceMagnitude = t c T h r e s h o l d } ( C a r d i a c E v e n t ) ) ) ) )\ un ion
(\ s e l e c t {( stamp >= stamp37 ) }( (\ s e l e c t { ceMagnitude = t c T h r e s h o l d }
( C a r d i a c E v e n t ) ) \ j o i n(\ rename { tcID , nuID , phID , patID , t c T h r e s h o l d , stamp37}
( TakeCharge ) ) ) ) ) ;
c© Singh (NCSU) Norms for Governance 31 July 2015 20
Opportunities for Research
I Taking AI and MAS into the real worldI Major applications areas
I Internet of ThingsI CybersecurityI Software and analytic organizations
I Numerous research challenges, centered on autonomyI Models of interaction, incorporating resilienceI Strategic aspects, as in game theoryI Machine learning of strategiesI Human aspects of emotion and cognition regarding normsI Empirical validation of external validity of systemsI Agent-based simulations of complex systems
c© Singh (NCSU) Norms for Governance 31 July 2015 21
Thanks and Plugs
I AcknowledgmentsI US Department of DefenseI US National Science Foundation
I Read and publish inI ACM Transactions on Internet TechnologyI IEEE Internet Computing
http://www.csc.ncsu.edu/faculty/mpsingh/
c© Singh (NCSU) Norms for Governance 31 July 2015 22