Prof. A. Taleb-Bendiab, talk: Reading’06, Date: 12/09/2015, Slide: 1 Software Engineering...

Prof. A. Taleb-Bendiab, talk: Reading’06, Date: Prof. A. Taleb-Bendiab, talk: Reading’06, Date: 04/21/2304/21/23, Slide: , Slide: 11

Software Engineering Software Engineering Challenges: Challenges:

of Complex Self-of Complex Self-Organising Organising SystemsSystems

Prof. A. Taleb-BendiabProf. A. Taleb-BendiabSchool of ComputingSchool of Computing

Liverpool John Moores UniversityLiverpool John Moores Universityemail: email: [email protected]@livjm.ac.ukhttp://www.cms.livjm.ac.uk/talebhttp://www.cms.livjm.ac.uk/taleb

Software Engineering Software Engineering Challenges: Challenges:

of Complex Self-of Complex Self-Organising Organising SystemsSystems

Prof. A. Taleb-BendiabProf. A. Taleb-BendiabSchool of ComputingSchool of Computing

Liverpool John Moores UniversityLiverpool John Moores Universityemail: email: [email protected]@livjm.ac.ukhttp://www.cms.livjm.ac.uk/talebhttp://www.cms.livjm.ac.uk/taleb

mailto:[email protected]

mailto:[email protected]

Prof. A. Taleb-Bendiab, talk: Reading Guest Seminar, Date: Prof. A. Taleb-Bendiab, talk: Reading Guest Seminar, Date: 04/21/2304/21/23, Slide: , Slide: 22

OutlineOutline Drivers for a paradigm shiftDrivers for a paradigm shift Autonomic Grid ComputingAutonomic Grid Computing

Autonomic ComputingAutonomic Computing Setting the Scene for Setting the Scene for

Drivers for a paradigm shiftDrivers for a paradigm shift Quest for a new theoretical frameworkQuest for a new theoretical framework

Recent bRecent bio-inspiredio-inspired initiatives initiatives SAS, DASADA, SRS and ANTSSAS, DASADA, SRS and ANTS

Understanding autonomic systems engineering Understanding autonomic systems engineering Definitions and state of the art Definitions and state of the art Challenges and Open Research QuestionsChallenges and Open Research Questions

Complexity NetworksComplexity Networks Self-organising systemsSelf-organising systems Complex random networks Complex random networks

ConclusionsConclusions


Emerging Networked Emerging Networked LandscapesLandscapes


Drivers for a Paradigm Shift Drivers for a Paradigm Shift #2#2

Modern ExpectationsModern Expectations High-Availability -- 24x7 delivery

near-100% availability is becoming near-100% availability is becoming mandatory for e-commerce, enterprise apps, mandatory for e-commerce, enterprise apps, online services, ISPsonline services, ISPs

Change Support rapid deployment of new hw/sw,

services, etc Maintainability

Provide flexible systems admin. env. reduce system administrators tasks, complexity and cost

Just-in-time scalability Allow flexible system up scaling without sacrificing

performance, availability or maintainability evolutionary growth and adaptation

Survivability Full malleability


A Shift Towards A Shift Towards What? What? Key question is not only

how to achieve the above listed modern expectations as:

a single metric/attribute or a cost/value-effective combination of them all

But IBM argues that it’s how to reduce the cost and complexity of achieving that

Management by delegation Rethinking systems designRethinking systems design

So where to next?


Some Recent InitiativesSome Recent Initiatives SAS -- SAS -- Self-Adaptive Systems Self-Adaptive Systems

(DARPA, 1997)(DARPA, 1997) DASADADASADA -- Dynamic Assembly for

Systems’ Adaptability, Dependability, and Assurance (DARPA, 2000)DARPA, 2000)

AC -- AC -- Autonomic Computing Autonomic Computing (IBM, 2001)(IBM, 2001)

ACom- ACom- Autonomic Communication Autonomic Communication (EU, 2003)(EU, 2003)

SRS -- SRS -- Self-Regenerative Systems Self-Regenerative Systems (DARPA, 2003)(DARPA, 2003)

ANTS -- ANTS -- Autonomous Nano-Autonomous Nano-Technology Swarm (NASA)Technology Swarm (NASA)

KP -- KP -- Knowledge Plane (MIT, DARPA, Knowledge Plane (MIT, DARPA, 2004)2004)

Major Recent InitiativesMajor Recent Initiatives

Defined by Laddaga in the Defined by Laddaga in the 1997 DARPA Broad 1997 DARPA Broad Agency Announcement as:Agency Announcement as:

““...software that ...software that evaluates its own evaluates its own performance and performance and

changes behaviour when changes behaviour when the evaluation indicates the evaluation indicates

that it is not that it is not accomplishing what the accomplishing what the software is intended to software is intended to

do...”.do...”.

To adapt, the system To adapt, the system reacts to environmental reacts to environmental change - the problem is change - the problem is recognising the need for recognising the need for change, then planning, change, then planning,

enacting and verifying the enacting and verifying the change - these are self-change - these are self-

managing concernsmanaging concerns

Autonomic ComputingInspired by the “autonomic” Inspired by the “autonomic” function of the human central function of the human central nervous system. nervous system.

software systems that take software systems that take care of the mundane care of the mundane elements of systems elements of systems

management themselves, management themselves, allowing human operatives allowing human operatives

to concentrate on more to concentrate on more important work.important work.

4 major research thrusts: 4 major research thrusts:

• Biologically-inspired Biologically-inspired diversitydiversity: : genetically genetically

diverse computing fabricdiverse computing fabric• “ “Cognitive immunity” Cognitive immunity” and self-healing: see and self-healing: see

automated cyber immune automated cyber immune response and system response and system

regeneration. regeneration. • Granular, scalable Granular, scalable redundancy: This redundancy: This

research thrust area will research thrust area will increase the practicality of increase the practicality of

redundancy techniques.redundancy techniques.• Reasoning about the

insider threat to preempt insider attacks and detect

system overrun.

A 2020 vision of a class of A 2020 vision of a class of space exploration space exploration missions termed missions termed nanoswarms, nanoswarms, where many where many cooperating cooperating picospacecraftpicospacecraft or intelligent spacecraft work intelligent spacecraft work in teams to explore the in teams to explore the asteroid belt, based on asteroid belt, based on the efficiency and the efficiency and coordination of hive coordination of hive culture.culture.


Autonomic Grid Computing at Autonomic Grid Computing at the Rescuethe Rescue

For more details For more details Autonomic Computing Autonomic Computing

Drivers for change Drivers for change High-availability, etc.High-availability, etc. DefinitionsDefinitions Designs and principlesDesigns and principles State-of-the-artState-of-the-art

Grid ComputingGrid Computing MiddlewareMiddleware


Remaining Research Remaining Research ChallengesChallenges

Host-BasedHost-Based Complexity ParadoxComplexity Paradox

Autonomic computing aims to reduce admin. costs, hide system Autonomic computing aims to reduce admin. costs, hide system complexity and intricacy, complexity and intricacy,

Though, their designs are becoming more complex Though, their designs are becoming more complex as yet are poorly understood as yet are poorly understood as echoed by D. Garlan 2005as echoed by D. Garlan 2005 “… “… how do we design, build, and evolve such sw systems so how do we design, build, and evolve such sw systems so

that they can meet given—and evolving—requirements ...” that they can meet given—and evolving—requirements ...” Incremental deployment of AC capabilities in Incremental deployment of AC capabilities in

legacy systems. legacy systems. AOP-based evolution, InteroperationAOP-based evolution, Interoperation Support functional and non-functional Support functional and non-functional

requirements for autonomy.requirements for autonomy. Evaluation mechanisms and metrics [ref] Evaluation mechanisms and metrics [ref]

Governance vs Autonomy ParadoxGovernance vs Autonomy Paradox Balancing and adjusting governance and Balancing and adjusting governance and

autonomyautonomy Programming, control and Interaction Models Programming, control and Interaction Models

Complex-BasedComplex-Based Self-organisationSelf-organisation Complex and random NetworksComplex and random Networks


Progress to Date Progress to Date #1#1 Has been informed by a set of design paradigms Has been informed by a set of design paradigms

Model-based vs Self-Organising Systems design Model-based vs Self-Organising Systems design modelsmodels

Top-down vs bottom-upTop-down vs bottom-up Applying and/or revisiting:Applying and/or revisiting:

cybernetic principlescybernetic principles control systems theory, regulation, reward and control systems theory, regulation, reward and

sanctionssanctions Decision theory, Complexity theoryDecision theory, Complexity theory DAI and CIDAI and CI

dynamic planning, deliberative models, MLdynamic planning, deliberative models, ML Middleware supportMiddleware support

self-awareness, reflection and deliberationself-awareness, reflection and deliberation Autonomic Software Architecture, etc.Autonomic Software Architecture, etc.


The Story so Far The Story so Far #1#1 State-of-the-art of autonomic systems designs State-of-the-art of autonomic systems designs

including;including; autonomic software models and autonomic software models and

architecture, standards architecture, standards tools and techniques to support tools and techniques to support

the design, modelling, analysis the design, modelling, analysis and evolution of autonomic software and evolution of autonomic software

Define associated models for their Define associated models for their programming, control programming, control interaction models with human and/or interaction models with human and/or

other non-AC systems (legacy). other non-AC systems (legacy). Delegation of authority and its adjustmentDelegation of authority and its adjustment

Currently design models of Currently design models of the 1st generation the 1st generation ”autonomic systems” ”autonomic systems” employ; employ;

Explicit managed Explicit managed autonomy via policies autonomy via policies and rule sets and rule sets predefining at design-predefining at design-time all extraneous time all extraneous behaviour using behaviour using constructs such as;constructs such as;

Event Condition Event Condition Action, Design by Action, Design by contractcontractSeparation of Separation of concerns – AOP, concerns – AOP, etc.etc.


Story so far Story so far #2#2 More recent work is focusing on scalable More recent work is focusing on scalable

methods for specifying dynamic behaviour of methods for specifying dynamic behaviour of autonomic systems. autonomic systems. Axiomatic vs algebraic modellingAxiomatic vs algebraic modelling

FOL based calculi Vs process algebraFOL based calculi Vs process algebra Evolving Evolving

policies and control modelpolicies and control model Structural/organisational modelStructural/organisational model

Bounded autonomy and adjustmentsBounded autonomy and adjustments Unifying models for Unifying models for

model-based and SOS approaches for autonomic model-based and SOS approaches for autonomic systems engineering and managementsystems engineering and management


Our Approaches Our Approaches #1#1 More recent theoretical work is focusing on scalable More recent theoretical work is focusing on scalable

methods for specifying and enacting dynamic behaviour of methods for specifying and enacting dynamic behaviour of autonomic systemsautonomic systems Autonomic Systems EngineeringAutonomic Systems Engineering

Related Work: Related Work: IBMIBM blueprint blueprint (www-03.ibm.com/autonomic/pdfs/ACBP2_2004-10-04.pdf)(www-03.ibm.com/autonomic/pdfs/ACBP2_2004-10-04.pdf) An autonomic manager contains a continuous control loop that monitors activities and takes An autonomic manager contains a continuous control loop that monitors activities and takes

actions to adjust the system to meet business objectivesactions to adjust the system to meet business objectives Autonomic managers learn from past experience to build action plansAutonomic managers learn from past experience to build action plans Elements need to be instrumented consistently, based on open standardsElements need to be instrumented consistently, based on open standards

Our modelOur model Model-based ApproachModel-based Approach

Systems theory, design patterns, design grammar and Systems theory, design patterns, design grammar and service-oriented programmingservice-oriented programming

A. Taleb-Bendiab, D.W. Bustard, R. Sterritt, A. Laws, M. Randles, F. Keenan, P. Miseldine, "A. Taleb-Bendiab, D.W. Bustard, R. Sterritt, A. Laws, M. Randles, F. Keenan, P. Miseldine, "Model-Based Self-Managing Systems EngineeringModel-Based Self-Managing Systems Engineering", in Proceedings of the 16th International ", in Proceedings of the 16th International Workshop on Database and Expert Systems Applications (Workshop on Database and Expert Systems Applications (DEXA’05DEXA’05), ), SAACS'05SAACS'05: 3rd : 3rd International Workshop on Self-Adaptable and Autonomic Computing Systems, pp., International Workshop on Self-Adaptable and Autonomic Computing Systems, pp.,

David Bustard, Roy Sterritt, A. Taleb-Bendiab, A. Laws, M. Randles, F. Keenan, 05, "Towards David Bustard, Roy Sterritt, A. Taleb-Bendiab, A. Laws, M. Randles, F. Keenan, 05, "Towards a Systemic Approach to Autonomic Systems Engineering", a Systemic Approach to Autonomic Systems Engineering", EASE'2005. EASE'2005.

David Bustard, Roy Sterritt, A. Taleb-Bendiab, A. Laws, M. 06, "Autonomic System Design David Bustard, Roy Sterritt, A. Taleb-Bendiab, A. Laws, M. 06, "Autonomic System Design Based on the Integrated Use of SSM and VSM", to appear in AI Review, Vol. , No. , Springer, Based on the Integrated Use of SSM and VSM", to appear in AI Review, Vol. , No. , Springer, ISSN 0269-2821.ISSN 0269-2821.

K. Liu, A. Taleb-Bendiab, 05, "Presenting a Case for a Principled Approach to K. Liu, A. Taleb-Bendiab, 05, "Presenting a Case for a Principled Approach to Citizen, Business and Technology IntegrationCitizen, Business and Technology Integration in e-Government Services: in e-Government Services: Challenges and Research OpportunitiesChallenges and Research Opportunities", Egov'05", Egov'05. .

Monitor Execute

Analyze Plan

Knowledge

Managed Element

Sensors Effectors

http://www.cms.livjm.ac.uk/taleb/Publications/05/AL_SAACS%2705.pdf

http://http:/www.dexa.org/drupal/?q=node

http://cms1.gre.ac.uk/conferences/saacs-2005/accepted_papers.htm


Our Approaches Our Approaches #2#2 Emergence-based Emergence-based

ApproachApproach Complexity: Complex SystemsComplexity: Complex Systems

Seth Bullock and D. Cliff (HP Report, Ref.)Seth Bullock and D. Cliff (HP Report, Ref.) Complexity and Emerging Behaviour in IT Complexity and Emerging Behaviour in IT

SystemsSystems


Entropic Autonomic DesignEntropic Autonomic Design


Illustrative ExampleIllustrative Example

… Printer Internet Other Facility or Service

… Application 1

Application 2

Application n

A2: monitor that the computing service facilitates business activities and take control action as necessary

A8: install new

technology A10: withdraw

obsolete technology

A7: maintain record of

technology in use

A4: maintain stock of spare equipment, parts and supplies

A9: procure new technology

A5: be aware of the cost of the

computing service

A3: maintain technology

in use

A1: provide a computing

service

A6: be aware of the benefit of the

computing service

TCA

A2: monitor that the computing service facilitates business activities and take control action as necessary

A8: install new

technology

A7: maintain record of

technology in use

A4: maintain stock of spare equipment, parts and supplies

A5: be aware of the cost of the

computing service

A15: develop technology support

plan

A10: withdraw obsolete

technology A3: maintain technology

in use

A6: be aware of the benefit of the

computing service

TCA

A0: Provide a computing service

A1: provide a user service

A11: be aware of co-ordination needs

and implement controls

A12: be aware of technology opportunities

& threats

A13: be aware of organisation

needs

A14: be aware of organisation constraints

A9: procure new technology

A16: define expectations


Achievements So far … Achievements So far …


Design Patterns: VSM and Design Patterns: VSM and GOFGOF


Related workRelated work Outlined in the Autonomic computing Outlined in the Autonomic computing

edge: The “Standard” way of autonomic edge: The “Standard” way of autonomic computing, Brent Miller, 29/05/2005.computing, Brent Miller, 29/05/2005.

Though more is required – Our Though more is required – Our ApproachApproach Autonomic Software PatternsAutonomic Software Patterns

Associated FrameworksAssociated Frameworks Description languagesDescription languages

Sensor and Actuator DescriptionSensor and Actuator Description Service Assembly and deploymentService Assembly and deployment Monitoring Monitoring

Standards -- InteroperationStandards -- Interoperation


Deploy Sensor (via SADL)

Request monitor (via MSDL)

Select Sensors

Inject

Readings as XML

Readings

Edit Sensors

Show Example -1

Show Example-2

Show Example-3

Show Example-4

Show Example-5

Sensor & Actuator

Framework

ConsumerSensor Provider

Sensors

P2P P2P Self-Organising Overlays: Self-Organising Overlays: GridsGrids


Modelling AutonomyModelling Autonomy Algebraic specification Algebraic specification

Related workRelated work Process AlgebraProcess Algebra

CSP CSP Static model checking and dynamic software analysisStatic model checking and dynamic software analysis

Our modelOur model Using SSC used to formalizes the behaviour of Using SSC used to formalizes the behaviour of

dynamically changing systems FOL (McCarthy, 1963).. dynamically changing systems FOL (McCarthy, 1963).. Support concurrent actions and timing constraints. Support concurrent actions and timing constraints. Each situation can be viewed as a history of previous Each situation can be viewed as a history of previous

actions. actions. Action, guards and time can be modelled at Action, guards and time can be modelled at

deliberation points in an autonomic setting.deliberation points in an autonomic setting. M. Randles, A. Taleb-Bendiab, Philip Miseldine, Andy Laws, "M. Randles, A. Taleb-Bendiab, Philip Miseldine, Andy Laws, "

Adjustable Deliberation of Self-Managing SystemsAdjustable Deliberation of Self-Managing Systems", ", ECBS 2005ECBS 2005: 449-456. [: 449-456. [pptppt]]

http://www.cms.livjm.ac.uk/taleb/Publications/05/RM_Ease2005.pdf

http://ftp.informatik.uni-trier.de/%7Eley/db/conf/ecbs/ecbs2005.html#RandlesTML05

http://www.cms.livjm.ac.uk/taleb/Publications/05/MR_Ease%2705.ppt


Evolving and Adjustable Evolving and Adjustable AutonomyAutonomy Via compositional model and evolution of Via compositional model and evolution of

Software services (components)Software services (components) Software governance (Control) viaControl) via

Formal modelling of norms, rules of playFormal modelling of norms, rules of play Encoded via CA-SPA constructs Encoded via CA-SPA constructs Enactment support – from spec. to code using Enactment support – from spec. to code using

Neptune language Neptune language deployed onto software control Centre (agent) on deployed onto software control Centre (agent) on

grid middlewaregrid middleware M. Randles, A. Taleb-Bendiab, P. Miseldine, 05, "M. Randles, A. Taleb-Bendiab, P. Miseldine, 05, "

Mind out of Programmable Matter: Exploring Unified Models of Emergent System AutonMind out of Programmable Matter: Exploring Unified Models of Emergent System Autonomy for Collective Self-Regenerative Systemsomy for Collective Self-Regenerative Systems", Extended Abstract, the 2nd GSFC/IEEE Workshop on Radical Agent Concepts (", Extended Abstract, the 2nd GSFC/IEEE Workshop on Radical Agent Concepts (WRAC'05WRAC'05), NASA GSFC Visitor's Center, Greenbelt, MD, 20th-22nd September 2005. ), NASA GSFC Visitor's Center, Greenbelt, MD, 20th-22nd September 2005.

Miseldine, P., Taleb-Bendiab A. “Miseldine, P., Taleb-Bendiab A. “A Programmatic Approach to Applying Sympathetic A Programmatic Approach to Applying Sympathetic and Parasympathetic Autonomic Systems to Software Design”, and Parasympathetic Autonomic Systems to Software Design”, Self-Organisation and Self-Organisation and Autonomic Informatics (ISBN I-58603-577-0), Hans Czap, Rainer Unland, Cherif Branki, Autonomic Informatics (ISBN I-58603-577-0), Hans Czap, Rainer Unland, Cherif Branki, Huaglory Tianfield (Eds.), pp:3-17, IOS Press, Amsterdam, 2005.Huaglory Tianfield (Eds.), pp:3-17, IOS Press, Amsterdam, 2005.Awarded "Most Innovative Paper" at ConferenceAwarded "Most Innovative Paper" at Conference

Miseldine, P., Taleb-Bendiab, A., “Miseldine, P., Taleb-Bendiab, A., “CA-SPA: Balancing the Crosscutting Concerns of CA-SPA: Balancing the Crosscutting Concerns of Governance Autonomy in Trusted Software”, Governance Autonomy in Trusted Software”, IEEE International Workshop on Trusted IEEE International Workshop on Trusted and Autonomic Computing Systems within AINA 2006. Vienna, Austria. April 2006.and Autonomic Computing Systems within AINA 2006. Vienna, Austria. April 2006.

http://www.cms.livjm.ac.uk/taleb/Publications/05/MR_WRAC%2705.pdf

http://www.cms.livjm.ac.uk/taleb/Publications/05/MR_WRAC%2705.pdf

http://aaaprod.gfsc.nasa.gov/WRAC/


Governing AutonomyGoverning Autonomy Self-Governance TheorySelf-Governance Theory

Deliberative layer using the EBDI model Deliberative layer using the EBDI model Formal modelling of norms, etiquette, rules of playFormal modelling of norms, etiquette, rules of play deployed via CA-SPA constructs deployed via CA-SPA constructs Enactment support – from spec. to codeEnactment support – from spec. to code


Programming Autonomic SystemsProgramming Autonomic Systems Neptune Meta-Language Neptune Meta-Language

Integrated Development Integrated Development Environment:Environment:

Miseldine, P., Taleb-Bendiab A. A Programmatic Miseldine, P., Taleb-Bendiab A. A Programmatic Approach to Applying Sympathetic and Approach to Applying Sympathetic and Parasympathetic Autonomic Systems to Software Parasympathetic Autonomic Systems to Software Design. to appear in the 2005 International Design. to appear in the 2005 International Conference on Self-Organization and Adaptation Conference on Self-Organization and Adaptation of Multi-agent and Grid Systems (SOAS’2005). of Multi-agent and Grid Systems (SOAS’2005).


Common ObjectCommon ObjectFunctionality SetFunctionality Set

Middleware

Evolvable Object

Mobility

MiddlewareCommunication

Openness

Data Formatter

Serialize + TransportSuspend

Operation

Distributed Shared Memory Facility

Request Codec

Incoming Data

Processed Data

Make Requests / Intervene in Operation

Monitor Status / Performance

Register upon instantiation

Inform of instantiated interest object

Specify interest

Lookup a service

Common Feature Layer

A Programming Model forA Programming Model forSelf-Organising Object SystemsSelf-Organising Object Systems


Object-LevelObject-LevelApplication Service CompositionApplication Service Composition

System Security Agent

Service Gateway

Performance Agent

Spawn

Middleware

Administrative

Interface

Spawn

Middleware Service Gateway

Application

7. Connect

Object

Common Feature Layer

1. Register

Inform

Direct

Request Service


Example 1: A Grid-Example 1: A Grid-Based Decision Based Decision

SystemsSystems


Another OneAnother One?? -- Dental Triage -- Dental Triage Demo.Demo.

Current System

Re-engin

eering

via

Neptu

ne

toolk

it

New

Visual Modelling of Protocol or process flow

New Grid-Based System

Pro

cess is com

piled

into

an

op

en in

trosp

ective form

at


East Lancashire East Lancashire ArchitectureArchitecture

OH-Dental Service

Dental Triage Service

EPR Service

A&E/PDS/EDS/DPrac/Other

E-Dental Booking Service

Dental Inventory Service

East Lancashire Dental Middleware

Clinical Care Pathway/Governance

24 Dental Triage Service

NHS Direct

Adastra Call Buffer Service

Accounting/billing Service

PCT/Other


AcknowledgementsAcknowledgements Acknowledgements

My thanks to the Team

Apologies to individual researchers if I didn’t have time to mention your

work Useful Links

www.cms.livjm.ac.uk/2nrich www.cms.livjm.ac.uk/cloud www.cms.livjm.ac.uk/taleb

http://www.cms.livjm.ac.uk/2nrich

http://www.cms.livjm.ac.uk/cloud

http://www.cms.livjm.ac.uk/taleb

http://www.cms.livjm.ac.uk/taleb


That’s the end – so I’m off !

Date post:	16-Jan-2016
Category:	Documents
Upload:	stewart-lawrence
View:	218 times
Download:	0 times

Prof. A. Taleb-Bendiab, talk: Reading’06, Date: 12/09/2015, Slide: 1 Software Engineering...

Documents