05/02/2023 1
Jim Spohrer (IBM)San Jose, CA
Wednesday March 22, 2017http://www.slideshare.net/spohrer/ibm-welcome-and-cognitive-20170322-v7
IBM Welcome & Cognitive Future
05/02/2023 2© IBM UPWard 2016
05/02/2023 3© IBM UPWard 2016
05/02/2023 4© IBM UPWard 2016
05/02/2023 5
IBM Research, Patents, Data, Cognitive
© IBM UPWard 2016
05/02/2023 6© IBM UPWard 2016
MachineLearning
NaturalLanguageProcessing
HighPerformanceComputing
KnowledgeRepresentationand Reasoning
QuestionAnswering
UnstructuredInformation
05/02/2023 Understanding Cognitive Systems 8
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
9
Brief History of AI
• 1956 – Dartmouth Conference• 1956 – 1981 Micro-Worlds• 1981 – Japanese 5th Generation• 1988 – Expert Systems Peak• 1990 – AI Winter• 1997 – Deep Blue• 1997 – 2011 Real-World• 2011 – Jeopardy! & SIRI• 2013 – Cognitive Systems Institute• 2014 – Watson Business Unit &• True North Brain Chip• 2015 – “Cognition as a Service”
on IBM Bluemix
Definitions: AI vs IA
05/02/2023 © IBM UPWard 2016 10
AI is Artificial Intelligence, orintelligence in machines (smart machines)
IA is Intelligence Augmentation, orpeople thinking and working together with smart machines.
IA is what IBM calls “Cognitive Computing” andthe smart machines are called “Watson Solutions” or
more generally “Digital Cognitive Systems (Cogs)”
Cognition as a Service (CaaS): AI building blocks for IA solutions
Augmenting Workers
05/02/2023 Understanding Cognitive Systems 11
05/02/2023 Understanding Cognitive Systems 12
Startup Companies
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
13
Cognitive Mediatorsfor all people in all roles
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
14
Occupations = Many Tasks
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
15
Watson Discovery Advisor
Simonite, T. 2014. Software Mines Science Papers to Make New Discoveries. MIT. November 25, 2014.URL: http://m.technologyreview.com/news/520461/software-mines-science-papers-to-make-new-discoveries/
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
16
User Models
05/02/2023 17
$5M Prize
© IBM UPWard 2016
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
18
I have…
Have you noticed how the building blocks just keep getting better?
05/02/2023 19
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access
05/02/2023 20
Societal Grand Challenges
© IBM UPWard 2016
Solving these would mean we are smarter, but would they mean we are wiser?
05/02/2023 21© IBM UPWard 2016
05/02/2023 22
High School Senior: Anish Krishnan
© IBM UPWard 2016
IBM in Silicon Valley:From Punch Cards….
05/02/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
23
On August 22, 1943, 105 men, women and children, among them 43 IBM employees, alighted from a special train that carried them across the continent to establish new homes and the new IBM Card Manufacturing Plant Number 5 at 16th and St. John Streets, San Jose, CA.
05/02/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
24
IBM in Silicon Valley:To Brain Chips….
05/02/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
25
26
Cognitive Build
What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)• Imagine a digital cognitive system to help you do
something important in your personal or professional lives• Team to design it and advocate for it, and then everyone
votes• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
05/02/2023 Understanding Cognitive Systems 27
Types
• Tool• Assistant• Collaborator• Coach• Mediator
05/02/2023 Understanding Cognitive Systems 28
Types: Progression of models and capabilities
05/02/2023 Understanding Cognitive Systems 29
Task & World Model/Planning & Decisions
Self Model/Capacity & Limits
User Model/Episodic Memory
Institutions Model/Trust & Social Acts
Tool + - - -
Assistant ++ + - -
Collaborator +++ ++ + -
Coach ++++ +++ ++ +
Mediator +++++ ++++ +++ ++
tool assistant collaborator coach mediator
Build: 10 million minutes of experience
05/02/2023 Understanding Cognitive Systems 30
Build: 2 million minutes of experience
05/02/2023 Understanding Cognitive Systems 31
Build: Hardware < Software < Data < Experience < Transformation
05/02/2023 Understanding Cognitive Systems 32
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
33
I have…
Have you noticed how the building blocks just keep getting better?
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
34
Learning to program:My first program
Early Computer Science Class:Watson Center at Columbia 1945
Jim Spohrer’s First Program 1972
05/02/2023 35© IBM UPWard 2016
Fast Forward 2016:Consider this…
05/02/2023 36
Microsoft CaptionBot June 19, 2016
© IBM UPWard 2016
05/02/2023 37
Microsoft CaptionBot June 20, 2016
© IBM UPWard 2016
05/02/2023 38
IBM Image Tagging
© IBM UPWard 2016
05/02/2023 39
Courses• 2015
– “How to build a cognitive system for Q&A task.”– 9 months to 40% question answering accuracy– 1-2 years for 90% accuracy, which questions to reject
• 2025– “How to use a cognitive system to be a better professional X.”– Tools to build a student level Q&A from textbook in 1 week
• 2035– “How to use your cognitive mediator to build a startup.”– Tools to build faculty level Q&A for textbook in one day– Cognitive mediator knows a person better than they know themselves
• 2055– “How to manage your workforce of digital workers.”– Most people have 100 digital workers.
05/02/2023 40
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
41
What exists in 2016?
360,000 100,000 120,000 60,000 150,000
05/02/2023 Understanding Cognitive Systems 42
Partnership for AI formed
05/02/2023 43© IBM UPWard 2016
05/02/2023 44© IBM UPWard 2016
What might Reality 2.0 look like?
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
45
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
46
05/02/2023 47
How fast is Reality 2.0 approaching?
What might it look like?
48
Computing: Then, Now, Projected
05/02/2023
2035
2055
“The best way to predict the future is to inspire the next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
05/02/2023 50
By 2035, T-Shaped Makers with great Building Blocks and Cognitive Mediators
Empathy & Teamwork
sectorregion/culture
discipline Dept
h
Breadth
STEM
Liberal Arts
05/02/2023 51
Reality 2.0 Service Platform:polite cognitive mediators (CM1,CM2)
do not interrupt people (P1,P2)
© IBM UPWard 2016
Service Platform
CM2
P2
CM1
P1
100x
100x 100x
05/02/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
52
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
53
Wise Service System:All entities’ in networkuse cognitive mediatorsto enhance value co-creation interactions
Cognitive Mediators:Cognitive systems with deep knowledge of both customer (user) and provider (expert)as co-creators of win-win value
Entity augmentation boosts both creativity and productivity of interactions
05/02/2023 54
Two assertions
• Machines seem to be getting smarter fast.
– Agree/disagree?
• People do not seem to be getting wiser fast.
– Agree/disagree?
© IBM UPWard 2016
Homo Sapiens means Wise Man: True/False?
05/02/2023 55
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access
05/02/2023 56
What is Industry 4.0?
© IBM UPWard 2016
05/02/2023 57
History of the idea: Mirror Worlds
© IBM UPWard 2016
05/02/2023 58© IBM UPWard 2016
Why is this relevant?
05/02/2023 59
I am still very skeptical… but tell me more….
© IBM UPWard 2016
05/02/2023 60© IBM UPWard 2016
05/02/2023 61
Managers: Courage Required….
© IBM UPWard 2016
05/02/2023 62
Talent required, but…
© IBM UPWard 2016
05/02/2023 63
Industry 4.0
© IBM UPWard 2016
05/02/2023 64
CyberPhysical Systems?
© IBM UPWard 2016
05/02/2023 65
Industry 4.0
© IBM UPWard 2016
05/02/2023 66© IBM UPWard 2016
05/02/2023 67© IBM UPWard 2016
Yesterday: Servitization
• Rolls Royce: “Power By The Hour”
Tomorrow: Servitization• Start with any traditional product that is sold to customers• Make the product part of a smart/wise service system
– Instrument it (sensors) – Internet of Things/Everything– Set-up an intelligent operation center to monitor all products’ performance
across their life-cycles– Use big data analytics to determine how to improve product performance,
efficiency, maintenance, etc.– Offer customer the “product-performance-as-a-service” with
financing/Internet of Service– Customer benefits from cost-savings, predictability– Provider benefits margin-improvements, predictability
• Every product becomes a platform technology (a vehicle for service innovation) for innovative university startups
Vision: MMaaRRSS
• Modular Manufacturing as a Regional Recirculation Service System– “I am the stuff that will be made into product X for
customer Y.”– Stuff = Material, Energy, and Information Flows – Minimize transport costs (for products and waste)
• The Vision: Circular Economy (~4 minutes)
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
71
In Summary
“A service scienceperspective considersthe evolving ecology of service system entities, their value co-creation andcapability co-elevationinteractions, and their capabilities, constraints,rights, and responsibilities.”
Cognitive SystemsEntities
Service SystemsEntities With
CognitiveMediators
Add Rights &Responsibilities
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
72
Explain external phenomena
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
73
Explain internal phenomena
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
74
Explainvalue co-creationphenomena
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
75
Physics Chemistry Biology
Neuroscience Psychology ArtificialIntelligence
Engineering Management PublicPolicy
Education Design Humanities
Natural Systems
Cognitive Systems
Service Systems
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
76
Sciences provide…• Frameworks for people to ask and answer
questions systematically• Explanations with instructions on “how to re-do”
Kline: Conceptual Foundation of Multidisciplinary Thinking -“To our children and children’s children, to whom we elders owe an explanation of the worldthat is understandable, realistic, forward-looking, and whole.”
Proenneke:Alone in the Wilderness -To do a thorough testing, should each generationbe required to rapidly rebuildfrom scratch? A re-makers movement?
Some paths to becoming 64x smarter:Improving learning and performance
• 2x from Learning sciences (methods)– Better models of concepts – Better models of learners
• 2x from Learning technology (tools)– Guided learning paths– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)– More you know, faster you go– Advanced organizers
• 2x from Lifelong learning (time)– Longer lives and longer careers– Keeps “learning-mode” activated
• 2x from Early learning (time)– Start earlier: Challenged-based approach– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)– Technology & Infrastructure Interactions– Organizations & Others Interactions
Next Generation:Future-Ready T-Shaped Adaptive Innovators
Many disciplinesMany sectors
Many regions/cultures(understanding & communications)
Deep in one sector
Deep in one region/culture
Deep in one discipline
05/02/2023 79
Future-Ready T-Shapes
© IBM UPWard 2016
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
80
Brief History of AI
• 1956 – Dartmouth Conference• 1956 – 1981 Micro-Worlds• 1981 – Japanese 5th Generation• 1988 – Expert Systems Peak• 1990 – AI Winter• 1997 – Deep Blue• 1997 – 2011 Real-World• 2011 – Jeopardy! & SIRI• 2013 – Cognitive Systems Institute• 2014 – Watson Business Unit &• True North Brain Chip• 2015 – “Cognition as a Service”
on IBM Bluemix
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
81
Cognitive Assistants for all occupations are beginning to appear
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
82
The Maker Movement & Open Source Ecology
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
83
Future of Skills
05/02/2023 84
T-Shaped “Future Ready” Talent
© IBM UPWard 2016
05/02/2023 85© IBM UPWard 2016
CSIG
Assisting individuals and organizations to close their service innovation skills gap
and co-create wiser service systems empowering employees, customers, citizens
with cognitive mediatorsin the collaborative service economy
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
87
Dedication: Doug EngelbartFather of the mouse and
augmentation theory
05/02/2023 88
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
05/02/2023 89
But this stuff is still really hard…
© IBM UPWard 2016
“The best way to predict the future is to inspire the next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
91
05/02/2023 Understanding Cognitive Systems 92
Cyber-Social-Learning-Systems
Jim Spohrer (IBM)August 29, 2016
http://www.slideshare.net/spohrer/csls-20160821-v1
05/02/2023 Understanding Cognitive Systems 93
Today’s Talk: Cyber-Social-Learning-Systems• What is the impact of Artificial Intelligence (AI) on CSLS?– Augmented Intelligence (IA) via digital cognitive systems– White House OSTP Response(s)
• Other topics to think about:– What are more of the implications of digital cognitive systems?
• Tool > Assistant > Collaborator > Coach > Mediator• Transformation > Experience > Data > Software > Hardware
– What does social intelligence require? Episodic Memory?– What is the impact of augmented reality on CSLS?– What are possible connections to service systems science
(SSME+DAPP)?– What type of adaptive innovator with growth mindset needed (T-
shapes)?
05/02/2023 Understanding Cognitive Systems 94
Augmented Intelligence
• Tool• Assistant•
Collaborator
• Coach• Mediator
05/02/2023 Understanding Cognitive Systems 95
White House OSTP Response(s)
• AI for public good• Social & economic implications• Education to harness AI• Research questions and gaps• Data sets and model sets• Multidisciplinary research• Role of incentives and prizes• Safety and control protocols• Legal and governance issues
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
96
In Summary
“A service scienceperspective considersthe evolving ecology of service system entities, their value co-creation andcapability co-elevationinteractions, and their capabilities, constraints,rights, and responsibilities.”
Cognitive SystemsEntities
Service SystemsEntities With
CognitiveMediators
Add Rights &Responsibilities
05/02/2023 Understanding Cognitive Systems 97
Backup Slides
• Understanding Cognitive Systems
05/02/2023 Understanding Cognitive Systems 98
Understanding Cognitive SystemsJim Spohrer (IBM), August 25, 2016
CSIG (Cognitive Systems Institute Group) Speaker Serieshttp://www.slideshare.net/spohrer/
understanding_20160825_v3
05/02/2023 Understanding Cognitive Systems 99
Today’s Talk: Understanding Cognitive Systems• What is a cognitive system (entity)?– biological– technological– types of digital cognitive systems
• How to…– build them?– understand them?– work with them?
• Steps toward a next generation cognitive curriculum…
05/02/2023 Understanding Cognitive Systems 100
But first…. Cognitive Science, a young field
• Society– cognitivesciencesociety.org
• People– Founders: Roger Schank, Donald Norman,
Allan Collins– Others: David Rumelhart, Herbert Simon, Allen
Newell– Today: Patrick Langley, Wayne Gray, Kenneth
Forbus, Ashok Goel, Paul Maglio, etc.• Systems Conference
– cogsys.org– (JCS wishes this was part of HICSS)
05/02/2023 Understanding Cognitive Systems 101
Advances in Cognitive Systems - cogsys.org
05/02/2023 Understanding Cognitive Systems 102
Google Search: August 26, 2016
05/02/2023 Understanding Cognitive Systems 103
Today’s Talk: Understanding Cognitive Systems• What is a cognitive system (entity)?– biological– technological– types of digital cognitive systems
• How to…– build them?– understand them?– work with them?
• Steps toward a next generation cognitive curriculum…
05/02/2023 Understanding Cognitive Systems 104
What is a cognitive system (entity)?
05/02/2023 Understanding Cognitive Systems 105
What is a digital cognitive system (entity)?
05/02/2023 Understanding Cognitive Systems 106
What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)– Imagine a digital cognitive system to help you do something
important in your personal or professional lives– Team to design it and advocate for it, and then everyone
votes– Winners: reduce waste and human suffering, screen for health
issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
05/02/2023 Understanding Cognitive Systems 107
Types
• Tool• Assistant•
Collaborator
• Coach• Mediator
05/02/2023 Understanding Cognitive Systems 108
Types: Progression of models and capabilities
Task & World Model/Planning & Decisions
Self Model/Capacity & Limits
User Model/Episodic Memory
Institutions Model/Trust & Social Acts
Tool + - - -Assistant ++ + - -Collaborator +++ ++ + -Coach ++++ +++ ++ +Mediator +++++ ++++ +++ ++
05/02/2023 Understanding Cognitive Systems 109
Build: 10 million minutes of experience
05/02/2023 Understanding Cognitive Systems 110
Build: 2 million minutes of experience
05/02/2023 Understanding Cognitive Systems 111
Build: Hardware < Software < Data < Experience
05/02/2023 Understanding Cognitive Systems 112
Understand them…
05/02/2023 Understanding Cognitive Systems 113
Work with…
05/02/2023 Understanding Cognitive Systems 114
Next generation cognitive curriculum
05/02/2023 Understanding Cognitive Systems 115
Backup slides
• Service systems - http://service-science.info/archives/3368
05/02/2023 Understanding Cognitive Systems 116
What is service science?
• IBM initiated effort to establish a multidisciplinary field to study service systems … with a focus on people-centered, IT-enabled service innovations for business and society– based on service-dominant logic– service = value co-creation– IT-enabled service architectures– service systems (socio-technical systems for
win-win value co-creation)• IBM helped establish
– computer science (1945-present)– service science (2005-present)
Service systems are dynamic configurations ofresources (people, technology, organizations,and information) interconnected byvalue propositions, internally and externally.
Examples:- macro: cities, states, nations- meso: hospitals, universities, businesses- micro: households, families, individuals
Reference:Spohrer J, Maglio P, Bailey J, Gruhl D (2007) Steps toward a science of service systems. IEEE Computer Society. 40(3):71-77(January).
05/02/2023 Understanding Cognitive Systems 117
What is service science?
• Now over 500 universities globally teach a more multidisciplinary approach to service innovation, including:– Service management and marketing– Service engineering and operations– Service design and arts– Service public policy and economics– Service computing and informatics
• SSME + DAPP = Service Science Management Engineering + Design Arts Public Policy– People, technology, organizations, information
interconnected by value propositions.
Reference:IfM & IBM (2008). Succeeding through serviceinnovation: A service perspective for education,research, business and government. University of Cambridge Institute for Manufacturing, Cambridge, UK. 2008.
05/02/2023 Understanding Cognitive Systems 118
How to get involved?
• Weekly speaker series– Service innovation– Service education & research– Smart service/cognitive systems
• Discovery summits & book series• Opportunities
– Institutional memberships– Leadership & ambassadors– Volunteer opportunities– Awards & sponsored conferences
ISSIP.org is a non-profit societyInternational Society of Service Innovation Professionals
Membership:Over 1000 professionals and students from 40+ countries, 50+ companies and 50+ universities.
05/02/2023 Understanding Cognitive Systems 119
How to get involved?
• Journals (INFORMS, etc.)
• Conferences (HICSS, etc.)
• Courses (MIT, etc.)• Funding (NSF, etc.)• Society (ISSIP, etc.)
05/02/2023 Understanding Cognitive Systems 120
What are the hot topics?
• Smart Service Systems: Intelligence Augmentation– AI + AR UX (Artificial Intelligence + Augmented Reality User
Experience)– Smartphones (mobile, social, secure, etc.)
• Collaborative Economy: Servitization– From assets to co-creation (e.g., Uber, AirBnB, etc.)– From product to capability/outcome-as-a-service– Manufacturing as a local recycling service
• Digital Transformation: Trust and Identity– Blockchain: Don Tapscott’s TED Talk & book– Big Data: Service Analytics & HAT (Hub of All Things)
05/02/2023 Understanding Cognitive Systems 121
Backups
• T-shaped people
Some paths to becoming 64x smarter:Improving learning and performance
• 2x from Learning sciences (methods)– Better models of concepts – Better models of learners
• 2x from Learning technology (tools)– Guided learning paths– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)– More you know, faster you go– Advanced organizers
• 2x from Lifelong learning (time)– Longer lives and longer careers– Keeps “learning-mode” activated
• 2x from Early learning (time)– Start earlier: Challenged-based approach– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)– Technology & Infrastructure Interactions– Organizations & Others Interactions
Next Generation:Future-Ready T-Shaped Adaptive Innovators
Many disciplinesMany sectors
Many regions/cultures(understanding & communications)
Deep in one sector
Deep in one region/culture
Deep in one discipline
05/02/2023 124
Future-Ready T-Shapes
© IBM UPWard 2016
05/02/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
125
Cognitive Assistants for all occupations are beginning to appear
05/02/2023 126
IBM Research – AlmadenSan Jose, CA USA
© IBM UPWard 2016
05/02/2023 127© IBM UPWard 2016
05/02/2023 © IBM Upaward 2016 128
05/02/2023 129
From App to Agent
© IBM UPWard 2016
05/02/2023 130
CognitiveBuild
© IBM UPWard 2016
05/02/2023 131
My Quest
• What is the best bot that anyone can easily install on their smartphone and laptop today?
© IBM UPWard 2016
05/02/2023 132
30th Anniversary Celebration
© IBM UPWard 2016
05/02/2023 133
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access