Today
empowerment
Microsoft Surface
Every Surface includes a touchscreen for fast, intuitive navigation — with more power, battery life and portability for life on the move.
https://www.microsoft.com/en-us/surface
Tomorrow
empowerment
Transformative technologies
Mixed Reality, Machine Learning, and Quantum Inspired Optimization
“We want to democratize AI to
amplify human ingenuity”
MSR Beijing
MSR Cambridge
MSR Redmond MSR MontrealMSR New England
MSR New York
Fueled by Microsoft breakthrough research
96% on RESNET vision test
94.9% on Switchboard test
89.4% on Stanford CoQA test
69.9% with MT Research system
39.5 Teraflops with Intel Stratix 10
MSR India
MSR Shanghai
Machine translation
human parityObject detection
human parity
Switchboard
Switchboard cellular
Meeting speech
IBM Switchboard
Broadcast speech
Speech recognition
human parity
Conversational Q&A
human parity
First FPGA deployed
in a datacenter
Envision, create, prototype, solve,
lead on questions, challenges, and
possibilities
Short-term, immediate, tangible
impact to products and business
Curiosity-driven research Deployment-driven research
ProductiveAny language, any developer, any skill level
Built for enterprisesOptimized to work at any scale with existing systems & processes
TrustedYou own and control your data
Our investment principles
Happiness
Meaningful
Innovation
Empowering
PeopleResponsible AI
Meaningful
Innovation
https://www.microsoft.com/en-us/ai/seeing-ai
AI for Accessibility
‘COVID-19 Knowledge Miner’Latest news and research at your fingertips
How do you stay up to date and cut through the noise, when
information is constantly evolving from infinite sources? Maybe
we can help.
For doctors and researchers, we are providing you with
complimentary access to a continuously updated aggregation
of COVID-19 data news and research, with a simplified and
intelligent search experience.
55
countries
active
50k
searches
per week
2x
users per
week
Additional resources: https://aka.ms/COVID19information
Reference #1
• Customer: HUS
• Customer Country: Finland
• Released: 13/03/2020
• Partner: Tieto Every
• Url: https://www.terveyskyla.fi/
Reference #2:
• Customer: Region Hovedstaden
• Customer Country: Denmark
• Released : 14/03/2020
• Partners: Proactive
• Url: http://1813.dk/
Reference #3:
• Customer: HSE
• Customer Country: Ireland
• Released : March 18/03/2020
• Partner: pTools
• Url:
https://www2.hse.ie/coronavirus/
Healthbot Service Covid-19
Happiness
Meaningful
Innovation
Empowering
PeopleResponsible AI
Empowering
People
AI in productivity enablement
Guided process management Factory assistant
Remote assist Knowledge management
Happiness
Responsible AI
PracticesPrinciples Tools
AETHER committee
The Partnership on AI
Guidelines for Human-AI Design
Homomorphic Encryption
Interpret ML
Differential Privacy
Data Drift
Secure MPC
Guidelines for Conversational AI
Fairness
Reliability
Privacy
Inclusivity
Accountability
Transparency
Transparency
People should be able to
understand how AI systems
make decisions, especially when
those decisions impact people’s
lives
Example: Cardiovascular disease risk score
Happiness
Meaningful
Innovation
Empowering
PeopleResponsible AI
AI Business School
FOR CUSTOMERS, PARTNERS, AND MICROSOFT EMPLOYEES
https://www.microsoft.com/en-us/ai/ai-business-school
AI for
Accessibility
AI for
Earth
AI for
Humanitarian
Action
AI for
Cultural
Heritage
AI for
Health
Make Your Application More Human with AI and Cognitive Services
Microsoft webinar, 20-05-2020, Donald Hessing
Twitter: @dhessing
Linkedin: https://www.linkedin.com/in/donaldhessing
©2019 Idean Proprietary and confidential©2020 CapgeminiRFP Global Website DevOps Partner
Donald Hessing
Digital Customer Experience Lead Microsoft
Microsoft Certified Master (MCM)
Programme Chair | European SharePoint, O365 and Azure Conference
@dhessing
Agenda
Introduction to Cognitive Services
Q&A
Wrap-up
Knoweldge Mining through Cognitive Services
DEMOS
Bring AI to every Application
Adding humanlike
capabilities to appsVision, Speech and Prediction
30© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Cognitive Services
Broad range of advanced capabilities
Cognitive Solutions
8
1
2
3
4
5
6
7
Classification Modelsgrouping data into segments for better understanding of hierarchical relations,
e.g. automated system for financial documents classification
Predictive Modelling predicting occurrences of certain categories of events, e.g. type and volume of future incidents, complaint probability based on ticket handling process
Bot trainingChat bot machine learning - training to automatically improve user intent recognition
IoT insights & decisionsmanaging automatically huge amount of data coming from IoT devices for intelligent purposes e.g. office space utilisation management
Computer visiongaining high-level understanding from digital images or videos. image recognition, e.g. recognize error type from a screenshot, face
recognition, e.g. biometric user identification
Text mining & text analyticsmining and analysing text data to discover
patterns, extract useful knowledge, and support decision making e.g. identify
automation use cases, sentiment analysis
Natural Language Processing (NLP)voice/text understanding in natural language
e.g. Virtual Assistant (Chat/Voice bot)
Speech recognitionrecognition and translation of spoken
language into text, e.g. Alexa, Siri, Cortana
MachineLearning
CognitiveThinking
These capabilities can be mixed
in different combinations to
create a cognitive solution
31© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Humanlike
EntitiesPersons“Anita Christiansen”,“Conrad Nuber”,
Locations“Bothell”, “Woodinville”
Organization“Litware Insurance Corp.”
32© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Vision
Face
Detects and recognizes faces in images
27 attributes (Age, Emotion, Gender)
Trainable - matching private people collection
Computer Vision
Identify 10.000 objects
Detect handwritten text
Landmarks, brands, printed text
Ink Recognizer
Recognition of hand written words and shapes
Ink strokes to text
Form Recognizer
Identify and extract key/value pairs from forms
and receipts
Custom Vision
Build, deploy, and improve your own image classifiers.
Image classification and object detection
Video Indexer
Not a cognitive skill, but service that brings the
cognitive services together (Vision, Language, Speech)
33© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Computer Vision
34© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Face API
Detect human faces in an image including
age, emotion, gender, pose, smile, and facial
hair, along with 27 landmarks for each face in the image.
Face API enables you to search, identify, and
match faces in your private repository of up to 1 million people
Easily find similar-looking faces. Given a collection of faces and a new face as a query, this API will return a collection of similar
faces.
Organize many unidentified faces
together into groups, based on their visual
similarity.
Face identification Similar face search Face groupingFace detection
35© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Custom Vision
Adapting Computer Vision models with your own data
36© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Two key scenario’s
Source: https://www.datacamp.com/community/tutorials/object-detection-guide
37© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Use Cases
38© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Speech Service
...
Text to Speech
Standard and Neural Voices
Custom Neural Voices (new)
Custom Voices
Speech to Text
Transcription
Conversation Transcription
Custom model with O365 data
Speaker Recognition
Speaker Identification
Speaker Verification
Speech Translation
Language Detection
Real Time Translation
Speech SDK Devices SDK AI Containers Languages Voice Models
39© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Microsoft TranslatorBreaking language & communication barriers
40© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Speech Translation
41© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Custom speech domain model
Transcription.txt (audio + human transcript)b0046.wav Herrerasaurus lived in late Triassic and was hugeb0047.wav Noasaurus is another species of that period and it was up to 8 feet longb0048.wav Noasaurus lived in late Cretaceous periodb0049.wav Staurikosaurus became extinct in late Triassic period
Testing and Training
42© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Benefits for Call Centers Artificial Intelligence (AI) will
handle 15% of all customer
interactions by 2021*
* Gartner 2018
What are the strategic benefits of implementing call center automation solutions?
✓ Reduced customer friction
✓ Lower operational Costs
✓ Streamlined processes
✓ Better customers insights & predictions
✓ Highly efficient use of service agent’s time
43© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Call and Service Center use cases
Store reviews and correlated
purchases in Cosmos DB
Use Text Analytics to
extract
sentiment/known
entities & phrases
Use Speech-to-Text
to transcribe calls
Chatbot
PowerBIMetrics:
“Top words mentioned”
“Analysis of Emotion”
“Positive vs. Negative”
“Hourly Updates”
“What’s Trending”
Call Logs
Live Agents
Translate
(as needed)
Purchase
DB
Company Web Site
&
Social Media
Platforms
Use Content Moderator
to remove profanity or
inappropriate
comments
Operations Dashboard
Azure Logic Apps
✓ Analyze Trends
✓ Sharpen Marketing Focus
✓ Recommend Agent Training
44© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Language
Language Understanding (LUIS)
Understands user goal (intent)
Extracts entities from sentences
Support 12 languages, pre-built entity dictionaries
Immersive Reader (Preview)
Text reading and comprehension capabilities
Already used by 15M people
Translation of 60 languages
Text Analytics
Detect sentiment, key phrases, named entities
and langue from text
Translator Text
Machine translation of 60+ languages
Support custom models to reflect custom domain
terminology
QnA Maker
Build a Question and Answer Knowledge base
Extract QnA Pairs from external sources
45© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Text Analytics
Key Phrases
Sentiment
Entity Linking
Bing Entity Search
46© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Use Cases
47© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
QNA Maker
I want to buy a ticket for the European
SharePoint Conference
Where can i buy an ESPC Conference
ticket?
I want to attend the European SharePoint
Conference
What are the ticket packages for ESPC?
Can I purchase a ticket online?
48© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Multi-Turn QNA Maker
PersonalizationPowered with Azure Cognitive Services for advantaged knowledge mining
50© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Reinforcement Learning
Action 2 Info
Action 3 Info
User & Context Info
Action 1 info
Reward Score
aka.ms/personalizerdemo
51© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Personalization patterns
Discovery Pattern and Causality
Expoit versus Explore
Exploit
“Exploit”= use
“Explore”
Explore
52© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Use Cases
53© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
DEMOS
Custom Vision
Speech domain model
Personalizer
Azure Search
Azure SearchPowered with Azure Cognitive Services for advantaged knowledge mining
55© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
80%of business relevant information is unstructured
56© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
…
57© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Azure Search + Cognitive Services
Information Pre-trained ML Models Fully text-searchable rich
index
INGEST ENRICH EXPLORE
Form 5471
58© Capgemini 2020. All rights reserved |Presentation Title | Author | Date
Use Cases
Knowledge mining, custom classifiers, image libraries, brand management, ...
59© Capgemini 2020. All rights reserved |
Wrap Up
60© Capgemini 2020. All rights reserved |
Capgemini recently presented the purpose and use cases of making your applications more human by using pre-trained AI. Keynote speaker Donald Hessing highlighted a broad number of use cases with endless scenarios and opportunities.
You are welcome to join our deep dive sessions to explore your specific use cases and desired business outcomes. These would be 1:1 sessions with you and your key stakeholders from your organization, Capgemini and Microsoft. Our deep dives are a 3 step approach to co-create your business case and proof of concept by using pre-trained AI models in our lab.
Our Approach
➢ Identify use cases and desired business outcomes driven by pre-built AI
➢ Learn to apply pre-trained AI in your applications and provide a more detailed architecture
➢ Co-create with Capgemini and Microsoft experts and build a holistic proof of concept by creating a business case and technical validation in our lab
1
2
3
Deep Dive Session – Define uses cases and build a proof of concept in our lab
Registration Form
First Name:Last Name:Job Title:Company:Email:
Our Team in the deep dives
Donald HessingCapgeminiPrincipal ConsultantMicrosoft Lead Architect, DCX
Gerard JongsmaCapgeminiDigital Transformation ExpertCapgemini Digital CoE
61© Capgemini 2020. All rights reserved |
Questions?
Capgemini is a global leader in consulting, digital transformation, technologyand engineering services. The Group is at the forefront of innovation to addressthe entire breadth of clients’ opportunities in the evolving world of cloud, digitaland platforms. Building on its strong 50-year+ heritage and deep industry-specific expertise, Capgemini enables organizations to realize their businessambitions through an array of services from strategy to operations. Capgeminiis driven by the conviction that the business value of technology comes fromand through people. Today, it is a multicultural company of 270,000 teammembers in almost 50 countries. With Altran, the Group reported 2019combined revenues of €17 billion.
About Capgemini
Learn more about us at
www.capgemini.com
This presentation contains information that may be privileged or confidential and is the property of the Capgemini Group.
Copyright © 2020 Capgemini. All rights reserved.