Microsoft Cognitive

Services Updates

Ted Way, PhD

Senior PM, Azure ML

tedway@microsoft.com

Unlock valuable

information lying latent

in all your content

Your business documents

Form

5471

Information Cutting-edge AI Fully text-searchable

rich index

Form 5471

Scott Guthrie

TIFF HTML

…

JPG

INGEST

Data in any

format, any

Azure store

ENRICH EXPLORE

Annotation

s

Cognitive

skills

Searc

h

management free

keyword search

faceting

language analyzers

geospatial support

suggestions/auto-complete

customizable scoring

proximity search

synonyms

cognitive search

etc.

Information Cutting-edge AI Fully text-searchable

rich index

Form 5471

INGEST ENRICH EXPLORE

Enriched

Documents

Source

Data

Search Index

INGEST ENRICH EXPLORE

Faster Performance! 30X Faster

Support of Complex Data

Types

Extend that types of

data that can be stored

and searched

New Skills

Create conditional &

shaper skills

New entity recognition

skill

HowdenChris van Ravenswaay

Global Business Solutions Manager

Centrifugal fan Axial fan Rotary heat exchanger

Compressor Cooling fan Steam turbine

Digital solutions

Special & local products

Ingesting

Searchable

Specifications

Reuse of Previous

Work &

Comments

Collaboration &

Feedback

RFP

Documents

Printed text

recognition

RFP Feedback

Application

Azure Blob

Storage

Web AppAzure Search

Search

Index

Cosmos DB

Comments &

Metadata

Engineering

Standards

Extraction

Metadata

Extraction

Risks

Extraction

Key phrase

extraction

Organization

Entity

Extraction

Built-in skills

Location entity extraction

Persons entity extraction

Celebrity recognition

Landmark detection

Sentiment analysis

Language detection

Image tag extraction

Printed text recognition

Key Phrase extraction

Organization entity extraction

Face detection

Text Utilities Azure Databricks

Machine LearningVMs

Azure Machine Learning

Custom skills

Your custom

skill goes here!

https

Speaker

rating skill

{

"values": [

{

"recordId": "7cad2",

"data":

{

"value1":

“Cindy Noteboom“

}

},

{

"recordId": "7cad3",

"data":

{

"value1":

“Elad Ziklik"

}

},

…

]

}

{

"values": [

{

"recordId": "7cad2",

"data":

{

"myOutput1":

“Awesome speaker"

}

},

{

"recordId": "7cad3",

"data":

{

"myOutput1":

“Fun but a bit weird"

}

},

…

]

}

Azure

FunctionsThe easiest

way to host

your custom

skillAzure

Function

Your custom

skill code

MS Graph

Enricher

Speaker Email

Search Index

https

Baldness

detector

skill

{

"values": [

{

"recordId": "7cad2",

"data":

{

"value1":

“Cindy Noteboom“

}

},

{

"recordId": "7cad3",

"data":

{

"value1":

“Elad Ziklik"

}

},

…

]

}

{

"values": [

{

"recordId": "7cad2",

"data":

{

"myOutput1":

“Absolutely not bald"

}

},

{

"recordId": "7cad3",

"data":

{

"myOutput1":

“Definitely getting there"

}

},

…

]

}

MS Graph

Enricher

Speaker Email

Face API

Shaper SkillSearch Index

OBJECT{

"region": "US",

"manager": {

"age": 30,

"name": {

"first": "John",

"last": "Smith"

}

}

}

NESTED{

"group": "fans",

"user": [

{

"first": "John",

"last": "Smith"

},

{

"first": "Alice",

"last": "White"

}

]

}

Enriched

Documents

Source

Data

Search Index

INGEST ENRICH EXPLORE

Knowledge Store

Projections

Enriched

Documents

Source

Data

Search Index