+ All Categories
Home > Documents > Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and...

Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and...

Date post: 20-May-2020
Category:
Upload: others
View: 6 times
Download: 4 times
Share this document with a friend
44
Machine Learning at Google Scale ML APIs and TensorFlow
Transcript
Page 1: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Machine Learning at Google ScaleML APIs and TensorFlow

Page 2: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Michel Pereira

Google Cloud Customer Engineer

@michelpereira@

Page 3: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

What is Neural Network and Deep Learning

Page 4: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Neural Network is a function that can learn

Page 5: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural
Page 6: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

How about this?

Page 7: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

More hidden layers = More hierarchies of features

Page 8: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

How about this?

Page 9: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural
Page 10: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

We need to go deeper neural network

From: Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations, Honglak Lee et al.

Page 11: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Machine Learning use casesat Google services

Page 12: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

12

signalfor Search ranking,

out of hundreds

improvementto ranking quality

in 2+ years

#3 #1

Search

machine learning for search engines

RankBrain: a deep neural network for search ranking

Page 13: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

13

[glacier]

Google Photos

13

Page 14: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

14

Smart reply in Inbox by Gmail

10%of all responses sent on mobile

Page 15: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Google Translate with Neural Machine Translation

Page 16: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

16

AndroidAppsGmailMapsPhotosSpeechSearchTranslationYouTubeand many others ...

Used across products:

2012 2013 2014 2015

Deep Learning usage at Google

Page 17: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Externalizing the powerwith ML APIs

Page 18: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

TensorFlow Cloud Machine Learning ML API

Easy-to-Use, for non-ML engineers

Customizable, for Data Scientists

Machine Learning products from Google

Page 19: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Image analysis with pre-trained models

No Machine Learning skill required

REST API: receives an image and returns a JSON

$1.50 per 1,000 units

GA - cloud.google.com/vision

Cloud Vision API

Page 20: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Confidential & ProprietaryGoogle Cloud Platform 20

FacesFaces, facial landmarks, emotions

OCRRead and extract text, with support for > 10 languages

LabelDetect entities from furniture to transportation

LogosIdentify product logos

Landmarks & Image PropertiesDetect landmarks & dominant color of image

Safe SearchDetect explicit content - adult, violent, medical and spoof

Page 21: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

2121

Demo

Page 22: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Pre-trained models. No ML skill required

REST API: receives audio and returns texts

Supports 80+ languages

Streaming or non-streaming

Public Beta - cloud.google.com/speech

Cloud Speech API

Page 23: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Confidential & ProprietaryGoogle Cloud Platform 23

Features

Automatic Speech Recognition (ASR) powered by deep learning neural networking to power your applications like voice search or speech transcription.

Recognizes over 80 languages and variants with an extensive vocabulary.

Returns partial recognition results immediately, as they become available.

Filter inappropriate content in text results.

Audio input can be captured by an application’s microphone or sent from a pre-recorded audio file. Multiple audio file formats are supported, including FLAC, AMR, PCMU and linear-16.

Handles noisy audio from many environments without requiring additional noise cancellation.

Audio files can be uploaded in the request and, in future releases, integrated with Google Cloud Storage.

Automatic Speech Recognition Global Vocabulary Inappropriate Content Filtering

Streaming Recognition

Real-time or Buffered Audio Support Noisy Audio Handling Integrated API

Page 24: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

2424

Demo

Page 25: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Pre-trained models. No ML skill required

REST API: receives text and returns analysis results

Supports English, Spanish and Japanese

GA - cloud.google.com/natural-language

Cloud Natural Language API

Page 26: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Confidential & ProprietaryGoogle Cloud Platform 26

Features

Extract sentence, identify parts of speech and create dependency parse trees for each sentence.

Identify entities and label by types such as person, organization, location, events, products and media.

Understand the overall sentiment of a block of text.

Syntax Analysis Entity Recognition

Sentiment Analysis

Page 27: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

2727

Demo

Page 28: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Pre-trained models. No ML skill required

REST API: receives text and returns translated text

8 languages: English to Chinese, French, German, Japanese, Korean, Portuguese, Spanish, Turkish

Public Beta - cloud.google.com/translate

Cloud Translation API Premium

Page 29: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

2929

Demo

Page 30: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Video analysis with pre-trained models

No Machine Learning skill required

REST API: receives a video and returns a JSON

Private Beta - cloud.google.com/video-intelligence

Cloud Video Intelligence API

Page 31: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

3131

Demo

Page 32: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

TensorFlow:An open source library forMachine Intelligence

Page 33: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Google's open source library for

machine intelligence

tensorflow.org launched in Nov 2015

Used by many production ML projects

What is TensorFlow?

Page 34: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

# define the networkimport tensorflow as tfx = tf.placeholder(tf.float32, [None, 784])W = tf.Variable(tf.zeros([784, 10]))b = tf.Variable(tf.zeros([10]))y = tf.nn.softmax(tf.matmul(x, W) + b)

# define a training stepy_ = tf.placeholder(tf.float32, [None, 10])xent = -tf.reduce_sum(y_*tf.log(y))step = tf.train.GradientDescentOptimizer(0.01).minimize(xent)

Page 35: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

TensorBoard: visualization tool

Page 36: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Portable and ScalableTraining on:

Mac/Windows

GPU server

GPU cluster / Cloud

Prediction on:

Android and iOS

RasPi and TPU

Page 37: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Sharing our tools with researchers and developers around the world

repositoryfor “machine learning”

category on GitHub

#1

Released in Nov. 2015

From: http://deliprao.com/archives/168

Page 38: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

TensorFlow community and ecosystem

Page 39: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

From: https://www.qualcomm.com/news/snapdragon/2017/01/09/tensorflow-machine-learning-now-optimized-snapdragon-835-and-hexagon-682

Page 40: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural
Page 41: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Enterprise

Google Cloud is

The Datacenter as a Computer

Page 42: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

<OnBoard>

//Participe do treinamento sobre os fundamentos de Cloud e conheça as novas tecnologias da nuvem do Google.

//Google Cloud OnBoard é para desenvolvedores, programadores e especialistas em TI. Aprimore-se com os melhores instrutores do Google.

//Entre em goo.gl/cWXaaE e cadastre-se para receber mais informações.

Agenda(2_de_junho)Local(Google_Campus_SP)+6_cidades_BR

</OnBoard>

Page 43: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

goo.gl/cWXaaE

Page 44: Machine Learning at Google Scale - QConSP · Machine Learning at Google Scale ML APIs and TensorFlow. Michel Pereira Google Cloud Customer Engineer @michelpereira@ What is Neural

Thank you!


Recommended