Theano tutorial

Kyiv Deep Learning Study Group #5Sergii Gavrylov

Overview● Introduction

● Symbolic variables

● Functions

● Shared Variables

● Gradients

● Example

What is Theano?

● Python library

● Computer algebra system

● Compiler

Where to find more info?

● Website: deeplearning.net/software/theano

● User mailing list: groups.google.com/group/theano-users

● Deep learning tutorials: deeplearning.net/tutorial

Tutorial environment

1. Go to theano.grammarly.com:8080 to determine your

workspace name that you will use through this tutorial.

2. Go to theano.grammarly.com:8888 to use your workspace

3. password: youareflying

Scalar math

Symbolic variables

X

+

Z

Y

Symbolic variables

X

+

Z

Y

compilation add_fun(_ , _)

37, 5

42

Task scalars

Data types

Data types

Vector math

Matrix math

Task vectors_matrices

Shared variables

X

+

Z

Y

42

Shared variables

X

+

Z

Y

42

compilation add_fun(_)

1

43

Shared variables

Updates

Task shared_updates

Symbolic differentiation

Task grad

Task logistic_regression

Grammaticality vs

Acceptability

Grammaticality vs Acceptability

Adjective Noun

colourless ideas

interesting ideas

Grammaticality vs Acceptability

Adjective Noun

colourless ideas

interesting ideas

Grammaticality vs Acceptability

Adjective Noun

colourless ideas

interesting ideas

Approach

● Go through the text and gather all adjective noun pairs.

○ All this pairs are positive examples.

○ In order to generate a negative example take a valid pair and

replace the adjective with a randomly generated adjective.

● Build a classifier that will distinguish between negative and positive

examples.

Features

nlp.stanford.edu/projects/glove

Stanford GloVeVector dimensionality is 300

Conclusion

● Theano is a tool that combines the best of both worlds: it is easy

to code and fast to execute!

● It is used in both academia and industry.

● Symbolic paradigm is extremely flexible, but it might be not

suitable for everyone.