+ All Categories
Home > Science > (Kpi summer school 2015) theano tutorial part2

(Kpi summer school 2015) theano tutorial part2

Date post: 22-Jan-2017
Category:
Upload: sergii-gavrylov
View: 718 times
Download: 3 times
Share this document with a friend
19
Theano tutorial part 2 AACIMP 2015 Sergii Gavrylov
Transcript

Theano tutorialpart 2

AACIMP 2015Sergii Gavrylov

Overview● Brief recap

● Multivariate logistic regression

● Multilayer perceptron

● Convolution

● Convolutional neural network

● scan

● Recurrent neural network

Brief recap● Symbolic variables

● Functions

● Shared variables / updates

● Gradients

● Substitution

Computational graphX

+

Z

Y

● Code generation

● Symbolic differentiation

Multivariate logistic regression

0

1

2

3

softmax(x * W)

Multilayer perceptron

0

1

2

3

relu(x * W) softmax(x * W)

1D Convolution

1D Convolution

1D Convolution

1D Convolution

2D Convolution

filter =

ConvPoolLayer

Convolutional NN

deeplearning.net/tutorial/lenet.html

scan (Symbolic loop in theano)

Recurrent neural network

www.iro.umontreal.ca/~bengioy/dlbook/rnn.html

“Vanilla” RNN

www.iro.umontreal.ca/~bengioy/dlbook/rnn.html

Conclusion

● Theano has a lot of useful building blocks (convolution, scan).

● Theano supports both cpu and gpu backends.


Recommended