8/20/18
1
Machine Learning
StephanRobert|HEIG-Vd|SummerUniversity2018
Few good books (Not necessary to buy them, just download them. Free access)
8/20/18
2
Few good books (Not necessary to buy them, just download them. Free access)
• Machine Learning, Tom Mitchell• Machine Learning, Kevin Murphy
Web page and links... Lectureslidesandhandouts
Documentation,links,softwareresources
Announcementsandschedule
Email(labs)
Slidesathttp://www.stephan-robert.ch/teaching/machine-learning
8/20/18
3
… and links...
Kaggle.com(competitions,jobs,…)
Datascience.net
Python tutorials and books
docs.python.org/3/tutorial/index.html
wiki.python.org/moin/IntroductoryBooks
8/20/18
4
Python environment
Pythonrelease3.6
AnacondaNavigator(Jupyter,Ipython,Spyder,…)
Python libraries
Numpy
Pandas
Matplotlib
Scikit-learn
Scipy
8/20/18
5
Syllabus
Lesson1:IntroductiontoMachineLearning,GradientDescent(costfunction,manyvariables)
Lesson2:Linearregression,logisticregression
Lesson3:Supportvectormachines
Lesson4:Unsupervisedlearning(PCA,k-means,K-nearestneighbor,classification)
Homeworks
HW1:GradientDescent
HW2:Linearandlogisticregression
HW3:SupportVectorMachines
HW4:Unsupervisedlearning
8/20/18
6
Eachgroupofstudents(1-2studentspergroup)mustwritetheirowncodefortheprogrammingpart.Pleasedon’tsearchforanswersontheweb,Google,previousyears’homeworks,etc.D0n’tpostthemeither!
HW1,2,3:Groupoftwostudents(1fromSNU+1fromHEIG-Vd)
HW4:Individual
Homeworks
Grading
• 4homeworks
8/20/18
7
Machine Learning is changing the world
© Emily Fox
Few videos...
• NVIDIA Press Event at CES 2018https://www.youtube.com/watch?v=P3BjB5-Y4JM
8/20/18
8
What is Machine Learning?
• Study of algorithms that improve their performances at some tasks with experience
Supervised learning
• Knowledgeofoutput
Learningwiththepresenceofanexpert(e.g.SupportVectorMachines,DecisionTrees,NeuralNetworks,BayesianClassifiers,…)
8/20/18
9
ExampleofhousespricesinLausanne
House price prediction Supervised learning: regression
House price prediction Supervised learning
8/20/18
10
House price prediction Supervised learning
House price prediction Supervised learning
8/20/18
11
Spam filtering Supervised learning: classification
NotSpamTextofemail,IPSource,… Spam
input output
Other examples Supervised learning: classification
• Sentimentanalysis• Personalizedmedicaldiagnosis(multiple
outputs:flu,healthy,…)
8/20/18
12
Stock prediction Supervised learning
Depends on recent historyof stock market, newsevents,…
(Vodafone)
Unsupervised learning
• NoKnowledgeofoutput
Learningwithoutthepresenceofanexpert(e.gk-means,clusteringapproaches,…)
8/20/18
13
Unsupervised learning
news.google.com
Unsupervised learning
Clusteringimages,groupas:
• Clouds• Mountains• Roads
8/20/18
14
Unsupervised learning
Otherexamples
• UsersonWebsites(groups,activities)• Words(Firstnames,lastnames,location
words,…)