17
Performance EvaluationCourse Schedule
References
M1 Course - Performance Evaluation in Networks
Course : Eric THIERRYTD/TP : Dominique BARBE, Tien Nam LE
M1IF - ENS Lyon Performance Evaluation & Networks 1/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Performance Evaluation ?
Studying the performances of computer/communicationsystems/networks (but not only, e.g. transport networks, supplychains), with three complementary features :
observation
prediction
control/optimisationLégende :
Source Sortie
Noeud FIFOFlux
M1IF - ENS Lyon Performance Evaluation & Networks 2/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Systems / Performances
Systems :
architectures / hardware (micro-processors, PC clusters,supercomputers)
code / software (runtime, compilation)
communication networks (internet, telecom, embedded) /distributed systems
logistics, industrial processes, transport networks, ...
Performances :
�metrics� : speed, power, bandwidth, delay, load, losses ...
worst case, on average (under probabilistic hyp.), equity ...
M1IF - ENS Lyon Performance Evaluation & Networks 3/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Systems / Performances
Systems :
architectures / hardware (micro-processors, PC clusters,supercomputers)
code / software (runtime, compilation)
communication networks (internet, telecom, embedded) /distributed systems
logistics, industrial processes, transport networks, ...
Performances :
�metrics� : speed, power, bandwidth, delay, load, losses ...
worst case, on average (under probabilistic hyp.), equity ...
M1IF - ENS Lyon Performance Evaluation & Networks 3/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Studying the performances of a system
Investigation tools :
mathematical/numerical analysis of abstract models
simulation (math model, scale model)
experiments/measures on real system
}data analysis (statistics)
M1IF - ENS Lyon Performance Evaluation & Networks 4/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Studying the performances of a system
Investigation tools :
mathematical/numerical analysis of abstract models
simulation (math model, scale model)
experiments/measures on real system
}data analysis (statistics)
M1IF - ENS Lyon Performance Evaluation & Networks 4/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Studying the performances of a system
Investigation tools :
mathematical/numerical analysis of abstract models
simulation (math model, scale model)
experiments/measures on real system
}data analysis (statistics)
M1IF - ENS Lyon Performance Evaluation & Networks 4/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Reminder : the scienti�c method
ValidationObservations
Hypotheses / model
Predictions
Experiments
M1IF - ENS Lyon Performance Evaluation & Networks 5/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Course Objectives
Objectives :
designing and analysing mathematical models, in particularwith probabilistic assumptions
reinforcing knowledge about probabilistic/statistical tools
reinforcing knowledge about communication networks
practising simulation with a simulation software
practising statistics with a statistics software
Pre-requisite :
basics in Probability
knowledge about networks is good, but not essential
M1IF - ENS Lyon Performance Evaluation & Networks 6/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Why so many probabilities ?
Intrinsic randomness : real systems / math models whererandomness is desired or su�ered
The art of reasoning �à la louche� / �gross estimation� :quantifying frequent vs rare, rich bestiary of inequalities,probability in statistics.
Probabilistic/stochastic models : good in practice
M1IF - ENS Lyon Performance Evaluation & Networks 7/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Cloud of n experimental measures
Execution time of a task with regard to its size
Which information can be retrieved ?
Should we carry out more measures ?
M1IF - ENS Lyon Performance Evaluation & Networks 8/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Trajectories of n simulation runs
State of the system
Time
What can be deduced about the transitory/asymptoticbehavior of the system ?
Should we make the simulations last longer ?
M1IF - ENS Lyon Performance Evaluation & Networks 9/14
Performance EvaluationCourse Schedule
References
General frameworkCourse ObjectivesExamples
Analyzing a network of queues
Does the system risk overload ?
How long will I wait before being served ?
M1IF - ENS Lyon Performance Evaluation & Networks 10/14
Performance EvaluationCourse Schedule
References
ScheduleEvaluation / Information
Course topics
Probability basics ×1 or 2
Random generation & Simulation ×1 or 2
Queuing theory ×4 or 5
Statistics ×3 or 4
Measures in networks ×0 or 1
M1IF - ENS Lyon Performance Evaluation & Networks 11/14
Performance EvaluationCourse Schedule
References
ScheduleEvaluation / Information
Evaluation / Information
Evaluation :
3 hours exam in January (coe� = 1/2)
continuous assessment including a 2 hours mid-term exam anda couple of homeworks (coe� = 1/2)
B attending courses & TD/TP = good for performances
Information :
Web page :http://perso.ens-lyon.fr/eric.thierry/Perf2018
Contacts : [email protected]@[email protected]
M1IF - ENS Lyon Performance Evaluation & Networks 12/14
Performance EvaluationCourse Schedule
References
BibliographyWeb sites/ Softwares
Bibliography
An Introduction to Probabilistic Modeling. P. Brémaud.
Springer-Verlag, 1994.
Probability and Random Processes. G. Grimmett, D. Stirzaker.
Oxford University Press, 2001.
Introduction aux probabilités et à la statistique. J.-F. Delmas.
Les Presses de l'ENSTA, 2010.
Elements of Queuing Theory. F. Baccelli, P. Brémaud.
Springer-Verlag, 2010.
Performance Evaluation of Computer and Communication
Systems. J.-Y. Le Boudec. EPFL Press, 2011.
The Art of Computer Systems Performance Analysis. R. Jain.
Wiley-Interscience, 1991.
M1IF - ENS Lyon Performance Evaluation & Networks 13/14
Performance EvaluationCourse Schedule
References
BibliographyWeb sites/ Softwares
Web sites / Softwares
Web sites :
J.-Y. Le Boudec (EPFL) : http://perfeval.epfl.ch/
The Probability Web : http://probweb.berkeley.edu/
Softwares for the course :
NS2 / NS3 : https://www.nsnam.org/
Java Modelling Tools : http://jmt.sourceforge.net/
R : https://www.r-project.org/
M1IF - ENS Lyon Performance Evaluation & Networks 14/14
