A Cookbook for Administration of Learn
Stephen FeldmanBlackboard, Inc.Product Development
2
3
4
5
6
7
So Anybody Can Cook…Right?
8
9
This Guy Doesn’t Think So…
10
11
12
Let’s Go Back in Time to BbWorld 2011
13
14
15
18
19
20
Two Stories of Significance
21
22
Constructing the Panama Canal: The French Failure
23
24
25
26
27
28
Constructing the Panama Canal: US Intervention
29
30
31
1880 – 1890 Under French Control: 22,189 deaths
1904 – 1914 Under U.S. Control: 5,604 deaths
32
33
The London Cholera Epidemic of 1854
34
35
36
37
38
39
40
41
42
43
What Do These Stories Teach Us?
44
Techniques for Presenting Data
o Time series statistics can provide benefit when viewed with appropriate context.
o Present data in percentileso Statistical averages should be analyzed with standard
deviation.o Histograms can tell a compelling story about groups of
outliers.o Scatterplots can tell a compelling story about individual
outliers.o Associate different types of data: response times with
resource utilization or throughput rates (clusters)o Correlation can lead to causation, but be confident and
careful
45
46
47
Illustration of Variability
48
49
50
51
o It’s dangerous to use past experience without considering the data of the present.
o It’s dangerous to ignore data.o Problems cannot be solved simply with extra capacity.o Looking at time-series statistical averages can be just
as dangerous.o Seeking out statistical anomalies as they will tell us so
much about how bad or defective the user experience truly is.
What Have We Learned?
52
We value your feedback!Please fill out a session evaluation.