Quality of experience measurementsTechnologies and who knows what
Jörgen GustafssonEricsson Research
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 4
How much darker is square A than square B?
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 10
Subjective test
x 24
Mean Opinion Score
x 250
›
5 excellent4 good3 fair2 poor1 bad
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 11
Capturing perception
Codec: signaling
Non-linear dependency between perceived quality and IP and application
layer measurements
QoE models:
MOS = f(x, y, z, …)
Combining in a non-linear way
Audiovisual quality (MOS)
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 12
Parametric model P.1201
Parameterextraction
video
audio
Audio-visual
V-mos
a-mos
a/v-mos
c1
c2
c3
…
Buffering
IP headers
Stream info
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 13
› ITU-T Study Group 9 and 12
› Recently approved P.1201 and P.1202 recommendations for UDP based video
› New work items for progressive download (YouTube) and adaptive streaming (DASH)
QoE model Standardization
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 14
Measurement accuracy
Asking the manon the bus
Modeling human perception
Transport layermeasurements
How close to real perception
Accuracy of method
Ideal
Binary: Good or bad
Detailed comparison possible
Medium accuracy Qo
S
Qo
Ee
stim
atio
n
Re
al
Qo
E
Not useful
Action?
Useful
Good
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 15
Serviceprovider
CDN (Content Delivery Network)
End user
ISP (Internet Service Provider)
Media client reports
IP level measurement data
IP and access network data
Quality of Experience!
Ultimate QoE measurement data set
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 16
› Is the quality of media services (in Sweden, today) good enough?
› What QoE measurements are done today and what is missing?› What accuracy of the QoE measurements is desirable?› What are the reasons to share QoE measurement with other actors?
› Who does a user call when there are quality problems?› What are the end-users willing to pay for in terms of quality?
› What new business models can emerge using novel QoE measurement technologies?
Panel discussion
Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 17
› Human perception is utterly complex…
› …but we can handle that with QoE models
› A lot of QoE measurement data is available
› …but no one has access to all the data
› Potential for new business models
Summary