Video streaming with SP and SI frames

Chuan-Yu Cho

In proceeding of VCIP 2005Eric Setton and Bernd Girod, Information Systems Laboratory,Stanford University, Stanford, CA

2

Outline

Introduction to SP/SI Frames SP and SI Frames Encoding Generating SP and SI Frames for Streaming Performance Analysis

3

Introduction to SP/SI Frames

P P P SP1 P P Quality 1

SP12 (Stored bitstream)

P P P SP2 P P Quality 2

P P P SP12 P P (Transmitted bitstream)

SI

(Stored bitstream)P P P SP P P

P P P SI P P (Transmitted bitstream)

Lost frame

4

SP and SI Frames Encoding

SP frame encoder SI and switching SP frame encoder

M. Karczewicz and R. Kurceren, “The SP- and SI-frames design for H.264/AVC,” IEEE Trans. on Circuitsand Systems for Video Technology, pp. 637–644, July 2003.

5

Generating SP and SI Frames for Streaming

GOP structures used for streaming with SP and SI frames and for periodic I frame insertion.

Optimal settings for QPSP and QPSP2, for different probabilities of transmitting an SI frame.

6

Rate-distortion performance for different frame types

7

Rate-distortion performance with periodic I frame, SP frame or SI frame insertion

Mother & Daughter

Foreman

8

Congestion-Rate-Distortion Performancefor Varying Loss Rates - Mother & Daughter

9

Congestion-Rate-Distortion Performancefor Varying Loss Rates - Foreman

10

Congestion-Rate-Distortion Performancefor Varying Propagation Delays - Mother & Daughter

11

Congestion-Rate-Distortion Performancefor Varying Propagation Delays - Foreman

12

Conclusions

The use of SP and SI frames is beneficial for scenarios where feedback is available from the receiver and the propagation delay is low enough to allow for ACK-based retransmissions.