+ All Categories
Home > Documents > Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1...

Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1...

Date post: 04-Oct-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
30
YANNICK SCHEELEN JOP VAN DER LELIE Camera identification on YouTube
Transcript
Page 1: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Y A N N I C K S C H E E L E N

J O P V A N D E R L E L I E

Camera identification on YouTube

Page 2: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Introduction

Why camera identification?

Page 3: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Agenda

Pattern noise

Video encoding

Experiment

Results

Analysis

Conclusion

Page 4: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Noise sources

Signal processing of a simplified digital camera

Source: FIDIS “D6.8b: Identification of images”

Page 5: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Pattern noise

Present on all frames

Fixed pattern noise (FPN) Defective pixels

Photo Response Non-Uniformity (PRNU)

Page 6: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Algorithm

Page 7: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Algorithm

Correlation between the reference pattern and the video pattern

Correlation on each color channel (RGB) Sum of correlation on each color channel

Correlation value between -3 and 3

Page 8: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

PRNUCompare

Algorithm implemented in PRNUCompare Developed by NFI (Netherlands Forensics Institute)

http://prnucompare.sourceforge.net/

Page 9: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

PRNUCompare

Page 10: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Video encoding

Advanced Video Codec (AVC)

Compresses the video stream

Modifies the pattern noise

Applies to YouTube

Page 11: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Research question

How does re-encoding the video with the Advanced Video Codec influence the pattern noise?

Page 12: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Experiment

5 different camera models Canon Ixus/SX210

Panasonic FP7/FZ45

Apple iPhone 4

5 different cameras per model

Multiple resolutions

640x480

1280x720

Page 13: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Experiment

1 reference video per camera per resolution

1 natural video per camera per resolution

re-encode each natural video AVC encoding setting: CRF 18,21,…,39

Upload/download videos to/from YouTube

Page 14: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 18

Page 15: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 21

Page 16: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 24

Page 17: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 27

Page 18: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 30

Page 19: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 33

Page 20: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 36

Page 21: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Encoding quality 39

Page 22: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Results

Extracting the pattern noise for each video

Correlate each video to the reference patterns

Total number of videos processed: 835

Page 23: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Analysis

Verify that pattern noise can be used for source identification before re-encoding

Page 24: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Analysis

Page 25: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Analysis

Correlation between re-encoded videos and reference patterns

Page 26: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Analysis

Page 27: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Analysis

Page 28: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Conclusion

Depends on the level of compression

Presence of pattern noise differs per model

Higher resolutions videos perform better More pixels == more noise

Page 29: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Conclusion

Even after a re-encode on the video with a compression similar to YouTube, it is still possible to

identify the source camera for most cameras.

Page 30: Camera identification on YouTube · Experiment 1 reference video per camera per resolution 1 natural video per camera per resolution re-encode each natural video AVC encoding setting:

Questions?

Jop van der Lelie ([email protected])

Yannick Scheelen ([email protected])


Recommended