+ All Categories
Home > Documents > Eye Tracking for Personalized Photography

Eye Tracking for Personalized Photography

Date post: 08-Jan-2016
Category:
Upload: ninon
View: 26 times
Download: 3 times
Share this document with a friend
Description:
Eye Tracking for Personalized Photography. Steven Scher (UCSC student) James Davis (UCSC advisor) Sriram Swaminarayan (LANL advisor). Who’s Behind the Camera?. Photo Creative Commons http://www.flickr.com/photos/jasonpratt. Who’s Behind the Camera?. Photo Creative Commons - PowerPoint PPT Presentation
Popular Tags:
57
Eye Tracking for Personalized Photography Steven Scher (UCSC student) James Davis (UCSC advisor) Sriram Swaminarayan (LANL advisor)
Transcript
Page 1: Eye Tracking for Personalized Photography

Eye Tracking for Personalized Photography

Steven Scher (UCSC student)James Davis (UCSC advisor)

Sriram Swaminarayan (LANL advisor)

Page 2: Eye Tracking for Personalized Photography

Who’s Behind the Camera?

Photo Creative Commonshttp://www.flickr.com/photos/jasonpratt

Page 3: Eye Tracking for Personalized Photography

Who’s Behind the Camera?

Photo Creative Commonshttp://www.flickr.com/photos/scobleizer

Page 4: Eye Tracking for Personalized Photography

Human-Computer Hybrid Computation

Photo Creative Commonshttp://www.flickr.com/photos/m500/

Photo Creative Commonshttp://www.flickr.com/photos/popculturegeek

Photo Creative Commonshttp://www.flickr.com/photos/aloha75

Page 5: Eye Tracking for Personalized Photography

Human-Computer Hybrid ComputationSemi-automated “Photoshop” effects• Rotoscoping

– Keyframe-Based Tracking for Rotoscoping and Animation

• Tone Mapping– Interactive local

adjustment of tonal values

Page 6: Eye Tracking for Personalized Photography

Human-Computer Hybrid ComputationAmazon Mechanical Turk

• Object Recognition as “20 questions”– Visual Recognition with Humans in the

Loop

• Object Tracking– Efficiently Scaling Up Video Annotation

with Crowdsourced Marketplaces

Page 7: Eye Tracking for Personalized Photography

Human-Computer Hybrid ComputationEyetrack-automated “Photoshop” effects• Cropping

– Gaze-Based Interaction for Semi-Automatic Photo Cropping

Page 8: Eye Tracking for Personalized Photography

Saliency:What is this a picture of?

Page 9: Eye Tracking for Personalized Photography

Automatic Saliency Detection Harel et al

Page 10: Eye Tracking for Personalized Photography

SaliencyItti, Koch, & Niebur

A Model of Saliency-based Visual Attention for Rapid Scene Analysis

Harel, Koch, & PeronaGraph Based Visual Saliency

• Feature extraction

• Activation

• Normalization

• Summation

Page 11: Eye Tracking for Personalized Photography

Saliency:Who is this a picture of?

Page 12: Eye Tracking for Personalized Photography

Eye Tracking

Half-Mirror

Infrared camera

Infrared Light

Page 13: Eye Tracking for Personalized Photography

Future Expectations:EyeTracker in Camera Viewfinder

Viewfinder

Camera

Page 14: Eye Tracking for Personalized Photography

Future Expectations:EyeTracker in Camera Viewfinder

Canon EOS A2“Eye Controlled Focus”1992

Page 15: Eye Tracking for Personalized Photography

Photo Creative Commonshttp://www.flickr.com/photos/1080p/

Page 16: Eye Tracking for Personalized Photography

Eye Tracks (1kHz)

350 400 450 500 550 600 650 700 750250

300

350

400

450

500

550

600

Page 17: Eye Tracking for Personalized Photography

Eye Tracking

Seconds after finishing calibration

Eye

Trac

king

Err

or (p

ixel

s) o

n 80

0x60

0 sc

reen

Page 18: Eye Tracking for Personalized Photography

Eye Tracks (1kHz)

350 400 450 500 550 600 650 700 750250

300

350

400

450

500

550

600

Page 19: Eye Tracking for Personalized Photography

Gaussian Weighted According to Eyetracker’s Calibration accuracy

Page 20: Eye Tracking for Personalized Photography

Logarithmically Flattened

Page 21: Eye Tracking for Personalized Photography

Automatic Saliency DetectionItti et al

Page 22: Eye Tracking for Personalized Photography

Automatic Saliency Detection Harel et al

Page 23: Eye Tracking for Personalized Photography

Actual Eyetrack

Page 24: Eye Tracking for Personalized Photography

Automatic Saliency DetectionItti et al

Page 25: Eye Tracking for Personalized Photography

Automatic Saliency Detection Harel et al

Page 26: Eye Tracking for Personalized Photography

Actual Eyetrack

Page 27: Eye Tracking for Personalized Photography

Applications

Selective Defocus Content-Aware Retargeting

Page 28: Eye Tracking for Personalized Photography

Applications

Selective Defocus Content-Aware Retargeting

Page 29: Eye Tracking for Personalized Photography

Applications

Selective Defocus Content-Aware Retargeting

Page 30: Eye Tracking for Personalized Photography

Applications

Selective Defocus Content-Aware Retargeting

Page 31: Eye Tracking for Personalized Photography

Original Image

Page 32: Eye Tracking for Personalized Photography

Selectively Defocused

Page 33: Eye Tracking for Personalized Photography

Selectively Defocused

Page 34: Eye Tracking for Personalized Photography

Selectively Defocused

Page 35: Eye Tracking for Personalized Photography

Selectively Defocused

Page 36: Eye Tracking for Personalized Photography

Applications

Selective Defocus Content-Aware Retargeting

Page 37: Eye Tracking for Personalized Photography

Content Aware Retargeting

Page 38: Eye Tracking for Personalized Photography

New Aspect Ratio

Page 39: Eye Tracking for Personalized Photography

Content Aware Retargeting

Page 40: Eye Tracking for Personalized Photography

Seam CarvingRemove one pixel from each row

Page 41: Eye Tracking for Personalized Photography
Page 42: Eye Tracking for Personalized Photography
Page 43: Eye Tracking for Personalized Photography
Page 44: Eye Tracking for Personalized Photography
Page 45: Eye Tracking for Personalized Photography
Page 46: Eye Tracking for Personalized Photography

New Aspect Ratio

Page 47: Eye Tracking for Personalized Photography

Original Image

Page 48: Eye Tracking for Personalized Photography

Simple Resizing

Page 49: Eye Tracking for Personalized Photography
Page 50: Eye Tracking for Personalized Photography

Actual Eyetracks

Page 51: Eye Tracking for Personalized Photography

Eyetrack-based content-aware resizing

Page 52: Eye Tracking for Personalized Photography

Simple resizing

Page 53: Eye Tracking for Personalized Photography

Original Image

Page 54: Eye Tracking for Personalized Photography

Automatic Saliency

Page 55: Eye Tracking for Personalized Photography

Actual Eye Track

Page 56: Eye Tracking for Personalized Photography

Content-Aware ResizingBased on Automatic Saliency

Page 57: Eye Tracking for Personalized Photography

Content-Aware ResizingBased on Eye Tracks


Recommended