Large-Scale, Real-World Face Recognition in Movie Trailers

Presentation 4Alan Wright

Dictionary Distribution

Pub Fig Dictionary (200 people)

Num

ber o

f tra

inin

g im

ages

(cap

ped

at 2

00)

Dictionary Distribution

Pub Fig Dictionary (200 people)

Num

ber o

f tra

inin

g im

ages

(cap

ped

at 2

00)

Preliminary Testing

• GPSR – Date Night 76.47% accuracy (26/34 tracks)– Accuracy increase from 44% last week. – Looked at confidence rather than only mode.– Adjusted tau parameter to 0.01– Accurate results, but takes ~320 secs per frame

(approx 5 minutes). Face Tracks have anywhere from 8 to 80+ frames.

Preliminary TestingCoefficient Vector

Test

imag

es in

dic

tiona

ry

Frames in Track

Tina Fey

Preliminary TestingCoefficient Vector

• Track is Tina Fey• High confidence and high coefficients• Exactly what we expected

Preliminary TestingCoefficient Vector

Test

imag

es in

dic

tiona

ry

Frames in Track

Preliminary TestingCoefficient Vector

• No clear recognition• Most likely due to facial expression, lighting,

pose, and small number of frames (only 8).

Preliminary Testing

• Other methods tested: homotopy, DALM, LASRC…

• Poor accuracy, but faster run times. • How can we speed up GPSR?

GPSR Average ApproachY1 = Ax1

Y2 = Ax2

…Yk = Axk

Simplifies to:

Find a single coefficient for an entire track, rather than a coefficient for each frame of the track.

GPSR Average Approach

• Average each frame of the track (very quick).• Pass this average to the face recognition

function.• It will still take ~320 secs, but won’t take

320 s * x frames.

GPSR Average Results

• Date Night – 76.47% accuracy (just as accurate as the frame by frame method, but faster).

• The incorrect matches were on all but 2 of the same face tracks.

GPSR Average Results

• Preformed just as well on trailer subset (6 trailers)

• George Bush was IDed in all 3 tracks.• Celine Dion was IDed in 4 out of 6 tracks.

GPSR Average Results

• Jessica Alba was not IDed well• Leonardo DiCaprio was not IDed well

What’s Next

• Finalize Dataset – final face tracks and features.

• Larger Dataset – Test on more trailers. • Look at additional baseline method – low rank

approximation (65% accuracy – 60 secs a track)

• Derive more interesting approximations