©2004 Florida State University
A Flexible Image Browsing Interface
testerPeter JörgensenSchool of Information StudiesFlorida State University
ASIST ’04November 15, 2004
©2004 Florida State University
Warning
©2004 Florida State University
General communication
©2004 Florida State University
Wayfinding
©2004 Florida State University
living
©2004 Florida State University
Instructions
©2004 Florida State University
Finding the image
Keyword searching
CBIR
©2004 Florida State University
keyword queries
©2004 Florida State University
CBIR
©2004 Florida State University
Browsing final candidates
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
Slide Show
©2004 Florida State University
Story Board
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
©2004 Florida State University
Browsing limitations
System speeds
bandwidth
refresh rate
compression
Human factors
©2004 Florida State University
Human Factors
Images per second (minute)
size
bit depth
task
©2004 Florida State University
Previous ResearchVideo surrogates
Cinque et al 1998
Video keyframes
Komlodi & Marchionini, 1998
Tse et al 1998
Lee et al 2000
Geisler, 2003
©2004 Florida State University
Potter & Levy (1969)
Potter, M. C., & Levy, E. I. (1969). Recognition Memory for a Rapid Sequence of Pictures. Journal of Experimental Psychology, 81(1), 10-15.
©2004 Florida State University
A third approach
Slide Show
Storyboard
Multiple Scrolling Thumbnails
©2004 Florida State University
Multiple Scrolling Thumbnails
ASIST 2001 - Yang, Geisler, et al (2003)
Storyboard layout
Slide show animation
©2004 Florida State University
©2004 Florida State University
Instrument development
ibi
Image Browsing Interface
AppleScript Studio under Xtools (now Xcode)
800 MHz iMac running OS X
©2004 Florida State University
ibi specifications
Three Modes
Single image
Slide Show
Multiple Scrolling Images
©2004 Florida State University
ibi - parameters
Single images
Frames per second
image size
image set source movie
©2004 Florida State University
ibi – parameters
Multiple Images
Number of columns
Number of rows
Max. 12 images
©2004 Florida State University
ibi – data logText file, tab delimited
Date and time
Mode & frame rate
# rows and columns
Image set movie file
Number of images viewed
©2004 Florida State University
Subjects
26 volunteers from School
students
faculty
©2004 Florida State University
Tasks
2 face recognition
2 subject recognition
©2004 Florida State University
Images used
Face Set
AR Faces Database (Martinez & Benavente, 1998)
General Set
(Jörgensen & Jörgensen, 2002)
©2004 Florida State University
Target Images
©2004 Florida State University
Alternate Targets
©2004 Florida State University
Results
Hits
< 3 seconds after target presentation
Near hit
< 3 seconds after alternate target presentation
©2004 Florida State University
Data
Combined faces data
similarity
threw out arches data
too many similar
two identical
©2004 Florida State University
ResultsSuccess Rate vs Frame Rate
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
1 2 4 8 12 16Frames per second
HitsTotal Hits
©2004 Florida State University
ConclusionSupports Potter & Levy (8 fps is practical maximum for untrained browsers.)
Much more testing needs to be done
Size
color vs grayscale
Modes
©2004 Florida State University
Questions?Funded by FSU First Year Assistant Professor Award,Information Institute of the School of Information Studiesand the Dean of the School of Information Studies
http://faculty35.lis.fsu.edu/~peter/asist04_pej.pdfhttp://faculty35.lis.fsu.edu/~peter/jorgensen2004_ibi.pdf