+ All Categories
Home > Documents > La Technologie des Mouvements Oculaires en Linguistique Expérimentale Rachel Shen.

La Technologie des Mouvements Oculaires en Linguistique Expérimentale Rachel Shen.

Date post: 22-Dec-2015
Category:
Upload: jared-wiggins
View: 216 times
Download: 0 times
Share this document with a friend
Popular Tags:
24
La Technologie des La Technologie des Mouvements Oculaires Mouvements Oculaires en Linguistique en Linguistique Expérimentale Expérimentale Rachel Shen Rachel Shen
Transcript

La Technologie des La Technologie des Mouvements Oculaires Mouvements Oculaires en Linguistique en Linguistique ExpérimentaleExpérimentaleRachel ShenRachel Shen

The key points of this The key points of this presentationpresentation

What is eye tracking?What is eye tracking?

Eye tracking in language studies and some Eye tracking in language studies and some examples;examples;

A very brief evaluation of different types of eye A very brief evaluation of different types of eye trackers; trackers;

The SMI eye tracking glassesThe SMI eye tracking glasses

What is eye tracking?What is eye tracking?• Subconscious movements of the Subconscious movements of the

eyes during visual activities, such eyes during visual activities, such as scene viewing, reading, etc.;as scene viewing, reading, etc.;

• Intake of information through Intake of information through those movements will be those movements will be processed by human brain;processed by human brain;

• The eye-mind assumption and the The eye-mind assumption and the lag between attention and lag between attention and fixations;fixations;

• Track them!Track them!

Eye tracking in Eye tracking in Language studies: Language studies: READINGREADING

Self-paced reading;Self-paced reading;

Gaze contingency Gaze contingency paradigm;paradigm;

Linguistic Linguistic manipulations can manipulations can be reflected in the be reflected in the measurements of measurements of “fixation time” and “fixation time” and “saccade time and “saccade time and direction”direction”

From a study of speed reading made by Humanist laboratoriet, Lund University, in 2005. Data are recorded using an SMI iView X 240 Hz video-based pupil-corneal reflex eye tracker.

Reading example: Normal Reading example: Normal sentencesentence

QuickTime™ and apeg

ˇˇ

Reading example: Syntactic Reading example: Syntactic anomalyanomaly

QuickTime™ and apeg

ˇˇ

Reading example: Semantic Reading example: Semantic anomalyanomaly

QuickTime™ and apeg

ˇˇ

Eye tracking in Language Eye tracking in Language studies: studies: Visual World Visual World Paradigm (VWP)Paradigm (VWP)

Auditory input and visual input;Auditory input and visual input;

Eye movements (most commonly, no. of fixations Eye movements (most commonly, no. of fixations and saccades) on the visual input are recorded;and saccades) on the visual input are recorded;

Sensitive to various linguistic properties from word Sensitive to various linguistic properties from word recognition to syntactic ambiguity resolution (and recognition to syntactic ambiguity resolution (and beyond)beyond)

VWP: VWP: the Advantages the Advantages Compared to ReadingCompared to Reading

Provides clues about what happens prior to a Provides clues about what happens prior to a critical word or region (can measure critical word or region (can measure attention);attention);

Measures relative direct interpretations of a Measures relative direct interpretations of a listener, which might be misjudged by the listener, which might be misjudged by the listener himself;listener himself;

Some phenomena can only be measured in Some phenomena can only be measured in situated condition;situated condition;

Easier to apply with children and patientsEasier to apply with children and patients

Example VWP: Donald Duck and Example VWP: Donald Duck and tractor (Conklin, Dijkstra & van tractor (Conklin, Dijkstra & van Heuven, 2008)Heuven, 2008)

HEHE

200-2000ms200-2000ms 200-400ms200-400ms

Example VWP: Cue integration Example VWP: Cue integration during spoken word recognition during spoken word recognition (Toscano & McMurray (2012)(Toscano & McMurray (2012)

VOT (400ms) VOT (400ms) vs. VL vs. VL

(700ms)(700ms) VOT time courseVOT time course

Eye tracking in Eye tracking in Language studies: Language studies: ProductionProduction

No spoken input;No spoken input;

To name an object or describe a scene;To name an object or describe a scene;

Gaze movements and object viewing Gaze movements and object viewing order are recorded, especially relative to order are recorded, especially relative to the speech output;the speech output;

Reflects utterance planningReflects utterance planning

Example Production Example Production (Gleitman, January, Nappa & (Gleitman, January, Nappa & Trueswell, 2007)Trueswell, 2007)

Onset of each stimuli Onset of each stimuli were given to were given to manipulate the manipulate the attention;attention;

Fixation order is affected Fixation order is affected by the manipulation;by the manipulation;

Word order choice for Word order choice for utterance production is utterance production is affected;affected;

The integrated The integrated paradigmsparadigms

Situation specific;Situation specific;

Pragmatic Pragmatic inferencing;inferencing;

Dialogue Dialogue

DialogueDialogueThe map task (Anderson et al., 1991);The map task (Anderson et al., 1991);

Tree decoration task (Ito and Speer, 2006);Tree decoration task (Ito and Speer, 2006);

Tangram task (Clark and Wilkes-Gibbs, 1986);Tangram task (Clark and Wilkes-Gibbs, 1986);

Lego task (Clark and Krych, 2003);Lego task (Clark and Krych, 2003);

Baufix ( Poncin & Rieser (2006);Baufix ( Poncin & Rieser (2006);

Cooking (Hanna & Tanenhaus, 2004)Cooking (Hanna & Tanenhaus, 2004)

Example Situated: cue encoding Example Situated: cue encoding and decoding (and decoding (Snedeker & Trueswell (2003)))

Tap the frog with the flower. Tap the frog with the flower. (Ambiguous)(Ambiguous)

Tap the frog by using the flower. Tap the frog by using the flower. (Unambiguous)(Unambiguous)

Tap the frog that has the flower. Tap the frog that has the flower. (Unambiguous)(Unambiguous)

Eye tracking Data Eye tracking Data presentationpresentation

Animated;Animated;

Static saccade path;Static saccade path;

Heat maps;Heat maps;

Blind zone mapsBlind zone maps

US viewersUS viewersCanadian viewersCanadian viewers

Which eye tracker?Which eye tracker?

• Setups vary;Setups vary;• Sample rates vary (30Hz-2000Hz);Sample rates vary (30Hz-2000Hz);• Bright pupil (varying light conditions) and Bright pupil (varying light conditions) and dark pupil tracking (Lab condition);dark pupil tracking (Lab condition);• For detailed comparison: For detailed comparison: http://www.eyetracking.com/Hardware/Eye-Tracker-List

The SMI Eye The SMI Eye tracking Glassestracking Glasses

• System Type: Video based glasses-type eye tracker

• Sampling Rate: 60Hz binocular

• Method: Dark pupil, pupil-cr

• Binocular Tracking: Yes (auto parallax correct)

• Accuracy: 0.5 degrees over all distances

• Gaze tracking range: 80° horizontal, 60° vertical

• Additional Details: HD Scene Camera Resolution: 1280x960

The workflow of the The workflow of the SMI Eye tracking SMI Eye tracking GlassesGlasses

DesignDesign

RecordRecord

AnalyseAnalyse

The SMI Eye The SMI Eye tracking Glasses tracking Glasses ExampleExample

Field work with the Field work with the SMI Eye tracking SMI Eye tracking GlassesGlasses• Easy to carry (1300g /246g);Easy to carry (1300g /246g);• Easy to setup;Easy to setup;• Easy to calibrate and validate with live feedback Easy to calibrate and validate with live feedback on scene video;on scene video;• Long recording time (2-4hrs);Long recording time (2-4hrs);

Data view and analyses Data view and analyses with the SMI Eye with the SMI Eye tracking Glassestracking Glasses

• Event replay such as gaze size, scanpath, etc.;Event replay such as gaze size, scanpath, etc.;• Raw data of fixations and saccades in terms of Raw data of fixations and saccades in terms of location, start time and end time, etc.location, start time and end time, etc.

Please come and try it!Please come and try it!

Merci beaucoup pour votre temps!Merci beaucoup pour votre temps!


Recommended