+ All Categories
Home > Documents > Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne...

Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne...

Date post: 22-Aug-2020
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
40
Temporal Dynamics of Learning NTU Science of Learning Workshop Harnessing the motor system for improved cognition Leanne Chukoskie, Ph.D. Asst. Research Scientist, Institute for Neural Computation Asst. Science Director, Temporal Dynamics of Learning Center Assoc. Director, Research for Autism and Development Lab University of California, San Diego
Transcript
Page 1: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Harnessing the motor system for

improved cognition

Leanne Chukoskie, Ph.D.

Asst. Research Scientist, Institute for Neural Computation

Asst. Science Director, Temporal Dynamics of Learning Center

Assoc. Director, Research for Autism and Development Lab

University of California, San Diego

Page 2: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Brain and behavior develop together with

experience as a powerful teacher.

Page 3: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

We are interested in learning how eye and body

movements come together to produce learning

opportunities in the world, or not, as the case

may be for some children.

Page 4: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 5: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 6: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Attention

Page 7: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Stjerna, et al, 2015

Page 8: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

In the lab, we employ some useful (but rather dull)

tasks to assess attention and gaze control

• Basic saccade task (with gap and overlap

variants)

• Attention Network Task

• Posner-style cuing paradigm (with a

discrimination) to assess attention orienting

Page 9: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Example of a “better” ANT task

from Ray Klein (Dalhousie)

Page 10: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Methods

Page 11: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Attention Orienting Task (E-task)

Page 12: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

+* *

Page 13: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

+

Page 14: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

+

Page 15: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 16: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Miller, Chukoskie, Zinni, Townsend and Trauner, 2014

Saccade control is atypical in ASD….

Page 17: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Miller, Chukoskie, Zinni, Townsend and Trauner, 2014

….and may share underlying mechanism with

irregularity in finger tapping

Page 18: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

How to remediate attention orienting?

Page 19: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Intervention Computer

Page 20: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 21: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 22: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Is there any transfer to

more “real world” tasks?

Page 23: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Visuomotor Integration

Page 24: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Driving simulator as mid-level outcome

measure

Page 25: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

But what about realistic social interactions?

Page 26: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Social gaze as a high-level

outcome measure

Page 27: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

However, as you know, it isn’t just eye

movements that develop atypically. We used

a standardized motor battery (Florida Apraxia)

to characterize.

Page 28: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 29: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 30: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 31: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 32: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 33: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

What good balance looks like

Page 34: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

What poor balance looks like

Page 35: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 36: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 37: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 38: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Page 39: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Cognitive benefits of gross motor

interventions?

• Currently, not much being done with special

populations, but…

• FITKids intervention from Charles Hillman

and colleagues shows expected fitness and

metabolic benefits, as well as cognitive.

• We are creating balanced-based

interventions for children with special needs

Page 40: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.

Temporal Dynamics of Learning NTU Science of Learning Workshop

Many Thanks!!RADLab

Jeanne Townsend, Ph.D. – Director of RADLab

Marissa Westerfield, Ph.D. (walking MoCap)

Victor Minces, Ph.D. (social gaze analysis)

Nicole Suarez

Shuying Yu

Marlene Samano

DVS/Kinect Camera

Joe Snider, Ph.D.

Harinath Garudadri, Ph.D.

Alican Nalci

Alireza Khodamoradi

Nadir Weibel, Ph.D.

Steven Rick

Calvin Chan

Game design and build by:

Supported by:

NIMH R21/R33 MH096967


Recommended