Augmented Reality ...in education

Simulations by the MIT Education Arcade & HGSE’s HARP Project

Jennifer Groff - jennifer_groff@mail.harvard.edu

Handheld GamesAUGMENTED REALITYComputer simulation on handheld computers triggered by real world locations

• Goal - understand “authentic” science through simulated realistic practices

• Combines physical & virtual world contexts• Embeds learners in authentic situations• Engages users in a socially facilitated context

Handheld GamesAUGMENTED REALITYComputer simulation on handheld computers triggered by real world locations

A location-based experience• Uses GPS (Global Positioning

System) outdoors…• …or wi-fi positioning indoors

As participants move, their Pocket PCs knows their real location and provides location-specific information.

More about AR...Helmets v. Handhelds• Light augmentation

• Providing a small amount of “augmented” information. The environment and real people are integral and “real”.

• Heavy augmentation• The environment is used as a physical way

of navigating through virtual space. Environment can represent anything.

Environmental Detectives

• Players briefed about rash of local health problems linked to the environment

• Provided with background information and “budget”

• Determine source of pollution by drilling sampling wells and remediating with pumping wells

• Work in teams representing different interests (EPA, Industry, etc.)

Outdoor AR Advances• Features

• Structured around role dependent collaboration• Transcribed interview text, images or rich-media

(e.g., video) provide interview information.• Gates allow participants in outdoor simulations to

enter real buildings.

‘Evidence’ Screen• Use ‘Send Evidence Over IR’ to

prepare to make an accusation.• If a player has enough evidence,

he or she can interview a suspect to accuse them of a crime.

• A virtual character will only confess to a player who has all of the key evidence.

• To accuse a virtual character, simply interview them with enough evidence.

Examples of Customized Scenarios• Public Health - Charles River City

• Investigate mysterious health problems in Boston two weeks before the World Series

• Forensics - Mad City Murder• Investigate the death of a local resident and determine

whether it was murderMad City MurderCharles River City

Moving Indoors

• Indoor game played at the Boston Museum of Science

• Used 802.11 for positioning• Defining roles to enhance

collaboration• Introducing an element of

time to make it feel more like a game

• Solving a mystery using scientific information from the museum

Location InformationClick on items in the room to select them for viewing or picking up

Click on people in the room to select them for interviewing or showing objects to

To show an item that you already have to a Virtual Character, click on the person, then click Show and then choose the item that you want to show.

All screens tell you what room you’re currently in

To view an item in the room, click on the item and then click the View button.

To pick up an item in the room, click on the item and then click the Pick Up button.

To interview a virtual character click on the person and then click Interview

Game Play

Parents and Kids Collaborating Fostering Collaboration Through Roles

Collecting Virtual Samples

Using Contextual Information

“Participatory Reality”• Combining the features of AR and Participatory

Simulations to replicate authentic dynamic scientific practices where underlying models matter.• Participants are connected• Events unfold based on models• Game progresses differently each time

+ =

Outbreak @ MIT• You are actually an agent

in the system and can get sick or help the problem get under control

• Client-server based allows “one world” with underlying models and more realistic feel

• Evaluated by Public Health graduate students

One World

There’s a mask in this room. I need to protect myself, so I’ll pick it up.

One World

Since I picked it up, the mask has disappeared from the room. Other players no longer see it.

One World

The mask appears in my items list

One World

I’ll put it on myself

One World

One World

Now it appears in my active items list, since I’m wearing it.

Outbreak @ MIT: Scenario• The Department of Public Health has been

investigating a recent flight from Chicago to Boston. Several passengers have become ill with a respiratory disease which may be SARS and are being housed in a Boston medical facility.

• Have two passengers associated with MIT contracted or spread the disease?• Cindy Hsiao, a visiting student• Quint Grandville, an MIT employee

Outbreak @ MIT: Game Design• Locations

Virtual characters and items are spread around MIT buildings

• Time30 mins of real time = 1 wk game time

• Disease transmission• Probability of infection depends on the amount of time you spend in a room with an

infected player or NPC.• Infection causes your “antigen level” to increase and your health level to drop.• Multiple disease models are built into the game.

• Multiple Rolesè