FY 2009 NASA Cooperative Agreements Notice (CAN) Research in the Design, Usage and Evaluation of Massively Multiplayer Online Games and

Immersive Synthetic Environments for NASA STEM Education and Training Announcement No. NNG09AZ32R

Marc Prensky coined the phrase “digital natives” to identify the generations born since the personal computer and digital technology have become common household tools. More media savvy and skilled at multitasking than their parents, digital natives find many traditional and analog approaches to learning, or working, slow, under-powered and illogical. To attract digital natives into STEM fields of study, NASA, and concerned entities, will need to reach those digital natives where they live: literally, in their digital world.

There is increasing recognition that these synthetic environments can serve as powerful “hands-on” tools for teaching a range of complex subjects. NASA has long recognized the power of simulations as learning and training tools. MMO games can help players develop and exercise a skill set closely matching the thinking, planning, learning, and technical skills increasingly in demand by employers. These skills include strategic thinking, interpretative analysis, problem solving, plan formulation and execution, team-building and cooperation, and adaptation to rapid change.

There is a general consensus that educational games are not the same as today's commercial MMO games. Educational games represent a new type of product - where the knowledge of pedagogy is integrated with the features of games that are so motivating, engaging, and rewarding to users.

Concept for a Simulated Environment & Role-Playing Educational Network

• The system will be able to augment ISS training to provide initial bootcamp lessons in a distributed fashion but with clear milestones and progress monitoring to ensure the students are meeting their training schedule.

• The system shall provide proficiency training for ISS crews, some subset of modules could be shipped to the ISS so they could stay proficient with visiting vehicles/commercial ride home.

– These refresher modules through partnerships with other ISS stakeholders could also incorporate medical lessons or other tasks that are not frequently performed but critical knowledge must be maintained.

• Simulated training system will provide knowledge capture as well as serve as a foundation of Plan, Train Fly for three ventures

– Internal ISS operations training

– Provide MOD’s Operations expertise to the new commercial companies by providing a simulation package that provides their folks initial training on how to Plan, Train, Fly

– Provide to other external users such as inflight ISS crews who need refresher courses during their long duration expeditions.

• The system shall provide bootcamp for commercial ventures, phase one generic ops training (flight control and crew training), phase two vehicle specific training modules to help ensure their team is qualified to not collide with station.

– This will not replace full up integrated simulations that the commercial ventures will still perform, but will streamline their personnel training in preparation for those sims.

• The system shall provide the capability for knowledge capture of shuttle operations to replace ojting for how to teach classes, sim and flight data that will be lost after shuttle retirement.

• The system is also flexible to provide education outreach, public version provides science, technology, education, math for kids to play astronaut, flight controller.

Elevator Pitch• Current training methods are workbook and static CBT centric as opposed to

an immersive gaming environment – more conducive to younger generation. Also there is currently a heavy reliance on OJTing for student to acquire system knowledge as well as soft skills (communication, team work, etc.)

• MOD needs to leverage their core skills to provide consultation to the new commercial ventures

• What if we could provide a 3D immersive persistent world that students could log into anytime and anywhere to interactively learn system knowledge and soft skills?– We will allow students based on time spent and achievements earned to

understand how subsystems work, how to run simulators, how to teach classes, and learn the skills needed to be an operator/specialist or Flight system engineer

– By being able to use the persistent multiplayer world we can avoid relying on scheduling big rigs (SMS/PTT/FCT/SST) for early training needs

– By providing a system that is accessable from anywhere it will allow this technology to be leveraged by the commercial companies to ensure their operations have a core level of capabilities and knowledge.

Persistent 3D World• Massively Multiplayer Online World providing an innovative solution for

training the next generation of Mission Operations and Astronauts• Users log on anywhere and anytime to work on their knowledge

development and communication skills by interacting with other students

Achievement based development • 5 levels of student development that takes the student from new

hire to Top Gun based on time and achievement • Mentors and Group Leads can track time spent and achievements

earned as well as award bonus points to level up student based on real world experiences

Training both ISS and Commercial Vehicles• Classes organized along career path – operator/specialist or flight system engineer• Teaches both system knowledge and soft skills via interacting with other students

– Can provide shuttle reference missions to teach time critical ascent/entry dynamic operations as well

• Expandable to handle any future vehicle by adding classes via an expansion pack– For commercial companies would provide a standard introductory load of

operational techniques as well as vehicle specific lessons

Astronaut Classes and Public Outreach Classes also available

• Also provides training to astronauts for both ISS and commercial vehicles using similar character paths for skill and system development

– Potential to partner with other ISS stakeholders to provide refresher course to critical skills retention during long duration expeditions

• Space and Life Sciences is looking at ways to provide ISS crew critical medical lessons while on orbit

• Public outreach server will provide greater community understanding of what it takes to be an astronaut or working in manned spaceflight as well as overall awareness of NASA programs while learning science, technology, and math.

Welcome to SERENITYSimulated Environment & Role-Playing

Educational Network Interactively Teaching You

• Massively Multiplayer Online World providing an innovative solution for training the next generation of Mission Operations and Astronauts

• 5 levels of student development based on time and achievement

– From New Hire to Top Gun

• Training both ISS and Constellation (operator/specialists and Flight System Engineers training flows)

• Also provides training to astronauts and potential for public outreach to provide the greater community understanding of what it takes to be an astronaut or working in manned spaceflight

The Hard Sell

The Government shouldn’t pay us to play a game!

MMO Way• Character/Story Arc – Complex plot that involves a player developing their

character through a series of objectives, skills learned and knowledge discovered. Decisions along the way dictate if the player succeeds or fails.

MOD Way• Certification Guide – A complex defined set of

objectives, skills that must be acquired, knowledge that must be learned with decision gates along the way to dictate if the employee Passes or fails certification.

MMO Way• Virtual World – a simulated environment which allows player to interact

with other players perform quests to gain achievements, discover knowledge and problem solving skills with the goal to continue leveling up the character.

MOD Way• Training Simulations – Several simulated environments

(PTT/SST/FCT/Int Sim) that allow student to interact with other students, learn system knowledge, improve their tool set (communication, console tools, teaching tools, analysis tools) and achieve objectives towards certification.

MMO Way• Achievement Tracking – system for logging objectives met during game

play across various interactions, quests and battles that allows for leveling up character to reach next level of game and thus further their story.

MOD Way• CPR/STARS – Database for logging objectives met

during the course of training that includes reading assignments, OJTing, and training simulations (MCC, FCT, PTT, SST) that allows the student to reach further levels of certification and work assignments.

MMO Way• Boss Levels – Game checkpoints that challenge the players problem

solving skills, team work and ensure they have met a minimum level of achievement, quests completed before moving to the next level.

MOD Way• Decision Gates/Cert Sims – Certification checkpoints

that challenge the student whether it be oral exams, written exams or integrated sim/class which ensure they have met the minimum system knowledge, skill set and objectives to be certified as an instructor, analyst, flight controller.

So what kind of “game” is this?

SERENITY Concept Details

Agenda

• Concept– Avatar/Skill development levels

• Environment– Locations

• Communication• Lesson types

– Personnel Development levels

• Open questions• Project Timeline

MMO Concept• Find a interactive fun way to train both flight controller and instructor skills

(and possibly some of the astronaut familiarization classes) in a computer environment based on point accruement/skill development based on a time investment

– Think Massively Multiplayer Online Game (MMOG) with a COTS or ISS scenario in a Mission Ops world

• User logs into world for skill development based on task assignments– Depending on skill level will interact with Bots or require interaction with upper

level personnel– Distributed network such that allows any upper level avatar to assign task

• Pop up on desktop requesting a senior avatar for task assignment

• NASA is also currently developing an MMO (Astronaut: Moon, Mars and Beyond) for educational learning in science, technology, engineering and mathematics

– http://news.bigdownload.com/2009/02/19/feature-first-look-at-nasas-unreal-engine-3-based-mmo/

• http://ipp.gsfc.nasa.gov/MMO/ • Could add a class of Avatars on a separate Server for public access to levels of

SERENITY to allow for Cx, MOD and Astronaut lessons as part of public outreach

Ten principles to be considered when creating MMOGs

(adapted from Gee, 2003b)

Definitions

• Newbie – new player, level one player with minimal skills and training

• Avatar – 3D representation of the user in the SERENITY environment

• Bot – a computer controlled avatar that interacts with users to assign tasks, grade performance and provide feedback

Learning Soft Skills and basic

systemknowledge

Some interactionWith other newbies

And upper levelusers

Checkpoint toApprentice

Level

Top Gun, interacts at checkpoint

Bots give assignments

How to run basic simulator functions

Intro classes

Teaching basic classes

Interactionwith other newbies

And upper levelusers

Checkpoint toInstructor

Level

Top Gun, interacts at checkpoint

Bots & Mentors give

assignments

Participate in Mini sims/FCTs

Bots crews ornewbie Crew

Continue to buildSoft skills and

System knowledge

Teaching basic and mid level

classes

Evaluatenewbies

Checkpoint toJourneyman

Level

Top Gun, interacts at checkpoint

Bots & Mentors give

assignments

Run in Mini sims/FCTs for

newbies

Bots crews ornewbie Crew

Continue to buildSoft skills and

System knowledge

Level 1:

Newbie

Level 2: Apprentice

Teaching all levels ofclasses

Evaluatenewbies and instructors

Final Boss Level

Top Gun, interacts at checkpoint

Top Guns & Mentors

give assignments

Run in Mini sims/FCTs For newbies and

apprentices

Bots crews ornewbie Crew

Continue to buildSoft skills and

System knowledge

Level 3: instructor

Level 4: Journeyman

Level 5:

Top Gun

Run all the simulators

Evaluate

all users

Teach all

Class levels

Level Progress - Achievement System

• Basically in the background the cert guide and STARS is guiding and logging the students progress as well as storing feedback and objectives

• Mentor, Top Gun and Group lead can access students record to see progress, objectives completed and build cert folder.– They can also adjust task assignments based on

current level and feedback• Early level up (waive objectives) or repeat lessons if needed

Achievement Page ConceptAvatar Status:

Current level – newbie

Class – Operations

Subclass – GNC

Vehicle class - Dragon

Current Assignment:

GNC H/W OV

Next Assignment:

GNC Displays

Level Progress Bar

Avatar Progress Bar

1 5432

Level Points - 250

Avatar Points - 250

Options:

Change Assignment

Change Vehicle

Level Up

Review Feedback

Return to SERENITY

Quit

Tuna

Feedback system

• Bots and users rate task completion and award development points based on:– Communication skills– System knowledge– Problem resolution

• Next task assignment is based on current development point level and lesson plan branching system

• Point system could be used as incentive system beyond just getting certified

Status Page Concept

Avatar Status:

Current level – newbie

Class – OPS

Subclass – GNC

Vehicle - Dragon

Experience:

Comm +5

Simulator +2

H/W SubSystem +1

S/W 0

Operations +2

Tuna

Skill Points:

Experience Gained – 200

Experience Available – 1000

Bonus Points - 50

Next Rank Increase - 50

Next Checkpoint in - 750

PTT I:

Starting up the rig

PTT II:

Auto Sim Run

PTT III:

Class 101

Novice GNC

Rookie GNC

GNC I:

GNC 101

GNC II:

GNC H/W OV

GNC III:

GNC S/W OV

MCC I:

FCR OV

MCC II:

DVIS OV

MCC III:

GNC Displays

Rookie

Novice

Apprentice

newbie

Environment

• 3D Third Person Free Roam World with some first person views depending on the lesson.

• Provides immersive lesson and skill development using animation, video lessons, direct interaction with users/Bots, tasks and simulation scenarios– Based on lessons completed next task could come from NPC,

mentor or other users– Major level advancement requires Top Gun interaction for

Checkpoints

• Initial focus is JSC with some basic intro level off site lessons

• Interaction between users can be free text, choices or voice

SERENITY Concept Art

Concept art borrowed from SimCEV, SimStation Orbiter and others

JSC Locations

• 4N– Home office is portal to the world (save point)– Conference rooms are for video lessons

• Apollo Lessons learned and other video lessons– Computer labs are for Computer Based Training lessons

• Interactive lessons that combine systems brief information with a 3-D vehicle model that can interacted with and broken down to the CEV Systems Handbook level of detail

• 4S– Part task trainers (PTT) for learning and running

simulations/classes– Single System trainers (SST) for learning and running

simulations/classes– Flight Controller Training (FCT) for joint interaction

simulations/class training

JSC Locations

• 5– Fixed based simulator for learning and

running simulations/classes

• 30– MCC for major case simulations

• 9– Mockup tours and reach and vis classes

Possible Off Site Locations

• KSC– LCC Training– Crew Escape familiarization– KSC vehicle processing

• Other centers as required for system knowledge (Commercial Vehicles Ops Center and training facilities)

Communication

• Text based– Mainly used by Bots to assign tasks and interact– Some classes/quizzes will use text interaction

• Chat– Two way text communication for advanced tasks and classes– Can also be used for providing feedback and assignments

• Instant Message– Mentors, Top Guns and others can send students their next

assignments, and feedback via an IM

• Video and Voice (VoIP)– Would require webcams and headsets– Would allow for “face to face” interaction for critical tasks to

evaluate communication skills

Lesson types

Intro classes/tasks– Animation sequences of

design reference missions

– Subsystem overview lectures

– ISS, Apollo and Shuttle lessons learned level 1

– Intro to PTT/SST – familiarization of facility and how to run a class

– MCC familiarization of tools and system displays

Mid level classes/tasks– Animation sequences of

failures, aborts and other in depth scenarios

– Continuing Subsystem lectures including FIW, Flight rules

– ISS, Apollo and Shuttle lessons learned level 2

– PTT/SST – teaching classes for newbies or crews

– FCT familiarization on running simulator and intro lessons

– Fixed base simulator familiarization

High level classes/tasks– ISS, Apollo and Shuttle

lessons learned level 3– FCT running simulator for

newbies and in depth classes

– Fixed base running simulator for newbies and crew

– MCC joint sims - Kobayashi Maru scenarios

Open Questions• What is the Technology investment?

– Multitude of world builders out there ranging from strictly gaming to educational training to collaboration to social networking

• World of Warcraft, America’s Army, OLIVE, Second Life

– Have talked with Fortera and their OLIVE system is capable of interacting with external models (MCC CxTF models) to allow for a more realistic simulation of environment and situations.

– Virtual Heroes should have a demo of Astronaut: Moon, Mars and Beyond this spring

• What would be the cost for such a paradigm shift in how we train our folks?– Can we leverage off both ISS, Commercial and Public

Outreach money for funding?

Technology/References• Orbiter simulator – free physics based space simulator

http://orbit.medphys.ucl.ac.uk/ - programhttp://www.orbithangar.com/index.php - addons such as Apollo 11 or ESAS CEV scenarios

• Massively multiplayer online role-playing game (MMORPG) is a genre of massively multiplayer online computer role-playing games (CRPGs) in which a large number of players interact with one another in a virtual world. Over The ability to support more than 100 simultaneous players is considered massive. As in all RPGs, players assume the role of a fictional character and take control over many of that character's actions. MMORPGs are distinguished from single-player or small multi-player CRPGs by the number of players, and by the game's persistent world, usually hosted by the game's publisher, which continues to exist and evolve while the player is away from the game.

– Worlds of Warcraft, LOTR Online, Star Wars Galaxies • References

– NASA is also currently developing an MMO (Astronaut: Moon, Mars and Beyond) for educational learning in science, technology, engineering and mathematics

• http://news.bigdownload.com/2009/02/19/feature-first-look-at-nasas-unreal-engine-3-based-mmo/– http://ipp.gsfc.nasa.gov/MMO/

– MMOG: A research framework for military training and education, Curt Bonk, DOD-Advanced Distributed Learning

– A Field Guide to educational simulations by Clark Aldrich– D.O.D uses Second Life to train their personnel for working in China by using a DOD

controlled island in the game replicating Chinahttp://www.mmocrunch.com/2008/01/10/mmodod/