9/14/09
1
Latest SIGGRAPH job posting now linked from my home page: ◦ http://www.cs.rit.edu/~jmg/SIGGRAPHjobs.html
◦ Link from my home page ◦ Updated every 2 weeks or so.
Grad projects / Independent Study ◦ Link from my home page.
9/14/09
2
RIT is looking for a few good programmers! ◦ ACM Programming Contest ◦ 3 people teams ◦ Tryouts Tues, Sept 22nd at 5pm (ICL4) FREE FOOD!
◦ Contact Paul Tyman ([email protected]) by Sept 21st .
Audience Experience Actor Control / moCap Integration Asset Importing Audio Staging
9/14/09
3
The major goal for checkpoint 1 for all teams: ◦ Analysis – examine code to discover how
things currently work ◦ Design – design a solution to be implemented
for Checkpoint 2.
Checkpoint deliverable will be docs / presentation on your design.
Members: ◦ Joshua Kirby (G) ◦ Devin Warren
Tasks for Quarter ◦ Client “packaging” ◦ Putting audience members in their place! Position in theatre, that is. Work with audio team. Audience avatar.
9/14/09
4
Checkpoint 1 ◦ Client “packaging” Online asset repositiory (SVN?) Assure that all assets required for the performance
are locally available on client machine Some in XML file, some referenced in code. Must get them all!
Asset not there? Get it from repository.
Software ◦ Correct LUSTER / VT version ◦ All required plugins ◦ Program parameters (server locations, etc.)
Assets ◦ Object meshes ◦ Materials / Textures / Shaders ◦ Audio ◦ Etc.
Resource / Performance manifest?
9/14/09
5
Tasks for Checkpoint 1 ◦ Discover what gets loaded for current system ◦ Discover where things get loaded from
◦ Design a system such that if current VT distribution is out of date, then update. Individual components update OR Bulk update.
Members: ◦ John Lukasiewicz (G) ◦ Laura Wieme (G)
Tasks for Quarter ◦ Maya as LUSTER design tool Object import and export Scene import and export Materials / textures / shaders Rigged models (work with moCap team) Lighting design. Positional audio (work with audio team)
9/14/09
6
Checkpoint 1 ◦ Object design ◦ Scene design ◦ Material / Texture / Shaders ◦ Rigged characters
Tasks for Checkpoint 1 ◦ Explore the means by which objects, scenes, and
materials.etc are currently exported from Maya ◦ Explore current spec for moCap capable models.
◦ Documentation of proposed pipeline for object / scene design and moCap compatibility. NOTE: Scene design using Maya is new to LUSTER /
OGRE3D
9/14/09
7
Members: ◦ Kyle Shay (G) ◦ Ben Bloom (G) ◦ Brian Murphy
Tasks for quarter ◦ Live streaming audio ◦ Positional audio Attaching sounds to objects. (work with Asset/
audience) ◦ Audio control (work with staging)
Checkpoint 1 ◦ Focus on live streaming audio Singing / dialogue Can be internal / external to LUSTER.
9/14/09
8
Tasks for Checkpoint 1: ◦ Design of an audio subsystem to enable live
streaming audio Investigate VOIP solutions Recommendations on physical setup (i.e what
mikes, what environment, software, hardware, etc). New to LUSTER/VR, so experimentation expected.
Members: ◦ Emmett Coakley (G) ◦ Sean Janis (G)
Tasks for Quarter ◦ Tool for creating cues ◦ Tool for managing cues ◦ Tool for triggering cues ◦ Integrate tool for lighting design (Maya) –
work with Asset Import.
9/14/09
9
Stage Mgr app
3D Virtual stage
LUSTER
Virtual Theatre (LUA)
Predefined cues
Common sound, lighting, display libraries
9/14/09
10
Tasks for Checkpoint 1: ◦ Define an interface for the stage manager For managing and triggering cues. Cues currently defined in XML file…Explore how
they are represented…and how they are triggered.
◦ Mock-up of stage mgr interface (using FLASH for user interface).
Decided to combine the moCap integration and Actor Control teams ◦ Tasks from two teams are intimately linked. ◦ Crossover between task sets ◦ Everyone gets a turn in the suit
Set of tasks still distinct ◦ Combined team will be responsible for both
sets of tasks.
9/14/09
11
LUSTER
Virtual Theatre Layer
Shape Recorder
(measurand)
Motion Builder
3D Virtual stage
Stage Interface
moCap LUSTER plugin
MB plugin
network
BVH
Major components: ◦ moCap systems themselves OM Stage / measurand ShapeWrap III ◦ MotionBuilder (by Autodesk) Primary interface from moCap to any application ◦ MB Plugin (written by Andy Brown) Streams moCap data (in terms of model joints) from MB
to Internet ◦ LUSTER moCap Plugin (written by David) Accepts streamed moCap data and applies to rigged
character in LUSTER Character must be properly rigged (work with Asset
team)
9/14/09
12
Pipeline works well…BUT… ◦ Hard to position actors on virtual stage ◦ Hard for actors to exchange objects, drop
things, ect. ◦ Hard to assign moCap streams to different /
multiple virtual actors ◦ No good physical actor POV.
Members ◦ Stephen Sarnell (G) ◦ Anoop Thomas (G) ◦ Matt Kang ◦ Tom Wilson ◦ Junxia Xu
Student consultants: ◦ Abishek Moothedath ◦ Pranabesh Sinha
9/14/09
13
Major tasks for quarter: ◦ Basic moCap logistics for performance ◦ Allow actors to exchange objects Make use of Wiimote
◦ Allow for easy placement of actors on stage. ◦ Allow for easy matching of moCap streams
with Virtual Actors. ◦ Mechanism for more natural actor POV.
Tasks for Checkpoint I: ◦ Get moCap systems up and running Exercise existing pipeline Start with measurand.
◦ Design LUSTER interface for Actor Assistant: Placement of actor on stage
On/off/position – perhaps actor roster.
Assignment of moCap stream with actor Both currently in staging client.
◦ Design interaction mechanism for using Wiimote to exchange objects or other actor tasks.
9/14/09
14
Teams: ◦ Asset Import ◦ Audience Experience ◦ Audio ◦ moCap ◦ Staging
Questions so far?
Checkpoint 1 ◦ Monday, September 28 ◦ Checkpoint deliverable will primarily be
presentations: Describe designs to class as a whole Describe implementation plan
Explain how things might affect other teams.
Expectation: 15 minutes / team Time for discussion
9/14/09
15
Also on the 28th ◦ We will discuss deliverables for CP2 ◦ Primarily implementation of design
Between now and then ◦ In-class Announcements and such for first 5 minutes Team meeting time for remainder of class time.
◦ Brian, David, Abishek, Pranabesh, & I will be available for consultation.
LUSTER ◦ Runtime: http://darkwindmedia.com/Luster_0_19_0.exe
◦ Editor: http://www.darkwindmedia.com/
EditorCandidateReleases/v1.0.2/LusterEditor-v1.0.2-win32.zip
◦ VT code SVN: http://www.darkwindmedia.com/svn/vt
9/14/09
16
MB plugin: ◦ SVN:
http://ritvt-plugin.googlecode.com/svn/trunk
LUSTER moCap plugin: ◦ SVN:
http://www.davehuynh.com/svn/joglemotionplugin
Would like to continue using SVN for codebase
May also use SVN for asset/resource management? ◦ See what Audience Experience team codes up
with.
9/14/09
17
Take a break After the break ◦ LET THE GAMES BEGIN!!!
