Date post: | 14-Jan-2015 |
Category: |
Documents |
Upload: | nvalkanova |
View: | 378 times |
Download: | 4 times |
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
TALLER: LLENGUATGES AUDIOVISUALS I NARRATIVA INTERACTIVA
Nina Valkanova & Marco Romeo
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
ABOUT NINA
• Computer scientist and media designer • PhD Candidate at the Interactive Technologies Group• Interested in interaction design for urban media displays • Teaching at the UPF
Taller de Sistemas Interactivos II (2009, 2010, 2011)
• [email protected]://ninavalkanova.comvia the Moodle
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
ROADMAP
THEORYConcepts of
Audio-Visual Language
THEORYConcepts of
Audio-Visual Language
THEORYHypertextInterfaces
Interactive Narrative
THEORYHypertextInterfaces
Interactive Narrative
WORKSHOPCamera
Interaction
WORKSHOPCamera
Interaction
Blob trackingBlob tracking
PRACTICEApplication of Concepts
from Audio-Visual Language
PRACTICEApplication of Concepts
from Audio-Visual Language
Color trackingColor tracking
FiducialsFiducials
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
ABOUT THIS CLASS
• Workshop on the creation of camera interactions• Practical exercises• Group work – 2 or 3 people.
– “Pair programming”– Form your group NOW and send US an email with your names TODAY– No FACEBOOK please
• Evaluation - next slide
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EVALUATION
• Presence – evaluated individually. 80% presence from practice (Marco) and workshop (Marco and Nina)
• Assignments – evaluated in group• Need to be completed IN CLASS • Submission – via Moodle.
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
XBOX GAME
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
COMPUTER VISION
• Creating “seeing” applications• Feeding an application with a series of images
(video, or single image) • Analyzed for something particular (face, light,
color, object)
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
APPLICATIONS
• Robotics• Surveillance machines• Weapons systems • Games• Touchscreen interfaces• Interactive installations
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
MINORITY REPORT (2002)
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
FULL-BODY GAME
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
M-TOUCH
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EXERCISE 1
• Download from the course’s page the document “Processing_OpenCV_JMyron_PSEye.pdf”
• Follow the installation instructions step by step
• Make sure you have step 5. (simple exercise) working
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
BLOB TRACKING
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
BLOB TRACKING
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EXERCISE 2
• Open the BLOBS example of OpenCV and have a look at it
• Using the starting example from step 5. (of the instructions) – make the BLOBS example of the OpenCV library work with the image data obtained from JMyron opencv.copy(img,width,0,0,width,height,0,0,width,height);
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EXERCISE 2
• Reminder from exercise 1: this code makes possible that Jmyron image data can be used by OpenCV
m.update(); int[] img = m.image(); loadPixels(); opencv.copy(img,width,0,0,width,height,0,0,width,height); updatePixels();
• Put this piece code in a separate function called JMyron2OpenCV(int w, int h, JMyron buffer)
• In the beginning of this function put the following code, which cleans the OpenCV buffer
int[] cleanPx = new int[w*h];opencv.copy(cleanPx,w,0,0,w,h,0,0,w,h);
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EXERCISE 2
• The interesting part: where should you call the function?JMyron2OpenCV
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
EXERCISE 3
• Control a video using camera interaction:• Extend your blob tracking sketch by the following:– Add a window showing a video playback (similar to
exercise done with Marco; use the Loop video example)– Program an interaction controlling the playback of the
video (stop / play), which uses the number of blobs detected by the camera
Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011
FOR NEXT TIME
• Deadline: 1 June 17:00h • Submit to the Moodle a file with the commented code of
“step 5: simple exercise”, explaining each code step• Submit to the Moodle your first blob-tracking sketch
(exercise 2)• Submit to the Moodle a ZIPPED archive containing your
sketch about video interaction and blob-tracking, and the data folder with the video. Use the loop video example. (exercise 3)