Digital da Vinci

Presented by:Navin Harjani

Sikander MoradChristopher Sun

Overview

Purpose and scope Usage scenario Prototype system Alpha System Beta System Conclusion

Purpose and Scope

Current systems: Traditional painting Computer aided drawing

Users of one system are typically uncomfortable/unfamiliar with the other

Purpose and Scope

Digital da Vinci is an intermediary, combining aspects of both systems

Painting program which uses gestural input and large screen projection output

Designed for ease of use for all artists: Traditional Computer-based

Usage Scenario Drawing a mural (house scene):

Draws a house by tracing shapes Draws freehand a red flower Erases flower due to wrong color Mixes a lighter color of red Redraws flower with new color Notices the ability to copy from the help

screen Selects the flower and copies it several times Saves painting

Benefits Computer aided drawing:

Selecting, zooming, copying, moving Shapes Eraser Saving and loading In-system help

Traditional painting: Un-tethered input Large canvas size Mixing of colors Natural gestures

Paper Storyboard Presented to two types of users

An engineer An artist

Created for initial feedback: Functionality Gestures Basic GUI layout

Paper Storyboard

Computer Prototype

Done in Visual Basic .Net due to its usefulness in creating GUI’s

Attempted to incorporate most of the storyboard suggestions

Provided limited functionality

Computer Prototype

Prototype Feedback

No feedback was given for non-functional features

Unclear feedback for functional features in the Digi-Palette

Lack of help provided for functions Presence of a mixing area was

unclear

Prototype Feedback

The X-Y coordinates and the dynamic help were distracting

The user was not able to erase/undo an action or clear the Mixing area

Buttons were not clearly labeled No feedback or conformation was

given for the New and Save features

Prototype Evolution

Increased highlighting and labeling of objects in Digi-Palette

Digi-Help improvements Additional help pages The option to hide the help pages Increase dynamic content of help

pages Added an eraser to Digi-Palette

Prototype Evolution

Prompts for saving and exiting and saving over previously saved files

Dynamic cursor giving feedback on system status

Changed the color and background of the mixing area

Alpha System

Done in Visual Basic .Net

Incorporated suggestions from the feedback of the prototype

Increased functionality

Alpha Feedback

The mixing area and the custom colors need to be more obvious

Appearance between selected, non-selected and disabled buttons is not noticeable enough

The colors on the palette are not saved when switching screens

Alpha Feedback

Setting custom colors should be done with a dragging action

Eraser should not be used on Digi-Palette

Cursor feedback was not adequate Digi-Spectrum was counter-active

to our design goal

Beta System - Mouse

MOTIVATION TA feedback on alpha system Meet the functional requirements

of our initial design which were omitted in the Alpha system.

Try to create a unique gesture set which would easily be integrated in the SRE

Beta System - Mouse

Implemented entirely in PERL/TK1. Portability: Works on all

platforms.2. Flexibility: Easier to develop and

integrate into the SRE than VB.net.

Beta System - Mouse

Evolution of interface Added the omitted functionality Improved method of selection Improved cursor feedback for different

modes. Added highlighting and graying out of

unused buttons. Used unique mouse events to describe

actions which would be translated to our gesture set.

Beta System - Gestures

Required the translation of our interface to the Shared reality room.

Changed all the event bindings. Changed screen resolution and

buttons sizes. Constrain user action for error

prevention.

Beta System - Gestures UDP packets sent camera information of where the head and

hand of the user was and basic trigonometry was used to extrapolate these to where the user was pointing.

MOUSE UPMOUSE DOWN ARM EXTENDARM RETRACT

Beta System – Video

Future work

Increase performance of the body tracker. Utilize information from all cameras.

Through usability testing change our interface to reflect differences between mouse and gesture interface.

Two handed-gestures.

Conclusion

Iterative process allowed for us to meet the following HCI principles:

Know thy user: Artist and painters Feedback Natural mapping of gestures

MORE TESTING