Levels of Reality in User Interfaces

Alissa Cooper, Tufts University Department of Computer Science · Robert Jacob

Background

“[Human Computer Interaction is] the discipline concerned with the design, evaluation, and implementation ofinteractive computing systems for human use and with the study of the major phenomena surrounding them.”Hewitt, et al. (2002). There are many different types of user interfaces used in Human Computer Interaction.Graphical User Interface is a technique where the user interacts with graphical elements. In 1983 BenShneiderman found that Direct Manipulation system “helps the user to deal with the problem directly”.Interacting with an animatronic is another interface where the user interacts with a realistic looking robot.Augmented Reality uses live video imagery and computer-generated graphics. It is interactive in real time andis registered in 3 dimensions. 3D Graphical Model is a different interface where the user interacts with acomputer-simulated environment.

Zoobs are a children’s building toy that can be connected in 3 different ways

Claw-to-Claw Ball-to-Claw Notch-to-Notch

The experiment starts with 4 multiple choice spatial aptitudetests. After the tests the experiment begins. One of fouruser interfaces will be used to give subject directions. Allvocal instructions are the same for each interface

Results

The pilot data from the experiments is the only data collected so far.The pilot data suggests the animatronic will lower the number of errors made and will decrease the time needed when completing the task. Also, theconditions that integrate more reality increase the amount of time the user remains focused on the interface.

Conclusion

To date it appears that the level of reality seems to increase performance and encourages more interaction between the user and the interface.

Abstract

Four different user interfaces are being tested in giving instructions on assembling a motorcycle part using a child’s assembly toy. The four user interface tests are the following:using a GUI condition, using an animatronic to give directions, using an augmented reality condition, and using a 3D graphical monitor condition. Each of 4 different userinterfaces are being tested to determine which technique of giving directions helps the subject build a motorcycle part more efficiently. By having all the interfaces only differ inone aspect that aspect of how the subject perceives the directions being given should change how well they can build the motorcycle part. By determining which interface isbetter at conveying directions, it could potentially improve how companies compose directions on how to use their product. It could help improve a technique on teachingsomeone something new.

GUI GUI consists of pictures of the animatronicThere are 2-3 pictures of the animatronic for each stepEach picture in the step is a piece of the total move the animatronic does

AnimatronicsFull sized life-like animated figure that uses over20 distinct moves to show each step. He uses therotation and movement of his hands and arms toshow how to connect the Zoobs

Augmented RealityA video of the animatronic is watched through aheadset (HMD). Subjects build the motorcycle partin the real world

3D Graphical MonitorUses a monitor to view video or movements

Wizard of Oz MethodIf an error is made, the appropriate visual and sound will play. The stepthe error was on will then repeat.This will repeat until the error is fixedand then interface moves to the next step

Methods