+ All Categories
Home > Documents > Michael Lawo ([email protected]) Using Wearable Computing Technology to Empower the Mobile Worker TNC...

Michael Lawo ([email protected]) Using Wearable Computing Technology to Empower the Mobile Worker TNC...

Date post: 30-Dec-2015
Category:
Upload: stella-watts
View: 214 times
Download: 1 times
Share this document with a friend
21
Michael Lawo ([email protected]) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo , Otthein Herzog, Peter Knackfuß
Transcript
Page 1: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Using Wearable Computing Technology to Empower the Mobile Worker

TNC 2009 Malaga 11.6.2009

Michael Lawo, Otthein Herzog, Peter Knackfuß

Page 2: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Motivation

• Today, information access is usually possible - anytime and anywhere• There is always useful information - somewhere• Storage of information is often wanted or even needed

But:

• Information is still rarely used outside the classical office environment• E.g.

Page 3: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

The Desktop Computing Paradigm

stationary

User is focusedon the system

No interaction with the environment

Page 4: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

The Mobile Computing Paradigm

Page 5: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Wearable System

User Real World

The Vision of Wearable Computing

2-way interaction Environment sensitive

Context recognition Augmentation

Unobtrusive Always „on“ Highly integrated

Interaction and Context are the keys.

Page 6: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Page 7: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Working with a Wearable Computer

Wearable Computing often expects users to accomplish different tasks simultaneously

Primary Task Real world task Often manual tasks Mobility

Secondary Task Supporting computer task Interaction with the wearable system

Aircraft Maintenance

Car Production/TrainingHow to design the user interface?

Page 8: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Interaction Challenges in Wearable Computing

Challenges Information density

Screen size, encoding, etc.

Attention grabbing capabilities Social acceptance Use in a dual-task scenario

Human-Computer Communication Cycle by Bowman et al. [BKLP05]

Text Audio

Gestures

Special Purpose

Challenges Device limitations

Size, weight, power consumption Novel usage patterns Implicit input (context recognition) Use in a dual-task scenario

Page 9: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Wearable Computing Architecture

Application Design Space

Architecture Components

Page 10: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Wearable User Interface Toolkit

Features Development based on reusable components Development with limited knowledge about wearable computing I/O device independent specification

Model-based development, e.g. Concurrent Task Trees (CTT) [Paterno99]

Support for context-aware interfaces and automatic interface adaptation Part of the Open Wearable Computing Framework (OWCF)

WUI-Toolkit

Page 11: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Aircraft Disassembly Assistant

Page 12: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

UI Evaluation | HotWire Primary Task Simulator

Idea of the HotWire inspired by kid’s game Originally intended to train motor skills Rules

“Pass a ring from one end of the wire to the other end.”

“Don’t touch the wire with the ring!”

Simulates real world primary tasks Abstracts manual task characteristics Retains properties of wearable computing

E.g. being involved in physical manual tasks

Easy to learn Easy to build Usable in the laboratory

First Prototype

“Der heiße Draht” Commercial Product

Laboratory Experiment VersionCeBit 2007 HotWire Demo

Page 13: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Gesture Interaction Experiment

Page 14: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Context detection

Integration of context recognition system and supporting application for the part assembly (Front Light)

Context recognition Wristband Device Data Acquisition Module (DAM) Context recognition for task

tracking Application (Integration of OWCF

components) wearIT@work core framework JContextAPI WUI Speech recognition

Other features QBIC / OQO Zeiss Binocular Look-around

HMD Activity monitoring

Page 15: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Context detection motion jacket

Setup to annotate activities Recording of checkpoint

procedures Synchronization of 3 sensor

types (frequency, reliability) Re-labelling of 2 parallel activity

annotation streams Parallel work on activity spotting

in 2 sensor domains (motion, muscle activity)

Motion Jacket

UbiSenseTag

UbiSense (UWB) Base

Page 16: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Context detection tests and first results

(video)

Context Recognition in Car Production Supporting application for the part

assembly (Front Light)

Context recognition using Wristband Device Context Toolbox Machine Learning Techniques

HMMs Segmentation

Page 17: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Hand-Gesture Interaction

Page 18: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Robust Textile Systems

Page 19: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Systemarchitecture

Middleware

Operating System

Application

Service Framework

Page 20: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Conclusion

Wearable computing provides services for new user groups, especially in the professional environment Maintenance and assembly Emergency response Sports

Mobile Computing Systems are needed which enable dual-task environments with a primary real-world task

Mobile Systems are needed which use personal and environmental sensors in order to provide assistance functions on the move

Page 21: Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter.

Michael Lawo ([email protected])

Thank you for your attention.

Prof. Dr. Michael LawoTZI, University of [email protected]

German chancellor Angela Merkel at TZI’s CeBIT booth


Recommended