Download - Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges

Otto-von-Guericke-Universität Magdeburg, User Interface Colloquium, November 2, 2009

Paper-Digital User Interfaces

Beat Signer Department of Computer Science

Vrije Universiteit Brussel

Applications, Frameworks and Future Challenges

http://www.beatsigner.com

http://www.beatsigner.com/

http://www.beatsigner.com/

User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]

Bridging the Paper-Digital Divide


Personal Background

Research on paper-digital and cross-media

solutions over the last 8 years

realised more than 20 interactive paper applications

Involved in 2 European projects

Paper++ (2001-2004)

- focus on enhanced reading

PaperWorks (2005-2008)

- enhanced reading, writing and publishing


Applications

Enhanced Reading

interactive paper maps

interactive festival brochures

educational materials

auction brochures

scientific publications

…

Enhanced Writing

photo album

researcher's notebook

mammography annotation

query by sketching

…

Paper-based Interfaces

PaperPoint

document proof-editing

digital libraries

video analysis tool

educational games

Art Installations

Lost Cosmonaut

Generosa Enterprise

Interactive Tabletops

photo browser

collaborative sketch tool


EdFest Project


EdFest Documents


Design Challenges


Rough Guide


iGesture Framework

iGesture Workbench

create/test gesture sets and

algorithms

Different modalities

digital pen, tablet PC,

mouse, Wii remote, …

multimodal gestures

Open Source

http://www.igesture.org


Print-n-Link

Handle existing PDF

documents

e.g. research papers

Automatic link autho-

ring at print time

applicable to other

domains


PaperPoint Presentation Tool

Mobile PowerPoint

presentation tool

non-linear presentations

real-time annotations

digital whiteboard

...

Multi-pen support

brainstorming


PaperPoint Stickers

Empty stickers linked

to specific PowerPoint

slides containing

text

images

movies, ...

Effective tool for inter-

active paper mockups


PaperProof: Paper-Digital Proof-Editing

User Interface Colloquium, November 2, 2009 Beat Signer, [email protected] 14

Mammography Annotations


The Lost Cosmonaut

Writing as a collaborative

act of memory and story-

telling

Reading, writing and

narrative as an act of

making sense

Handwriting as a tool for

human computer

interaction

In collaboration with Axel Vogelsang,

Artists in Labs Programme


iPaper Research

Link Metamodel (RSL) Tools

Cross-Media Frameworks Applications


RSL Metamodel and iServer


Links

Users

Layers Plug-ins

Structure

Active

Content


Active Components

Button

Slider

Slider2D

DateSelector

Browser

MapSelector

Rating

Capture

CaptureAndSpeak

Image

Sound

Movie

SQLClient

XCMRequest

ClientCtrlRequest

PaperPointControl

PaperPointAnnot

...


Cross-Media Authoring and Publishing

Manual link authoring

Content-driven

publishing

e.g. EdFest brochure

Automatic link authoring

e.g. Print-n-Link

Collaborative authoring


Content-driven Cross-Media Publishing

XCM content publishing

XML data

of festival

venues

and events

iServer cross-media link server

import

publish

PDF

XML link

definition

data

iPublish publishing framework

Structure Style

XSL CSS

Information-centric approach


Interactive Paper 2.0

consumers /

publishers

books

publisher

web pages

videos

presentation slides


Interactive Paper 2.0 ...

Global and open architecture instead of isolated

solutions

Two main challenges to be addressed

unqiue addressing and resolving of interactive

paper services

- requires a global paper lookup service (PLS) similar to the DNS on the Internet

service oriented architecture to enable cross-

application interaction and composition


Interactive Paper 2.0 ...

It is not only about enabling interactions accross

different interactive paper solutions

integegration with existing paperless information

spaces (e.g. Web 2.0)

personal cross-media information management

Are we missing a basic layer in existing

interactive paper architectures?


Future Challenges

Design

visual encoding of interactive areas and functionality

interaction design

- online/offline processing, lack of modal dialogues, ...

Interactive Paper 2.0

global publishing and interaction architecture

collaborative authoring and information sharing

seamless integration with personal cross-media

information management environments


Conclusions

Interactive paper framework (iPaper)

information-centric approach supports different

technologies, functionalities and applications

separation of authoring and programming

rapid prototyping

Innovative authoring and publishing tools

manual, content-driven, automatic and collaborative

Future Interactive Paper 2.0 challenges!


Further Information

Presentation available on

http://www.slideshare.net/signer/

Research papers about the presented applications

and frameworks are available on

http://vub.academia.edu/BeatSigner

Fundamental Concepts for Interactive Paper

and Cross-Media Information Spaces, Beat

Signer, ISBN 978-3-8370-2713-6, May 2008