Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges

Paper-Digital User Interfaces
Applications, Frameworks and Future Challenges
Beat Signer
Department of Computer Science
Vrije Universiteit Brussel

http://www.beatsigner.com

Otto-von-Guericke-Universität Magdeburg, User Interface Colloquium, November 2, 2009

Bridging the Paper-Digital Divide

User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be

Personal Background
 Research on paper-digital and cross-media
solutions over the last 8 years
 realised more than 20 interactive paper applications
 Involved in 2 European projects
 Paper++ (2001-2004)
- focus on enhanced reading
 PaperWorks (2005-2008)
- enhanced reading, writing and publishing


Applications
 Enhanced Reading  Enhanced Writing
 interactive paper maps  photo album
 interactive festival brochures  researcher's notebook
 educational materials  mammography annotation
 auction brochures  query by sketching
 scientific publications  …
 …
 Art Installations
 Paper-based Interfaces  Lost Cosmonaut
 PaperPoint  Generosa Enterprise
 document proof-editing
 digital libraries  Interactive Tabletops
 video analysis tool  photo browser
 educational games  collaborative sketch tool


EdFest Project


EdFest Documents


Design Challenges


Rough Guide


iGesture Framework
 iGesture Workbench
 create/test gesture sets and
algorithms

 Different modalities
 digital pen, tablet PC,
mouse, Wii remote, …
 multimodal gestures

 Open Source
 http://www.igesture.org


Print-n-Link
 Handle existing PDF
documents
 e.g. research papers
 Automatic link autho-
ring at print time
 applicable to other
domains


PaperPoint Presentation Tool
 Mobile PowerPoint
presentation tool
 non-linear presentations
 real-time annotations
 digital whiteboard
 ...

 Multi-pen support
 brainstorming


PaperPoint Stickers
 Empty stickers linked
to specific PowerPoint
slides containing
 text
 images
 movies, ...
 Effective tool for inter-
active paper mockups


PaperProof: Paper-Digital Proof-Editing


Mammography Annotations

User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be 14

The Lost Cosmonaut
 Writing as a collaborative
act of memory and story-
telling
 Reading, writing and
narrative as an act of
making sense
 Handwriting as a tool for
human computer
interaction

In collaboration with Axel Vogelsang,
Artists in Labs Programme


iPaper Research
Link Metamodel (RSL) Tools

Cross-Media Frameworks Applications


RSL Metamodel and iServer


Structure

Links

Users

Layers
Plug-ins Active
Content


Active Components
Button Image

Slider Sound

Slider2D Movie

DateSelector SQLClient

Browser XCMRequest

MapSelector ClientCtrlRequest

Rating PaperPointControl

Capture PaperPointAnnot

CaptureAndSpeak ...


Cross-Media Authoring and Publishing
 Manual link authoring
 Content-driven
publishing
 e.g. EdFest brochure
 Automatic link authoring
 e.g. Print-n-Link
 Collaborative authoring


Content-driven Cross-Media Publishing

XML link
XCM iPublish definition
content publishing publishing framework
data

publish
iServer
Structure Style
cross-media link server

import
PDF

XML data XSL CSS
of festival
venues
and events Information-centric approach

Interactive Paper 2.0
web pages
consumers /
publishers
publisher

videos
books

presentation slides


Interactive Paper 2.0 ...
 Global and open architecture instead of isolated
solutions
 Two main challenges to be addressed
 unqiue addressing and resolving of interactive
paper services
- requires a global paper lookup service (PLS)
similar to the DNS on the Internet
 service oriented architecture to enable cross-
application interaction and composition


Interactive Paper 2.0 ...
 It is not only about enabling interactions accross
different interactive paper solutions
 integegration with existing paperless information
spaces (e.g. Web 2.0)
 personal cross-media information management
 Are we missing a basic layer in existing
interactive paper architectures?


Future Challenges
 Design
 visual encoding of interactive areas and functionality
 interaction design
- online/offline processing, lack of modal dialogues, ...
 Interactive Paper 2.0
 global publishing and interaction architecture
 collaborative authoring and information sharing
 seamless integration with personal cross-media
information management environments


Conclusions
 Interactive paper framework (iPaper)
 information-centric approach supports different
technologies, functionalities and applications
 separation of authoring and programming
 rapid prototyping
 Innovative authoring and publishing tools
 manual, content-driven, automatic and collaborative
 Future Interactive Paper 2.0 challenges!


Further Information
 Presentation available on
 http://www.slideshare.net/signer/

 Research papers about the presented applications
and frameworks are available on
 http://vub.academia.edu/BeatSigner

 Fundamental Concepts for Interactive Paper
and Cross-Media Information Spaces, Beat
Signer, ISBN 978-3-8370-2713-6, May 2008

Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges

More Related Content

What's hot (20)

Similar to Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges (20)

More from Beat Signer (20)

Recently uploaded (20)

Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges