1

Supporting an integrated paper-digital workflow for observational research

IUI 2011Paper-digital workflow tool lets researchers annotate paper field notes while simultaneously digitizing observations to a database for analysis. The system tracks handwritten entries and timestamps, linking them to corresponding digital records, enabling smoother transitions between physical note-taking and software review. Field evaluations show reduced transcription errors and improved research efficiency in observational studies.

Ubiquitous sketching for social media

Mobile HCI 2011Sketch-driven social media tool lets users draw on paper that is auto-uploaded to online platforms via smartphone capture. Low-latency image processing recognizes sketches and converts them into shareable digital content, enabling instant social sharing without specialized hardware. Field studies demonstrate increased user engagement and creativity compared to text-only posting.

Enabling social interactions through real-time sketch-based communication

UIST 2010UbiSketch is a tool for ubiquitous real-time sketch-based communication enabling people to create doodles, drawings, and notes with digital pens and paper and publish them quickly and easily via their mobile phones

Exploring pen and paper interaction with high-resolution wall displays

UIST 2010Hiperpaper integrates pen-and-paper controls with ultra-scale wall displays, allowing users to sketch on standard paper that appears at full resolution on massive screens. The system uses overhead cameras to capture ink and position data, enabling seamless transitions between tangible and digital drawing. Participants reported improved accuracy and fluidity when switching across mediums compared to typical tablet-only workflows.

Hiperpaper: introducing pen and paper interfaces for ultra-scale wall displays

UIST 2010We introduce HIPerPaper, a novel digital pen and paper interface that enables natural interaction with the HIPerSpace wall, a 31.8 by 7.5 foot tiled wall display of 268,720,000 pixels. HIPerPaper provides a flexible, portable, and inexpensive medium for interacting with large high-resolution wall displays.

Introducing multimodal paper-digital interfaces for speech-language therapy

ASSETS 2010A multimodal interface combines printed worksheets with digital tablets and speech recognition to support speech-language therapy exercises. Users write or tap on paper prompts to trigger audio feedback, while the system provides real-time pronunciation guidance, enhancing patient engagement and clinician efficiency. Qualitative evaluation shows improved therapy outcomes by blending tactile and audiovisual modalities.

Interactive paper as a reading medium in digital libraries

ECDL 2008Interactive paper extensions for digital libraries let readers tap or annotate printed pages to fetch definitions, citations, and multimedia content, creating a seamless link between physical documents and library databases to enhance reading and exploration.

Pen and paper-based interaction with the Semantic Desktop

DAS 2008Pen-and-paper interface for the Semantic Desktop, linking handwritten notes to digital artifacts so users can annotate or query files by writing on paper while the system automatically updates or retrieves related documents.

Semantic eInk: Pen and Paper-based Interaction with the Semantic Desktop

ICDAR 2008System for semantic annotation of handwritten notes overlaying digital context, enabling seamless integration of pen-based input with document analysis to support advanced search and retrieval of handwritten content.

A model for mapping between printed and digital document instances

DocEng 2007Formal model linking printed documents and their digital counterparts, enabling bidirectional navigation and synchronization so changes in print or PDF update the other, supporting consistent document workflows.