ETRA 2012Mobile eye-tracking system records pilot gaze during flight simulations to study cockpit workload and information-seeking behavior. Data analysis reveals patterns of visual attention linked to task complexity, informing design of adaptive cockpit interfaces. Field tests show the platform collects high-fidelity gaze data without interfering with pilot performance.
ITS 2012Detailed study of reading activities uses video and gaze tracking to capture how users annotate, scroll, and reference documents on desktop displays. Analysis identifies patterns such as frequent context-switching and multitasking, guiding design of interactive workspaces that integrate pen, touch, and keyboard inputs. Recommendations include adaptive layouts and gesture shortcuts to reduce cognitive load during active reading sessions.
ICMI 2012Multimodal system analyzes speech, gesture, and facial cues from group interactions to predict individual expertise and leadership roles in collaborative learning. By training machine learning models on synchronized audio-visual data, the approach identifies patterns of influence and knowledge sharing. Results show the model predicts leadership emergence with over 80% accuracy, guiding interventions for effective team facilitation.
CHI 2012The TAP & PLAY toolkit allows educators to design interactive language exercises on paper, where learners tap printed prompts with a digital pen to receive instant audio feedback and gamified quizzes on tablet devices. The system bridges paper and digital learning by converting pen strokes into digital events, fostering active participation and immediate correction. Deployment in classrooms shows increased student motivation and measurable language gains.
IUI 2012Overlays allow multiple users to annotate ultra-scale display walls simultaneously by projecting personalized transparent layers, enabling private notes and group discussion without obscuring base content. Each participant’s input appears on separate virtual layers, reducing interference and enhancing coordination. User feedback indicates overlays improve task parallelism and decrease communication overhead in collaborative teams.
IUI 2011PaperSketch bridges paper and digital whiteboards for remote teams by capturing sketches on paper and streaming them live to a shared canvas. Low-latency ink recognition ensures that collaborators see each other’s drawings in real time, enabling fluid, co-located feels despite physical distance. User studies indicate increased creativity and coordination compared to voice-only collaboration.
IUI 2011Paper-digital workflow tool lets researchers annotate paper field notes while simultaneously digitizing observations to a database for analysis. The system tracks handwritten entries and timestamps, linking them to corresponding digital records, enabling smoother transitions between physical note-taking and software review. Field evaluations show reduced transcription errors and improved research efficiency in observational studies.
Mobile HCI 2011Sketch-driven social media tool lets users draw on paper that is auto-uploaded to online platforms via smartphone capture. Low-latency image processing recognizes sketches and converts them into shareable digital content, enabling instant social sharing without specialized hardware. Field studies demonstrate increased user engagement and creativity compared to text-only posting.
UIST 2010UbiSketch is a tool for ubiquitous real-time sketch-based communication enabling people to create doodles, drawings, and notes with digital pens and paper and publish them quickly and easily via their mobile phones
UIST 2010Hiperpaper integrates pen-and-paper controls with ultra-scale wall displays, allowing users to sketch on standard paper that appears at full resolution on massive screens. The system uses overhead cameras to capture ink and position data, enabling seamless transitions between tangible and digital drawing. Participants reported improved accuracy and fluidity when switching across mediums compared to typical tablet-only workflows.