ICHCI 2009This study examines physician–patient–interpreter communication in a health clinic using Distributed Cognition, highlighting how EMRs, paper documents, and exam room layout influence information flow. Findings suggest redesigning clinical spaces and technologies to support collaborative interaction, improve patient understanding, and enhance health literacy for LEP patients.
ICMI 2013This Grand Challenge evaluates predicting group dynamics and problem-solving success using multimodal data (speech, digital pen, video) from learning contexts. Results show reliable prediction of domain expertise and task outcomes across modalities, demonstrating that rich multimodal signals alone—independent of content analysis—can effectively assess group learning interactions.
PervasiveHealth 2013
Patient-centered health care and increased efficency are major goals of modern medicine. Research has shown that higher patient health literacy is linked to more successful health outcomes and the shift to electronic medical records (EMR) is hoped to increase efficency.
PervasiveHealth 2013
Understanding interaction with Electronic Health Records (EHR), often means to understand the multimodal nature of the physician-patient interaction, as well as the interaction with other materials (e.g.
Pervasive Health 2013We use the findings from two participatory design workshops and prototype evaluation to develop the basis for designing information displays with digital pen input.
CHI 2013Social movement trajectories are visualized as interactive path animations, allowing analysts to track group mobilization over time and geography. By mapping social media streams onto a dynamic spatial interface, the system highlights hotspots of activity and narrative shifts. Evaluation with activists shows improved understanding of movement evolution and identification of influential events.
PervasiveHealth 2012Paper-digital interface captures handwritten medical notes during emergencies and displays patient data on tablets instantly, improving coordination and reducing errors under pressure. The system integrates pen-based input with live digital visualization, ensuring critical information is always visible to care teams. Simulation evaluations demonstrate significant speed and accuracy gains compared to manual record-keeping.
CSCW 2012Pen-based toolkit enables educators to create collaborative language-learning exercises by combining paper worksheets with digital pens, automatically syncing handwritten responses to shared tablets. Instructors define prompts on paper; student answers are captured digitally for group review, fostering interactive peer feedback. Usability tests show increased engagement and seamless transition between analog and digital environments.
CHI 2012Digital pen-and-paper system records researchers’ handwritten field notes and automatically tags them with audio/video captured during observations, enabling seamless review of multimodal data. The system links ink strokes to contextual media, improving recall and reducing manual transcription efforts. Field studies show significant increases in data accuracy and efficiency compared to traditional note-taking methods.