PaperToPlace - Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences

UIST 2023 Paper instructions are a mainstream medium for sharing knowledge. However, consuming such instructions and translating them into activities can be inefficient due to the lack of connectivity with the physical environment. PaperToPlace is a novel workflow comprising an authoring pipeline, which allows the authors to rapidly transform and spatialize existing paper instructions into an MR experience, and a consumption pipeline, which computationally places each instruction step at an optimal location that is easy to read and does not occlude key interaction areas. This is a collaborative project with Adobe Research.