PrototipAR/PintAR: Rapid Prototyping in Augmented Reality


Overview

Over the last few years, we have seen a growth of developer-oriented tools for Augmented Reality (AR) such as Microsoft’s Mixed Reality toolkit as well as Application Programming Interfaces (APIs) exposed by game engines like Unity3D and Unreal Engine that attempt to ease the entry to AR authoring.

However, these toolkits still require a high degree of programming proficiency, presenting multiple barriers and a steep learning curve for designers or non-programmers, which results in slow iteration cycles that impede creativity and leave designers fatigued.

Low-fidelity prototyping methods, especially sketching, facilitate ideation and experimentation and are natural to users from different backgrounds. In this project we combine the advantages of sketching with the unique affordances of head-mounted AR displays by enabling direct manipulation of digital content in AR while relying on a digital pen user interface for sketching on a tablet. PrototipAR and PintAR allow users to specify interactive behaviors without writing code and provide an implicit state machine to express different stages of an experiences. They also provide users with an aerial overview of digital content to facilitate debugging through a world-in-miniature view.


Publications

Nadir Weibel
Nadir Weibel
Associate Professor of Computer Science and Engineering
Danilo Gasques
Danilo Gasques
Ph.D. Candidate

My research focus is on improving remote and co-located surgical mentoring and training as well as creating intefaces for surgical guidance through eXtended Reality technology.

Tommy Sharkey
Tommy Sharkey
Ph.D. Student
Janet Johnson
Janet Johnson
Ph.D. Candidate