ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring (CHI 2021)

Abstract

Traumatic injuries require timely intervention, but medical expertise is not always available at the patient’s location. Despite recent advances in telecommunications, surgeons still have limited tools to remotely help inexperienced surgeons. Mixed Reality hints at a future where remote collaborators work side-by-side as if co-located; however, we still do not know how current technology can improve remote surgical collaboration. Through role-playing and iterative-prototyping, we identify collaboration practices used by expert surgeons to aid novice surgeons as well as technical requirements to facilitate these practices. We then introduce ARTEMIS, an AR-VR collaboration system that supports these key practices. Through an observational study with two expert surgeons and five novice surgeons operating on cadavers, we find that ARTEMIS supports remote surgical mentoring of novices through synchronous point, draw, and look affordances and asynchronous video clips. Most participants found that ARTEMIS facilitates collaboration despite existing technology limitations explored in this paper.

Publication
In Conference on Human Factors in Computing 2021 (CHI 2021)

CHI2021 Presentation (5 min)

Project

Read more abou ARTEMIS here.

Danilo Gasques
Danilo Gasques
Ph.D. Candidate

My research focus is on improving remote and co-located surgical mentoring and training as well as creating intefaces for surgical guidance through eXtended Reality technology.

Janet Johnson
Janet Johnson
Ph.D. Candidate
Tommy Sharkey
Tommy Sharkey
Ph.D. Student
Nadir Weibel
Nadir Weibel
Associate Professor of Computer Science and Engineering

Related