Bringing any medical 3D scan onto augmented reality hardware: a streamlined data pipeline

Paul Ganster; Maximilian Weber; Daniel Wild; Christina Gsaxner; Natalie Schellnegger; Jan Egger

doi:10.1117/12.2612563

4 April 2022 Bringing any medical 3D scan onto augmented reality hardware: a streamlined data pipeline

Paul Ganster, Maximilian Weber, Daniel Wild, Christina Gsaxner, Natalie Schellnegger, Jan Egger

Proceedings Volume 12037, Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications; 120370P (2022) https://doi.org/10.1117/12.2612563
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

This contribution presents a streamlined data pipeline to bring medical 3D scans onto Augmented Reality (AR) hardware. When a 3D scan is visualized on a 2D screen, depth information is lost and doctors have to rely on their experience to map the displayed data to the patient. Showing such a scan in AR addresses this problem, as one can view that scan in real 3D. To achieve this, the scan produced by a medical scanner has to be preprocessed by the user and brought onto the AR hardware. Usually, many manual steps are involved in achieving this, which require technical knowledge about the underlying software and hardware components and impede acceptance of this new technology by the target group, medical personnel. This work presents a streamlined pipeline for this process, leading to an enhanced user experience. The core component of the pipeline is a web application, to which a user can upload the direct output of a medical scanner. The scan can be interactively segmented by the user, after which both the scan and segment are stored on a server. Additionally, this paper introduces an AR application, which can be used to browse through patients and view their scans and previously created segments. We evaluate our streamlined data pipeline and AR application in a user study, reporting the results of a system usability questionnaire and a Thinking Aloud test.

Citation Download Citation

Paul Ganster, Maximilian Weber, Daniel Wild, Christina Gsaxner, Natalie Schellnegger, and Jan Egger "Bringing any medical 3D scan onto augmented reality hardware: a streamlined data pipeline", Proc. SPIE 12037, Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications, 120370P (4 April 2022); https://doi.org/10.1117/12.2612563

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available