Automated detection of surgical wounds in videos of open neck procedures using a mask R-CNN

TingYan Deng; Shubham Gulati; Ashwin Kumar; William Rodriguez; Benoit M. Dawant; Alexander Langerman

doi:10.1117/12.2580908

15 February 2021 Automated detection of surgical wounds in videos of open neck procedures using a mask R-CNN

TingYan Deng, Shubham Gulati, Ashwin Kumar, William Rodriguez, Benoit M. Dawant, Alexander Langerman

Proceedings Volume 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling; 1159817 (2021) https://doi.org/10.1117/12.2580908
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

Open surgery represents a dominant proportion of procedures performed, but has lagged behind endoscopic surgery in video-based insights due to the difficulty obtaining high-quality open surgical video. Automated detection of the open surgical wound would enhance tracking and stabilization of body-worn cameras to optimize video capture for these procedures. We present results using a mask R-CNN to identify the surgical wound (the “area of interest”, AOI) in image sets derived from 27 open neck procedures (a 2310-image training/validation set and a 1163-image testing set). Bounding box application to the surgical wound was reliable (F-1 > 0.905) in the testing sets with a <5% false positive rate (recognizing non-wound areas as the AOI). Mask application to greater than 50% of the wound area also had good success (F-1 = 0.831) under parameters set for high specificity. When applied to short video clips as proof-of-principle, the model performed well both with emerging AOI (i.e., identifying the wound as incisions were developed) and with recapture of the AOI following obstruction). Overall, we identified image lighting quality and the presence of distractors (e.g., bloody sponges) as the primary sources of model errors on visual review. These data serve as a first demonstration of open surgical wound detection using first-person video footage, and sets the stage for further work in this area.

Conference Presentation

Citation Download Citation

TingYan Deng, Shubham Gulati, Ashwin Kumar, William Rodriguez, Benoit M. Dawant, and Alexander Langerman "Automated detection of surgical wounds in videos of open neck procedures using a mask R-CNN", Proc. SPIE 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling, 1159817 (15 February 2021); https://doi.org/10.1117/12.2580908

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available