Tissue segmentation for workflow recognition in open inguinal hernia repair training

TitleTissue segmentation for workflow recognition in open inguinal hernia repair training
Publication TypeConference Paper
Year of Publication2022
AuthorsKlosa, E., Hisey R., Nazari T., Wiggers T., Zevin B., Ungi T., & Fichtinger G.
Conference NameSPIE Medical Imaging
Date Published02/2022
PublisherSPIE Medical Imaging
Conference LocationSan Diego
Keywordsopen inguinal hernia repair, segmentation, surgical training, U-Net, workflow recognition

PURPOSE: As medical education adopts a competency-based training method, experts are spending substantial amounts of time instructing and assessing trainees’ competence. In this study, we look to develop a computer-assisted training platform that can provide instruction and assessment of open inguinal hernia repairs without needing an expert observer. We recognize workflow tasks based on the tool-tissue interactions, suggesting that we first need a method to identify tissues. This study aims to train a neural network in identifying tissues in a low-cost phantom as we work towards identifying the tool-tissue interactions needed for task recognition. METHODS: Eight simulated tissues were segmented throughout five videos from experienced surgeons who performed open inguinal hernia repairs on phantoms. A U-Net was trained using leave-one-user-out cross validation. The average F-score, false positive rate and false negative rate were calculated for each tissue to evaluate the U-Net’s performance. RESULTS: Higher F-scores and lower false negative and positive rates were recorded for the skin, hernia sac, spermatic cord, and nerves, while slightly lower metrics were recorded for the subcutaneous tissue, Scarpa’s fascia, external oblique aponeurosis and superficial epigastric vessels. CONCLUSION: The U-Net performed better in recognizing tissues that were relatively larger in size and more prevalent, while struggling to recognize smaller tissues only briefly visible. Since workflow recognition does not require perfect segmentation, we believe our U-Net is sufficient in recognizing the tissues of an inguinal hernia repair phantom. Future studies will explore combining our segmentation U-Net with tool detection as we work towards workflow recognition.

PerkWeb Citation KeyKlosa2022a
Refereed DesignationUnknown