Souipas, Spyridon, Nguyen, Anh 
ORCID: 0000-0002-1449-211X, Laws, Stephen G, Davies, Brian L and Baena, Ferdinando Rodriguez Y
(2023)
SimPS-Net: Simultaneous Pose & Segmentation Network of Surgical Tools.
IEEE Transactions on Medical Robotics and Bionics, 5 (3).
p. 1.
|
PDF
SIMPSNet_8_page.pdf - Author Accepted Manuscript Download (3MB) | Preview |
Abstract
Localisation of surgical tools during operation is of paramount importance in the context of robotic assisted surgery. 3D pose estimation can be utilised to explore the interaction of tools with registered tissue and improve the motion planning of robotic platforms, thus avoiding potential collisions with external agents. With the problems of traditional tracking systems being cost and the need to redesign surgical tools to accommodate markers, there has been a shift towards image-based, markerless tracking techniques. This study introduces a network capable of detecting and localising tools in 3D using a monocular setup. For training and validation, a novel dataset, 3dStool, was produced, and the network was trained to obtain a mean Dice coefficient of 85.0% for detection, along with a mean position and orientation error of 5.5mm and 3.3° respectively. The presented method is significantly more versatile than various state of the art solutions, as it requires no prior knowledge regarding the 3D structure of the tracked tools. The results were compared to standard pose estimation networks using the same dataset and demonstrated lower errors along most metrics.In addition, the generalisation capabilities of the proposed network were explored by performing inference on a previously unseen pair of scissors.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Image segmentation, Surgery, Pose estimation, Three-dimensional displays, Standards, Deep learning, Training, Surgical tool detection, instance segmentation, 3D pose estimation, monocular, surgical tool localisation |
| Divisions: | Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 25 Jul 2023 15:36 |
| Last Modified: | 15 Mar 2024 18:05 |
| DOI: | 10.1109/tmrb.2023.3291022 |
| Related URLs: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3171908 |
Dimensions
Dimensions
