loading page

Intraoperative Patient Specific Volumetric Reconstruction and 3D Visualization for Laparoscopic Liver Surgery
  • +5
  • Luca Boretto,
  • Egidijus Pelanis,
  • Alois Regensburger,
  • Kaloian Petkov,
  • Rafael Palomar,
  • Åsmund Fretland,
  • Bjørn Edwin,
  • Ole Jakob Elle
Luca Boretto
Siemens Healthcare AS, University of Oslo

Corresponding Author:[email protected]

Author Profile
Egidijus Pelanis
Oslo University Hospital
Author Profile
Alois Regensburger
Siemens Healthineers AG
Author Profile
Kaloian Petkov
Siemens Medical Solutions USA Inc Princeton
Author Profile
Rafael Palomar
Oslo University Hospital, Norwegian University of Science and Technology
Author Profile
Åsmund Fretland
Oslo University Hospital
Author Profile
Bjørn Edwin
Oslo University Hospital, University of Oslo
Author Profile
Ole Jakob Elle
Oslo University Hospital, University of Oslo
Author Profile

Abstract

Despite the benefits of minimally invasive surgery, interventions such as laparoscopic liver surgery present unique challenges, like the significant anatomical differences between preoperative images and intraoperative scenes due to pneumoperitoneum, patient pose, and organ manipulation by surgical instruments. To address these challenges, we propose a method for intraoperative 3D reconstruction of the surgical scene, including vessels and tumors, without altering the surgical workflow. The technique combines Neural Radiance Field (NeRF) reconstructions from tracked laparoscopic videos with ultrasound 3D compounding. We evaluate the accuracy of our reconstructions on a clinical laparoscopic liver ablation dataset, consisting of laparoscope and patient reference poses from optical tracking, laparoscopic and ultrasound videos, as well as preoperative and intraoperative CTs. We propose a solution to compensate for liver deformations due to pressure applied during ultrasound acquisitions, improving the overall accuracy of the 3D reconstructions compared to the ground truth intraoperative CT with pneumoperitoneum. We train a unified NeRF from the ultrasound and laparoscope data, which allows real-time view synthesis providing surgeons with comprehensive intraoperative visual information for laparoscopic liver surgery.
12 Nov 2024Submitted to Healthcare Technology Letters
13 Nov 2024Submission Checks Completed
13 Nov 2024Assigned to Editor
13 Nov 2024Reviewer(s) Assigned
22 Nov 2024Review(s) Completed, Editorial Evaluation Pending
25 Nov 2024Editorial Decision: Accept