Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis
Aim: Images in different laparoscopic cholecystectomy datasets are acquired using various camera models, parameters, and settings, with the annotation methods varying by institution. These factors result in inconsistent inference performance of the network model. This study aims to identify the opti...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
OAE Publishing Inc.
2024
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/117555/ http://psasir.upm.edu.my/id/eprint/117555/1/117555.pdf |
| _version_ | 1848867280716300288 |
|---|---|
| author | Ghobadi, Vahideh Ismail, Luthffi Idzhar Hasan, Wan Zuha Wan Ahmad, Haron Ramli, Hafiz Rashidi Norsahperi, Nor Mohd Haziq Tharek, Anas Hanapiah, Fazah Akhtar |
| author_facet | Ghobadi, Vahideh Ismail, Luthffi Idzhar Hasan, Wan Zuha Wan Ahmad, Haron Ramli, Hafiz Rashidi Norsahperi, Nor Mohd Haziq Tharek, Anas Hanapiah, Fazah Akhtar |
| author_sort | Ghobadi, Vahideh |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Aim: Images in different laparoscopic cholecystectomy datasets are acquired using various camera models, parameters, and settings, with the annotation methods varying by institution. These factors result in inconsistent inference performance of the network model. This study aims to identify the optimal network model architecture for liver and gallbladder segmentation from several options. Then, the performance and robustness of the optimal network model are evaluated using an independent dataset that is not included in the training. Methods: The public dataset, CholecSeg8k, was utilized as the input for the network model training, validation, and testing. A local private dataset from KPJ Damansara Hospital, Selangor, Malaysia, was used for testing purposes only. For the implementation of liver and gallbladder segmentation, segmentation models, a public Python library was employed. Results: Among the experiments, highly accurate liver and gallbladder segmentation results were achieved using the feature pyramid network (FPN) architecture as the network model, with the Inception-ResNet-v2 architecture as the network backbone. The best-trained network model resulted in a loss of 0.070955, a mean intersection over union (IoU) score of 0.95896, and a mean F1-score of 0.9773 on the test set. However, visualized results for the private dataset contained considerable false-negative areas. Conclusion: The proposed automated technique has the potential to serve as an alternative to the conventional indocyanine green injection along with near-infrared fluorescence imaging (ICG-NIRF)-based method for liver and gallbladder segmentation during laparoscopic cholecystectomy. Future work will focus on enhancing the results of the private dataset. Additionally, a surgeon-assistant robotic arm that will use the liver and gallbladder segmentation results for camera steering will be analyzed. |
| first_indexed | 2025-11-15T14:33:59Z |
| format | Article |
| id | upm-117555 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T14:33:59Z |
| publishDate | 2024 |
| publisher | OAE Publishing Inc. |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-1175552025-05-29T06:55:09Z http://psasir.upm.edu.my/id/eprint/117555/ Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis Ghobadi, Vahideh Ismail, Luthffi Idzhar Hasan, Wan Zuha Wan Ahmad, Haron Ramli, Hafiz Rashidi Norsahperi, Nor Mohd Haziq Tharek, Anas Hanapiah, Fazah Akhtar Aim: Images in different laparoscopic cholecystectomy datasets are acquired using various camera models, parameters, and settings, with the annotation methods varying by institution. These factors result in inconsistent inference performance of the network model. This study aims to identify the optimal network model architecture for liver and gallbladder segmentation from several options. Then, the performance and robustness of the optimal network model are evaluated using an independent dataset that is not included in the training. Methods: The public dataset, CholecSeg8k, was utilized as the input for the network model training, validation, and testing. A local private dataset from KPJ Damansara Hospital, Selangor, Malaysia, was used for testing purposes only. For the implementation of liver and gallbladder segmentation, segmentation models, a public Python library was employed. Results: Among the experiments, highly accurate liver and gallbladder segmentation results were achieved using the feature pyramid network (FPN) architecture as the network model, with the Inception-ResNet-v2 architecture as the network backbone. The best-trained network model resulted in a loss of 0.070955, a mean intersection over union (IoU) score of 0.95896, and a mean F1-score of 0.9773 on the test set. However, visualized results for the private dataset contained considerable false-negative areas. Conclusion: The proposed automated technique has the potential to serve as an alternative to the conventional indocyanine green injection along with near-infrared fluorescence imaging (ICG-NIRF)-based method for liver and gallbladder segmentation during laparoscopic cholecystectomy. Future work will focus on enhancing the results of the private dataset. Additionally, a surgeon-assistant robotic arm that will use the liver and gallbladder segmentation results for camera steering will be analyzed. OAE Publishing Inc. 2024 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/117555/1/117555.pdf Ghobadi, Vahideh and Ismail, Luthffi Idzhar and Hasan, Wan Zuha Wan and Ahmad, Haron and Ramli, Hafiz Rashidi and Norsahperi, Nor Mohd Haziq and Tharek, Anas and Hanapiah, Fazah Akhtar (2024) Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis. Artificial Intelligence Surgery, 4 (4). pp. 279-287. ISSN 2771-0408 https://www.oaepublish.com/articles/ais.2024.30 10.20517/ais.2024.30 |
| spellingShingle | Ghobadi, Vahideh Ismail, Luthffi Idzhar Hasan, Wan Zuha Wan Ahmad, Haron Ramli, Hafiz Rashidi Norsahperi, Nor Mohd Haziq Tharek, Anas Hanapiah, Fazah Akhtar Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title | Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title_full | Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title_fullStr | Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title_full_unstemmed | Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title_short | Real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| title_sort | real-time robust liver and gallbladder segmentation during laparoscopic cholecystectomy using convolutional neural networks: an analysis |
| url | http://psasir.upm.edu.my/id/eprint/117555/ http://psasir.upm.edu.my/id/eprint/117555/ http://psasir.upm.edu.my/id/eprint/117555/ http://psasir.upm.edu.my/id/eprint/117555/1/117555.pdf |