P0410 - Automatic Detection of Colonic Ulcers and Erosions in Colon Capsule Endoscopy Images Using a Convolutional Neural Network

Joao Afonso, MD¹, Miguel Mascarenhas, MD¹, Tiago Ribeiro, MD¹, Hélder Cardoso, MD¹, Patrícia Andrade, MD¹, João Ferreira, PhD², Marco Parente, PhD², Renato Natal, PhD², Guilherme Macedo, MD, PhD, FACG^1
1Centro Hospitalar de São João, Porto, Porto, Portugal; ²University of Porto, Porto, Porto, Portugal

Introduction: Conventional colonoscopy is gold standard for the diagnosis and monitoring of patients with suspected or known inflammatory bowel disease (IBD). Nevertheless, it is a potentially painful procedure with risk of complications, including bleeding and perforation. Colon capsule endoscopy (CCE) is a minimally invasive alternative for patients unwilling to undergo colonoscopy or when it is contraindicated or unfeasible. However, CCE produces thousands of frames and their revision is a time-consuming and monotonous task. The detection of ulcers and erosions is paramount for the diagnosis and assessment of the activity of IBD. However, these lesions may appear in a very small number of frames, thus increasing the risk of overlooking significant lesions. Our aim was to develop an Artificial Intelligence (AI) algorithm, based on a multilayer Convolutional Neural Network (CNN) for automatic detection of ulcers and erosions in CCE exams.

Methods: A total of 24 CCE exams (PillCam COLON 2^®) performed at a single centre between 2010-2020 were analysed. From these exams, 3 635 frames of the colonic mucosa were extracted, 770 containing colonic ulcers or erosions and 2 865 showing normal colonic mucosa. These images were used for construction of training (80% of the frames) and validation (20% of the frames) datasets. For automatic identification of these lesions, these images were inputted in a CNN model with transfer learning. The output provided by the CNN (Figure 1) was compared to the classification provided by a consensus of specialists (both with more than 200 CCE videos examined). Performance marks included sensitivity, specificity, positive and negative predictive values, accuracy and area under the receiving operator characteristics curve (AUROC).

Results: After the optimization of the neural architecture of the CNN, our model automatically detected colonic ulcers and erosions with a sensitivity of 90.3%, specificity of 98.8% and an accuracy of 97.0%. The AUROC was 0.99. The mean processing time for the validation dataset was 11s (approximately 66 frames/s).

Discussion: We developed a CNN model which demonstrated high levels of efficiency for the automatic detection of ulcers and erosions in CCE images. Our study lays the foundations for the development of effective AI tools for application to CCE exams, which may improve the diagnostic accuracy of CCE, and the time spent reading these exams.


Figure: Figure 1: 1a - Output obtained from the application of the CNN. A blue bar represents a correct prediction. 1b - Heatmaps for the lesion detection.


Disclosures:
Joao Afonso indicated no relevant financial relationships.
Miguel Mascarenhas indicated no relevant financial relationships.
Tiago Ribeiro indicated no relevant financial relationships.
Hélder Cardoso indicated no relevant financial relationships.
Patrícia Andrade indicated no relevant financial relationships.
João Ferreira indicated no relevant financial relationships.
Marco Parente indicated no relevant financial relationships.
Renato Natal indicated no relevant financial relationships.
Guilherme Macedo indicated no relevant financial relationships.


Joao Afonso, MD¹, Miguel Mascarenhas, MD¹, Tiago Ribeiro, MD¹, Hélder Cardoso, MD¹, Patrícia Andrade, MD¹, João Ferreira, PhD², Marco Parente, PhD², Renato Natal, PhD², Guilherme Macedo, MD, PhD, FACG¹. P0410 - Automatic Detection of Colonic Ulcers and Erosions in Colon Capsule Endoscopy Images Using a Convolutional Neural Network, ACG 2021 Annual Scientific Meeting Abstracts. Las Vegas, Nevada: American College of Gastroenterology.