Boundary-aware feature and prediction refinement for polyp segmentation

Polyp segmentation from colonoscopy videos is an essential task in medical image processing for detecting early cancer. However, segmenting a precise boundary is still challenging, even with powerful deep neural networks. We consider the difficulty can be caused by: (1) the ambiguity boundary and (2...

Full description

Saved in:
Bibliographic Details
Published in:Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization Vol. 11; no. 4; pp. 1187 - 1196
Main Authors: Qiu, Jie, Hayashi, Yuichiro, Oda, Masahiro, Kitasaka, Takayuki, Mori, Kensaku
Format: Journal Article
Language:English
Japanese
Published: Taylor & Francis 04.07.2023
Informa UK Limited
Subjects:
boundary-aware
consistency learning
Polyp segmentation
ISSN:2168-1163, 2168-1171
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Polyp segmentation from colonoscopy videos is an essential task in medical image processing for detecting early cancer. However, segmenting a precise boundary is still challenging, even with powerful deep neural networks. We consider the difficulty can be caused by: (1) the ambiguity boundary and (2) some complicated shape makes polyps hard to segment. To address these problems, we propose the Boundary-aware Feature and Prediction Refinement framework (BaFPR) for polyp segmentation. Specifically, we design a segmentation decoder for representation learning with boundary prior and propose a novel consistency loss to learn clues from the polar coordinate. The decoder mainly consists of a boundary prior module (BPM) and a bi-directional fusion module (BiFM). BPM is designed to learn the boundary prior, while BiFM learns to fuse representations of BPM and multi-scale representations from an encoder. To handle these complicated shapes of polyps, we maintain an extra segmentation network that learns with polar transformations of data to provide extra clues for the main segmentation network by our proposed consistency loss. We evaluated BaFPR with five challenging datasets for polyp segmentation and the results showed that our proposal consistently improves the segmentation performance of polyps. Code available at: https://github.com/MoriLabNU/BaFPR .
ISSN:2168-1163
2168-1171
DOI:10.1080/21681163.2022.2155579