Multimodal Extension of the ML-CSC Framework for Medical Image Segmentation

In recent years, Convolutional Neural Networks (CNNs) have led to huge successes across various computer vision applications. However, the lack of interpretability poses a severe barrier for their wider adoption in healthcare. Recently introduced Multilayer Convolutional Sparse Coding (ML-CSC) data...

Full description

Saved in:
Bibliographic Details
Published in:2021 12th International Symposium on Image and Signal Processing and Analysis (ISPA) pp. 91 - 96
Main Authors: Janssens, Jens, Lazendic, Srdan, Huang, Shaoguang, Pizurica, Aleksandra
Format: Conference Proceeding
Language:English
Published: IEEE 13.09.2021
Subjects:
Computer architecture
Convolution
Convolutional codes
Encoding
Image segmentation
interpretable convolutional neural networks
medical image segmentation
Multilayer convolutional sparse coding
multimodal data
Nonhomogeneous media
Signal processing algorithms
ISSN:1849-2266
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, Convolutional Neural Networks (CNNs) have led to huge successes across various computer vision applications. However, the lack of interpretability poses a severe barrier for their wider adoption in healthcare. Recently introduced Multilayer Convolutional Sparse Coding (ML-CSC) data model provides a model-based explanation of CNNs. This article aims to extend the ML-CSC framework towards multimodal data processing, which to our knowledge has not been addressed so far. In particular, we focus on interpretable medical image segmentation architecture design for multimodal data. We derive a novel sparse coding algorithm and propose three different CNN architectures with increasing performance, without introducing any additional learnable parameters. Based on the sparse coding theory, our multimodal extension enables the systematic design of interpretable CNN segmentation architectures. Experimental analysis demonstrates that the achieved segmentation results are consistent with the obtained theoretical expectations.
ISSN:1849-2266
DOI:10.1109/ISPA52656.2021.9552083