Refined Multi-Focus image fusion using Multi-Scale neural network with SpSwin Autoencoder-based matting

This paper proposes a novel method based on a Multi-Scale neural network with a SpatialSwin (SpSwin) Autoencoder-based matting for the multi-focus image fusion (MFIF) task. The proposed strategy introduces several innovations to enhance image quality and address challenges like boundary precision an...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Expert systems with applications Jg. 276; S. 126980
Hauptverfasser:	Jiang, Shengchuan, Yu, Shanchuan
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Elsevier Ltd 01.06.2025
Schlagworte:	And Hierarchical Feature Enhancement Block (HFEB) Combined Convolutional Blocks (CCBs) Depthwise Separable Convolution (DSC) Image fusion Pyramid Squeeze Attention (PSA) SpatialSwin (SpSwin) Autoencoder Transpose Convolution (TC) Combined Convolutional Blocks (CCBs) Pyramid Squeeze Attention (PSA) And Hierarchical Feature Enhancement Block (HFEB) Depthwise Separable Convolution (DSC) SpatialSwin (SpSwin) Autoencoder Transpose Convolution (TC) Image fusion
ISSN:	0957-4174
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Beschreibung
Zusammenfassung:	This paper proposes a novel method based on a Multi-Scale neural network with a SpatialSwin (SpSwin) Autoencoder-based matting for the multi-focus image fusion (MFIF) task. The proposed strategy introduces several innovations to enhance image quality and address challenges like boundary precision and texture preservation. The Sum of Edge-Weighted Gaussian-based Modified Laplacian (SEWG-ML) focus measure is developed to refine boundary detection, while a Pyramid Squeeze Attention (PSA) module dynamically adapts spatial and channel-wise attention at multiple scales for precise feature refinement. Trimap generation integrates superpixel segmentation and fuzzy k-means clustering for accurate foreground-background separation. The SpSwin Autoencoder leverages Swin Transformers for hierarchical token reduction and includes a Hierarchical Feature Enhancement Block (HFEB) to reconstruct high-level contextual features, ensuring seamless image fusion with reduced artifacts. These contributions result in a robust, high-performance framework. Experimental evaluations on benchmark datasets demonstrate superior performance, with metrics including SSIM (0.982), PSNR (39.60 dB), and MI (7.968), surpassing existing techniques. The proposed method in this paper is especially good at preserving fine details and suppressing artifacts, indicating its potential applicability in surveillance, medical imaging, and object detection.
ISSN:	0957-4174
DOI:	10.1016/j.eswa.2025.126980