Zobrazit v EDS

Enhancing light field image super-resolution through Mamba-based spatial–angular correlation learning.

Uloženo v:
Podrobná bibliografie
Název: Enhancing light field image super-resolution through Mamba-based spatial–angular correlation learning.
Autoři: Chen, Shaorui1,2 (AUTHOR) csr_20010517@163.com, Chen, Liang1,2 (AUTHOR) cl_0827@126.com, Wu, Defeng3,4 (AUTHOR) defeng@jmu.edu.cn, Wu, Yi1 (AUTHOR) wuyi@fjnu.edu.cn, Qi, Na5 (AUTHOR) qina@bjut.edu.cn
Zdroj: Visual Computer. Dec2025, Vol. 41 Issue 15, p12649-12662. 14p.
Témata: *HIGH resolution imaging, *LIGHT-field cameras, *THREE-dimensional imaging, *STATE-space methods, *STATISTICAL correlation, *FEATURE extraction, *DEPTH perception
Abstrakt: Light field cameras capture both spatial intensity and directional information of light rays, enabling applications such as depth perception, 3D reconstruction, and view rendering. However, the simultaneous capture of high spatial and angular resolutions remains challenging, densely angular sampling results in sub-aperture images (SAIs) with low spatial resolution. In this paper, we address this issue by proposing a novel approach for LF image SR that leverages Mamba, a state-space model (SSM) equipped with a selective scan mechanism, to effectively capture nonlocal spatial–angular correlation. Our method transforms 4D LF images into 2D epipolar plane images (EPIs) and employs an SSM-based block with a selective scan mechanism to explore the spatial–angular correlation within EPIs. Additionally, we propose a pyramid feature extraction module (PFEM) to extract richer information during the early processing stages. Experimental results on five public benchmark datasets demonstrate that our method not only outperforms state-of-the-art LF image SR approaches but also maintains competitive performance in real-world scenarios, achieving PSNR gains of up to 0.85 dB over the next-best method on the EPFL dataset at × 4 upscaling. The source code and datasets used in this study are publicly available at https://github.com/ChenSorry/MambaLFSR. [ABSTRACT FROM AUTHOR]
Databáze: Academic Search Index
Popis
Abstrakt:Light field cameras capture both spatial intensity and directional information of light rays, enabling applications such as depth perception, 3D reconstruction, and view rendering. However, the simultaneous capture of high spatial and angular resolutions remains challenging, densely angular sampling results in sub-aperture images (SAIs) with low spatial resolution. In this paper, we address this issue by proposing a novel approach for LF image SR that leverages Mamba, a state-space model (SSM) equipped with a selective scan mechanism, to effectively capture nonlocal spatial–angular correlation. Our method transforms 4D LF images into 2D epipolar plane images (EPIs) and employs an SSM-based block with a selective scan mechanism to explore the spatial–angular correlation within EPIs. Additionally, we propose a pyramid feature extraction module (PFEM) to extract richer information during the early processing stages. Experimental results on five public benchmark datasets demonstrate that our method not only outperforms state-of-the-art LF image SR approaches but also maintains competitive performance in real-world scenarios, achieving PSNR gains of up to 0.85 dB over the next-best method on the EPFL dataset at × 4 upscaling. The source code and datasets used in this study are publicly available at https://github.com/ChenSorry/MambaLFSR. [ABSTRACT FROM AUTHOR]
ISSN:01782789
DOI:10.1007/s00371-025-04178-z