Multispectral-NeRF: A Multispectral Modeling Approach Based on Neural Radiance Fields
Saved in:
| Title: | Multispectral-NeRF: A Multispectral Modeling Approach Based on Neural Radiance Fields |
|---|---|
| Authors: | Hong Zhang, Fei Guo, Zihan Xie, Dizhao Yao |
| Source: | Applied Sciences, Vol 15, Iss 22, p 12080 (2025) |
| Publisher Information: | MDPI AG, 2025. |
| Publication Year: | 2025 |
| Collection: | LCC:Technology LCC:Engineering (General). Civil engineering (General) LCC:Biology (General) LCC:Physics LCC:Chemistry |
| Subject Terms: | 3D reconstruction, Multispectral-NeRF model, neural radiance field, UAV, Technology, Engineering (General). Civil engineering (General), TA1-2040, Biology (General), QH301-705.5, Physics, QC1-999, Chemistry, QD1-999 |
| Description: | 3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality systems. Traditional 3D reconstruction techniques based on 2D images typically rely on RGB spectral information. With advances in sensor technology, additional spectral bands beyond RGB have been increasingly incorporated into 3D reconstruction workflows. Existing methods that integrate these expanded spectral data often suffer from expensive scheme prices, low accuracy, and poor geometric features. Three-dimensional reconstruction based on NeRF can effectively address the various issues in current multispectral 3D reconstruction methods, producing high-precision and high-quality reconstruction results. However, currently, NeRF and some improved models such as NeRFacto are trained on three-band data and cannot take into account the multi-band information. To address this problem, we propose Multispectral-NeRF—an enhanced neural architecture derived from NeRF that can effectively integrate multispectral information. Our technical contributions comprise threefold modifications: Expanding hidden layer dimensionality to accommodate 6-band spectral inputs; redesigning residual functions to optimize spectral discrepancy calculations between reconstructed and reference images; and adapting data compression modules to address the increased bit-depth requirements of multispectral imagery. Experimental results confirm that Multispectral-NeRF successfully processes multi-band spectral features while accurately preserving the original scenes’ spectral characteristics. |
| Document Type: | article |
| File Description: | electronic resource |
| Language: | English |
| ISSN: | 2076-3417 |
| Relation: | https://www.mdpi.com/2076-3417/15/22/12080; https://doaj.org/toc/2076-3417 |
| DOI: | 10.3390/app152212080 |
| Access URL: | https://doaj.org/article/5c856b95c4a14fecacad7cc3d0041d06 |
| Accession Number: | edsdoj.5c856b95c4a14fecacad7cc3d0041d06 |
| Database: | Directory of Open Access Journals |
Full Text Finder 
Nájsť tento článok vo Web of Science | Abstract: | 3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality systems. Traditional 3D reconstruction techniques based on 2D images typically rely on RGB spectral information. With advances in sensor technology, additional spectral bands beyond RGB have been increasingly incorporated into 3D reconstruction workflows. Existing methods that integrate these expanded spectral data often suffer from expensive scheme prices, low accuracy, and poor geometric features. Three-dimensional reconstruction based on NeRF can effectively address the various issues in current multispectral 3D reconstruction methods, producing high-precision and high-quality reconstruction results. However, currently, NeRF and some improved models such as NeRFacto are trained on three-band data and cannot take into account the multi-band information. To address this problem, we propose Multispectral-NeRF—an enhanced neural architecture derived from NeRF that can effectively integrate multispectral information. Our technical contributions comprise threefold modifications: Expanding hidden layer dimensionality to accommodate 6-band spectral inputs; redesigning residual functions to optimize spectral discrepancy calculations between reconstructed and reference images; and adapting data compression modules to address the increased bit-depth requirements of multispectral imagery. Experimental results confirm that Multispectral-NeRF successfully processes multi-band spectral features while accurately preserving the original scenes’ spectral characteristics. |
|---|---|
| ISSN: | 20763417 |
| DOI: | 10.3390/app152212080 |