Deep calibration for broadband multispectral filter array

Yuzhe Zhang; Shuai Wang; Qiang Jiao; Liheng Bian

doi:10.1117/12.2643792

4 January 2023 Deep calibration for broadband multispectral filter array

Yuzhe Zhang, Shuai Wang, Qiang Jiao, Liheng Bian

Proceedings Volume 12317, Optoelectronic Imaging and Multimedia Technology IX; 1231709 (2023) https://doi.org/10.1117/12.2643792
Event: SPIE/COS Photonics Asia, 2022, Online Only

Abstract

Broadband multispectral filter array (BMSFA) has emerged as an attractive alternative for spectral imaging due to its compactness and high light throughput. It compresses the multispectral data cube to 2D measurements, and then we reconstruct the data cube from the measurements with its pre-calibrated spectral response. In practice, the BMSFA spectral response is usually calibrated using ultra-narrow filters along wavelength with high cost. In addition, the process introduces noise and inter-spectral crosstalk that would severely degrade reconstruction quality. In this work, we report a novel calibration technique using deep learning called deep calibration. The technique generates different spectral illumination and collects sets of measurements of BMSFA camera and corresponding true spectra. In this way, a more accurate characterization of BMSFA spatial-spectral modulation can be obtained. Furthermore, a reconstruction network following hybrid CNN-Vit architecture was employed to learn the demodulation process from the collected dataset. Then, using this network as a decoder, the scene’s hyperspectral data can be accurately reconstructed from the measurements. Extensive experiments validated that the reported technique performs with high efficiency and accuracy in both calibration and reconstruction of BMSFA.

Conference Presentation

Citation Download Citation

Yuzhe Zhang, Shuai Wang, Qiang Jiao, and Liheng Bian "Deep calibration for broadband multispectral filter array", Proc. SPIE 12317, Optoelectronic Imaging and Multimedia Technology IX, 1231709 (4 January 2023); https://doi.org/10.1117/12.2643792

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available