Joint Reconstruction and Super Resolution of Hyper-Spectral CTIS Images
Mazen Mel (University of Padua),* Alexander Gatto (Sony Europe B.V.), Pietro Zanuttigh (University of Padova)
The 33rd British Machine Vision Conference
Abstract
Computed Tomography Imaging Spectrometers (CTIS) capture dense spectrum of dynamic scenes as compressed 2D sensor measurements. Model-based Hyper-Spectral (HS) image reconstruction algorithms devised for such systems are typically very slow, sensitive to the selected data and noise models, and can only restore HS images with poor spatial resolution. On the other hand, deep learning-based approaches, once trained, are capable of performing the reconstruction in real-time and are more suitable for high frame-rate applications but generally suffer from limited generalization capabilities. In this paper for the first time, we jointly address the issues of reconstruction speed and spatial resolution of CTIS through a simple and interpretable deep learning architecture partially inspired by the Filtered Back-Projection (FBP) algorithm used in conventional CT scans. Our model is able to exploit aliased pixel information in CTIS images to recover spatially super-resolved HS cubes. Experimental results on simulated and real data demonstrate the effectiveness of our approach not only in reconstruction quality, but also in computation time and generalization ability.Video
Citation
@inproceedings{Mel_2022_BMVC,
author = {Mazen Mel and Alexander Gatto and Pietro Zanuttigh},
title = {Joint Reconstruction and Super Resolution of Hyper-Spectral CTIS Images},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/1063.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by