Joint Reconstruction and Super Resolution of Hyper-Spectral CTIS Images


Mazen Mel (University of Padua),* Alexander Gatto (Sony Europe B.V.), Pietro Zanuttigh (University of Padova)
The 33rd British Machine Vision Conference

Abstract

Computed Tomography Imaging Spectrometers (CTIS) capture dense spectrum of dynamic scenes as compressed 2D sensor measurements. Model-based Hyper-Spectral (HS) image reconstruction algorithms devised for such systems are typically very slow, sensitive to the selected data and noise models, and can only restore HS images with poor spatial resolution. On the other hand, deep learning-based approaches, once trained, are capable of performing the reconstruction in real-time and are more suitable for high frame-rate applications but generally suffer from limited generalization capabilities. In this paper for the first time, we jointly address the issues of reconstruction speed and spatial resolution of CTIS through a simple and interpretable deep learning architecture partially inspired by the Filtered Back-Projection (FBP) algorithm used in conventional CT scans. Our model is able to exploit aliased pixel information in CTIS images to recover spatially super-resolved HS cubes. Experimental results on simulated and real data demonstrate the effectiveness of our approach not only in reconstruction quality, but also in computation time and generalization ability.

Video



Citation

@inproceedings{Mel_2022_BMVC,
author    = {Mazen Mel and Alexander Gatto and Pietro Zanuttigh},
title     = {Joint Reconstruction and Super Resolution of Hyper-Spectral CTIS Images},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year      = {2022},
url       = {https://bmvc2022.mpi-inf.mpg.de/1063.pdf}
}


Copyright © 2022 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection