Content-Diverse Comparisons improve IQA
William Thong (Sony AI),* Jose Costa Pereira (Huawei Noah's Ark Lab), Sarah Parisot (Huawei Noah's Ark Lab ), Ales Leonardis (Huawei Noah's Ark Lab), Steven McDonagh (Huawei Noah's Ark Lab)
The 33rd British Machine Vision Conference
Abstract
Image quality assessment (IQA) forms a natural and often straightforward undertaking for humans, yet effective automation of the task remains highly challenging. Recent metrics from the deep learning community commonly compare image pairs during training to improve upon traditional metrics such as PSNR or SSIM. However, current comparisons ignore the fact that image content affects quality assessment as comparisons only occur between images of similar content. This restricts the diversity and number of image pairs that the model is exposed to during training. In this paper, we strive to enrich these comparisons with content diversity. Firstly, we relax comparison constraints, and compare pairs of images with differing content. This increases the variety of available comparisons. Secondly, we introduce listwise comparisons to provide a holistic view to the model. By including differentiable regularizers, derived from correlation coefficients, models can better adjust predicted scores relative to one another. Evaluation on multiple benchmarks, covering a wide range of distortions and image content, shows the effectiveness of our learning scheme for training image quality assessment models.Video
Citation
@inproceedings{Thong_2022_BMVC,
author = {William Thong and Jose Costa Pereira and Sarah Parisot and Ales Leonardis and Steven McDonagh},
title = {Content-Diverse Comparisons improve IQA},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/0244.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by