RGB-T Multi-Modal Crowd Counting Based on Transformer
Zhengyi Liu (Anhui University),* Wei Wu (Anhui University), Yacheng Tan (Anhui University), Guanghui Zhang (Anhui University)
The 33rd British Machine Vision Conference
Abstract
Crowd counting aims to estimate the number of persons in a scene. Most state-of-the-art crowd counting methods based on color images can't work well in poor illumination conditions due to invisible objects. With the widespread use of infrared cameras, crowd counting based on color and thermal images is studied. Existing methods only achieve multi-modal fusion without count objective constraint. To better excavate multi-modal information, we use count-guided multi-modal fusion and modal-guided count enhancement to achieve the impressive performance. The proposed count-guided multi-modal fusion module utilizes a multi-scale token transformer to interact two-modal information under the guidance of count information and perceive different scales from the token perspective. The proposed modal-guided count enhancement module employs multi-scale deformable transformer decoder structure to enhance one modality feature and count information by the other modality. Experiment in public RGBT-CC dataset shows that our method refreshes the state-of-the-art results.Video
Citation
@inproceedings{Liu_2022_BMVC,
author = {Zhengyi Liu and Wei Wu and Yacheng Tan and Guanghui Zhang},
title = {RGB-T Multi-Modal Crowd Counting Based on Transformer},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/0427.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by