Shape Preserving Facial Landmarks with Graph Attention Networks
Andrés Prados-Torreblanca (Universidad Politécnica de Madrid), José M Buenaposada (Universidad Rey Juan Carlos),* Luis Baumela (Universidad Politecnica de Madrid)
The 33rd British Machine Vision Conference
Abstract
Top-performing landmark estimation algorithms are based on exploiting the excellent ability of large convolutional neural networks (CNNs) to represent local appearance. However, it is well known that they can only learn weak spatial relationships. To address this problem, we propose a model based on the combination of a CNN with a cascade of Graph Attention Network regressors. To this end, we introduce an encoding that jointly represents the appearance and location of facial landmarks and an attention mechanism to weigh the information according to its reliability. This is combined with a multi-task approach to initialize the location of graph nodes and a coarse-to-fine landmark description scheme. Our experiments confirm that the proposed model learns a global representation of the structure of the face, achieving top performance in popular benchmarks on head pose and landmark estimation. The improvement provided by our model is most significant in situations involving large changes in the local appearance of landmarks. The code is publicly available at https://github.com/andresprados/SPIGA.Video
Citation
@inproceedings{Prados-Torreblanca_2022_BMVC,
author = {Andrés Prados-Torreblanca and José M Buenaposada and Luis Baumela},
title = {Shape Preserving Facial Landmarks with Graph Attention Networks},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/0155.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by