MaterialNet: Multi-scale Texture Hierarchy and Multi-view Surface Reflectance for Material Type Recognition
DONGJIN LEE (Kyung Hee University), Seungkyu Lee (Kyung Hee University)*
The 33rd British Machine Vision Conference
Abstract
Material is distinguishing characteristic of real world objects. Recognizing unique texture of certain material type enables improved object detection or semantic segmentation. Incorporating acquired material properties such as surface reflectance of real world objects makes more realistic and richer 3D models in computer graphics. A robot arm essentially requires to recognize the stiffness or roughness of target object for precise and undamaged interaction. Despite the necessities, recognizing material type and its properties from color image is a challenging task. In this work, we propose (1) multi-scale texture hierarchy extraction network (MSTH-Net) encoding view-independent comprehensive multi-scale textures and their hierarchy and (2) multi-view surface reflectance extraction network (MVSR-Net) encoding view-specific features revealing surface reflectance of a material type. Finally, MaterialNet is proposed combining MSTH-Net and MVSR-Net for material type recognition from multi-view color images. Extensive experimental evaluations on six public benchmark datasets show promising performance of proposed method and potential for practical applications.Video
Citation
@inproceedings{LEE_2022_BMVC,
author = {DONGJIN LEE and Seungkyu Lee},
title = {MaterialNet: Multi-scale Texture Hierarchy and Multi-view Surface Reflectance for Material Type Recognition},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/0361.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by