Zero-shot Visual Commonsense Immorality Prediction
Yujin Jeong (Korea University), Seongbeom Park (Korea University), Suhong Moon (UC Berkeley), Jinkyu Kim (Korea University)*
The 33rd British Machine Vision Conference
Abstract
Artificial intelligence is currently powering diverse real-world applications. These applications have shown promising performance, but raise complicated ethical issues, i.e. how to embed ethics to make AI applications behave morally. One way toward moral AI systems is by imitating human prosocial behavior and encouraging some form of good behavior in systems. However, learning such normative ethics (especially from images) is challenging mainly due to a lack of data and labeling complexity. Here, we propose a model that predicts visual commonsense immorality in a zero-shot manner. We train our model with an ETHICS dataset (a pair of text and morality annotation) via a CLIP-based image-text joint embedding. In a testing phase, the immorality of an unseen image is predicted. We evaluate our model with existing moral/immoral image datasets and show fair prediction performance consistent with human intuitions. Further, we create a visual commonsense immorality benchmark with more general and extensive immoral visual contents. Codes and dataset are available at https://github.com/ku-vai/Zero-shot-Visual-Commonsense-Immorality-Prediction. Note that this paper might contain images and descriptions that are offensive in nature.Video
Citation
@inproceedings{Jeong_2022_BMVC,
author = {Yujin Jeong and Seongbeom Park and Suhong Moon and Jinkyu Kim},
title = {Zero-shot Visual Commonsense Immorality Prediction},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year = {2022},
url = {https://bmvc2022.mpi-inf.mpg.de/0320.pdf}
}
Copyright © 2022
The British Machine Vision Conference is organised by