English
Related papers

Related papers: Counterfactual Reasoning for Multi-Label Image Cla…

200 papers

In this paper, we propose a novel end-to-end unsupervised deep domain adaptation model for adaptive object detection by exploiting multi-label object recognition as a dual auxiliary task. The model exploits multi-label prediction to reveal…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Zhen Zhao , Yuhong Guo , Haifeng Shen , Jieping Ye

Partial multi-label learning (PML) models the scenario where each training instance is annotated with a set of candidate labels, and only some of the labels are relevant. The PML problem is practical in real-world scenarios, as it is…

Machine Learning · Computer Science 2020-03-18 Tingting Yu , Guoxian Yu , Jun Wang , Maozu Guo

The original ImageNet benchmark enforces a single-label assumption, despite many images depicting multiple objects. This leads to label noise and limits the richness of the learning signal. Multi-label annotations more accurately reflect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Junyu Chen , Md Yousuf Harun , Christopher Kanan

Recognizing multiple labels of images is a fundamental but challenging task in computer vision, and remarkable progress has been attained by localizing semantic-aware image regions and predicting their labels with deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Tianshui Chen , Zhouxia Wang , Guanbin Li , Liang Lin

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

This work deviates from easy-to-define class boundaries for object interactions. For the task of object interaction recognition, often captured using an egocentric view, we show that semantic ambiguities in verbs and recognising…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Michael Wray , Davide Moltisanti , Walterio Mayol-Cuevas , Dima Damen

Counterfactual statements, which describe events that did not or cannot take place, are beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual detection (CFD) and seek to enhance the CFD models. Previous…

Computation and Language · Computer Science 2024-10-01 Thong Nguyen , Truc-My Nguyen

In this paper, we propose a multi-label classification framework to detect multiple speaking styles in a speech sample. Unlike previous studies that have primarily focused on identifying a single target style, our framework effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-19 Miseul Kim , Seyun Um , Hyeonjin Cha , Hong-goo Kang

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

Object-context shortcuts remain a persistent challenge in vision-language models, undermining zero-shot reliability when test-time scenes differ from familiar training co-occurrences. We recast this issue as a causal inference problem and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pei Peng , MingKun Xie , Hang Hao , Tong Jin , ShengJun Huang

The task of multi-label image classification is to recognize all the object labels presented in an image. Though advancing for years, small objects, similar objects and objects with high conditional probability are still the main…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Xing Cheng , Hezheng Lin , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Nian Shi , Honglin Liu

Target-oriented multimodal sentiment classification seeks to predict sentiment polarity for specific targets from image-text pairs. While existing works achieve competitive performance, they often over-rely on textual content and fail to…

Computation and Language · Computer Science 2025-09-12 Zhiyue Liu , Fanrong Ma , Xin Ling

A complementary label (CL) simply indicates an incorrect class of an example, but learning with CLs results in multi-class classifiers that can predict the correct class. Unfortunately, the problem setting only allows a single CL for each…

Machine Learning · Computer Science 2022-08-09 Lei Feng , Takuo Kaneko , Bo Han , Gang Niu , Bo An , Masashi Sugiyama

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Multi-label image classification is a critical task in machine learning that aims to accurately assign multiple labels to a single image. While existing methods often utilize attention mechanisms or graph convolutional networks to model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ren-Dong Xie , Zhi-Fen He , Bo Li , Bin Liu , Jin-Yan Hu

Multi-label classification (MLC) is an ML task of predictive modeling in which a data instance can simultaneously belong to multiple classes. MLC is increasingly gaining interest in different application domains such as text mining,…

Machine Learning · Computer Science 2022-11-22 Ana Kostovska , Carola Doerr , Sašo Džeroski , Dragi Kocev , Panče Panov , Tome Eftimov

Multimodal multilabel classification (MMC) is a challenging task that aims to design a learning algorithm to handle two data sources, the image and text, and learn a comprehensive semantic feature presentation across the modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yanming Guo

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Multi-label image classification allows predicting a set of labels from a given image. Unlike multiclass classification, where only one label per image is assigned, such a setup is applicable for a broader range of applications. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Kirill Prokofiev , Vladislav Sovrasov

Although large vision-language models (LVLMs) have demonstrated remarkable capabilities, they are prone to hallucinations in multi-image tasks. We attribute this issue to limitations in existing attention mechanisms and insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaochen Yang , Hao Fang , Jiawei Kong , Yaoxin Mao , Bin Chen , Shu-Tao Xia