English
Related papers

Related papers: RePOPE: Impact of Annotation Errors on the POPE Be…

200 papers

Despite recent advances in multimodal pre-training for visual description, state-of-the-art models still produce captions containing errors, such as hallucinating objects not present in a scene. The existing prominent metric for object…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Suzanne Petryk , David M. Chan , Anish Kachinthaya , Haodi Zou , John Canny , Joseph E. Gonzalez , Trevor Darrell

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

Human visual preferences are inherently multi-dimensional, encompassing aesthetics, detail fidelity, and semantic alignment. However, existing datasets provide only single, holistic annotations, resulting in severe label noise: images that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Xinxin Liu , Ming Li , Zonglin Lyu , Yuzhang Shang , Chen Chen

Hallucination issues continue to affect multimodal large language models (MLLMs), with existing research mainly addressing object-level or attribute-level hallucinations, neglecting the more complex relation hallucinations that require…

Machine Learning · Computer Science 2025-06-02 Kening Zheng , Junkai Chen , Yibo Yan , Xin Zou , Xuming Hu

Sentence embedding tasks are important in natural language processing (NLP), but improving their performance while keeping them reliable is still hard. This paper presents a framework that combines pseudo-label generation and model ensemble…

Computation and Language · Computer Science 2025-01-28 Ziwei Liu , Qi Zhang , Lifu Gao

Evaluating large language models (LLMs) for clinical documentation tasks such as SOAP note generation remains challenging. Unlike standard summarization, these tasks require clinical abstraction, normalization of colloquial language, and…

Artificial Intelligence · Computer Science 2026-04-17 Bhavik Vachhani , Kush Shrisvastava , Pranshu Nema , Sai Chiranthan

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

Machine Learning · Computer Science 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

Multi-annotator learning (MAL) aims to model annotator-specific labeling patterns. However, existing methods face a critical challenge: they simply skip updating annotator-specific model parameters when encountering missing labels, i.e., a…

Multimedia · Computer Science 2025-08-08 Liyun Zhang , Zheng Lian , Hong Liu , Takanori Takebe , Yuta Nakashima

Label noise is a common problem in real-world datasets, affecting both model training and validation. Clean data are essential for achieving strong performance and ensuring reliable evaluation. While various techniques have been proposed to…

Machine Learning · Computer Science 2025-10-21 Henrique Pickler , Jorge K. S. Kamassury , Danilo Silva

Object counting is a foundational vision task with over a decade of dedicated research, yet state-of-the-art models still fail systematically in the mixed-object setting that dominates real-world applications such as industrial inspection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Corentin Dumery , Niki Amini-Naieni , Shervin Naini , Pascal Fua

Parameter-efficient fine-tuning (PEFT) methods are widely used to adapt large language models (LLMs) to downstream tasks and are often assumed to improve factual correctness. However, how the parameter-efficient fine-tuning methods affect…

Computation and Language · Computer Science 2026-02-13 Xu Hu , Yifan Zhang , Songtao Wei , Chen Zhao , Qiannan Li , Bingzhe Li , Feng Chen

Node classification on graphs often requires labeled nodes, yet obtaining labels at graph scale is expensive. When node attributes contain semantic content, such as paper abstracts, web pages, or product descriptions, large language models…

Machine Learning · Computer Science 2026-05-28 Safal Thapaliya , Jiatan Huang , Chuxu Zhang

Recently, there has been an explosion of large language models created through fine-tuning with data from larger models. These small models able to produce outputs that appear qualitatively similar to significantly larger models. However,…

Computation and Language · Computer Science 2024-11-05 Phil Wee , Riyadh Baghdadi

The performance of object detection, to a great extent, depends on the availability of large annotated datasets. To alleviate the annotation cost, the research community has explored a number of ways to exploit unlabeled or weakly labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Shijie Fang , Yuhang Cao , Xinjiang Wang , Kai Chen , Dahua Lin , Wayne Zhang

Training with sparse annotations is known to reduce the performance of object detectors. Previous methods have focused on proxies for missing ground truth annotations in the form of pseudo-labels for unlabeled boxes. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Saksham Suri , Sai Saketh Rambhatla , Rama Chellappa , Abhinav Shrivastava

Preference alignment methods such as RLHF and Direct Preference Optimization (DPO) improve instruction following, but they can also reinforce hallucinations when preference judgments reward fluency and confidence over factual correctness.…

Computation and Language · Computer Science 2026-04-16 Sindhuja Chaduvula , Ahmed Y. Radwan , Azib Farooq , Yani Ioannou , Shaina Raza

Hallucinations pose a significant challenge in Large Vision Language Models (LVLMs), with misalignment between multimodal features identified as a key contributing factor. This paper reveals the negative impact of the long-term decay in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Qiyan Zhao , Xiaofeng Zhang , Yiheng Li , Yun Xing , Xiaosong Yuan , Feilong Tang , Sinan Fan , Xuhang Chen , Xuyao Zhang , Dahan Wang

Test-time reinforcement learning mitigates the reliance on annotated data by using majority voting results as pseudo-labels, emerging as a complementary direction to reinforcement learning with verifiable rewards (RLVR) for improving…

Computation and Language · Computer Science 2026-05-07 Weiqin Wang , Yile Wang , Kehao Chen , Hui Huang

Multi-label classification (MLC) often suffers from performance disparities across labels. We propose \textbf{FairPO}, a framework combining preference-based loss and group-robust optimization to improve fairness by targeting…

Machine Learning · Computer Science 2025-12-01 Soumen Kumar Mondal , Prateek Chanda , Akshit Varmora , Ganesh Ramakrishnan

Given multiple datasets with different label spaces, the goal of this work is to train a single object detector predicting over the union of all the label spaces. The practical benefits of such an object detector are obvious and significant…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Xiangyun Zhao , Samuel Schulter , Gaurav Sharma , Yi-Hsuan Tsai , Manmohan Chandraker , Ying Wu