中文
相关论文

相关论文: Dual Debiasing for Noisy In-Context Learning for T…

200 篇论文

Pre-trained large language models based on Transformers have demonstrated remarkable in-context learning (ICL) abilities. With just a few demonstration examples, the models can implement new tasks without any parameter updates. However, it…

机器学习 · 计算机科学 2024-11-04 Ruifeng Ren , Yong Liu

We propose a simulation framework for generating instance-dependent noisy labels via a pseudo-labeling paradigm. We show that the distribution of the synthetic noisy labels generated with our framework is closer to human labels compared to…

机器学习 · 计算机科学 2021-10-19 Keren Gu , Xander Masotto , Vandana Bachani , Balaji Lakshminarayanan , Jack Nikodem , Dong Yin

Crowdsourcing provides a practical way to obtain large amounts of labeled data at a low cost. However, the annotation quality of annotators varies considerably, which imposes new challenges in learning a high-quality model from the…

机器学习 · 计算机科学 2021-06-15 Zhendong Chu , Jing Ma , Hongning Wang

Image captioning is one of the straightforward tasks that can take advantage of large-scale web-crawled data which provides rich knowledge about the visual world for a captioning model. However, since web-crawled data contains image-text…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Wooyoung Kang , Jonghwan Mun , Sungjun Lee , Byungseok Roh

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to produce inaccurate results when presented with adversarial…

计算与语言 · 计算机科学 2024-05-21 Xuanli He , Yuxiang Wu , Oana-Maria Camburu , Pasquale Minervini , Pontus Stenetorp

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Sensitivity of deep-neural models to input noise is known to be a challenging problem. In NLP, model performance often deteriorates with naturally occurring noise, such as spelling errors. To mitigate this issue, models may leverage…

计算与语言 · 计算机科学 2021-11-18 Jakub Náplava , Martin Popel , Milan Straka , Jana Straková

Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Siqi Wang , Chau Pham , Bryan A. Plummer

The challenge of learning with noisy labels is significant in machine learning, as it can severely degrade the performance of prediction models if not addressed properly. This paper introduces a novel framework that conceptualizes noisy…

机器学习 · 计算机科学 2025-11-26 Marzi Heidari , Hanping Zhang , Yuhong Guo

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

计算与语言 · 计算机科学 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

The performance emergence of large language models (LLMs) driven by data scaling laws makes the selection of pre-training data increasingly important. However, existing methods rely on limited heuristics and human intuition, lacking…

计算与语言 · 计算机科学 2025-04-09 Ru Peng , Kexin Yang , Yawen Zeng , Junyang Lin , Dayiheng Liu , Junbo Zhao

In real-world datasets, noisy labels are pervasive. The challenge of learning with noisy labels (LNL) is to train a classifier that discerns the actual classes from given instances. For this, the model must identify features indicative of…

机器学习 · 计算机科学 2023-08-15 Hui Kang , Sheng Liu , Huaxi Huang , Tongliang Liu

Learning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise. However, in real-world…

机器学习 · 计算机科学 2025-01-22 Linchao Pan , Can Gao , Jie Zhou , Jinbao Wang

Cross-modal retrieval is crucial in understanding latent correspondences across modalities. However, existing methods implicitly assume well-matched training data, which is impractical as real-world data inevitably involves imperfect…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Zhuohang Dang , Minnan Luo , Jihong Wang , Chengyou Jia , Haochen Han , Herun Wan , Guang Dai , Xiaojun Chang , Jingdong Wang

Implicit feedback, employed in training recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to identify noisy samples through their diverged data patterns,…

信息检索 · 计算机科学 2025-11-12 Tianrui Song , Wen-Shuo Chao , Hao Liu

Previous in-context learning (ICL) research has focused on tasks such as classification, machine translation, text2table, etc., while studies on whether ICL can improve human-like dialogue generation are scarce. Our work fills this gap by…

计算与语言 · 计算机科学 2024-02-20 Jiashu Pu , Yajing Wan , Yuru Zhang , Jing Chen , Ling Cheng , Qian Shao , Yongzhu Chang , Tangjie Lv , Rongsheng Zhang

Existing camouflaged object detection~(COD) methods depend heavily on large-scale pixel-level annotations.However, acquiring such annotations is laborious due to the inherent camouflage characteristics of the objects.Semi-supervised…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Xunfa Lai , Zhiyu Yang , Jie Hu , Shengchuan Zhang , Liujuan Cao , Guannan Jiang , Zhiyu Wang , Songan Zhang , Rongrong Ji