English
Related papers

Related papers: Unsupervised record matching with noisy and incomp…

200 papers

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

Machine Learning · Computer Science 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

This thesis presents two similarity-based approaches to sparse data problems. The first approach is to build soft, hierarchical clusters: soft, because each event belongs to each cluster with some probability; hierarchical, because cluster…

cmp-lg · Computer Science 2008-02-03 Lillian Lee

With the availability of virtually infinite number text documents in digital format, automatic comparison of textual data is essential for extracting meaningful insights that are difficult to identify manually. Many existing tools,…

Information Retrieval · Computer Science 2025-03-25 Akhil Joshi , Sai Teja Erukude , Lior Shamir

Despite the success of multimodal learning in cross-modal retrieval task, the remarkable progress relies on the correct correspondence among multimedia data. However, collecting such ideal data is expensive and time-consuming. In practice,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Haochen Han , Kaiyao Miao , Qinghua Zheng , Minnan Luo

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

Ensuring that collections of natural-language facts are globally consistent is essential for tasks such as fact-checking, summarization, and knowledge base construction. While Large Language Models (LLMs) can assess the consistency of small…

Artificial Intelligence · Computer Science 2026-01-21 Paul He , Elke Kirschbaum , Shiva Kasiviswanathan

Text-to-image person search aims to identify an individual based on a text description. To reduce data collection costs, large-scale text-image datasets are created from co-occurrence pairs found online. However, this can introduce noise,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zequn Xie , Haoming Ji , Chengxuan Li , Lingwei Meng

For statistical learning, categorical variables in a table are usually considered as discrete entities and encoded separately to feature vectors, e.g., with one-hot encoding. "Dirty" non-curated data gives rise to categorical variables with…

Machine Learning · Computer Science 2018-06-05 Patricio Cerda , Gaël Varoquaux , Balázs Kégl

The degraded performance and group unfairness caused by confounding sensitive attributes in rumor detection remains relatively unexplored. To address this, we propose a two-step framework. Initially, it identifies confounding sensitive…

Social and Information Networks · Computer Science 2024-12-31 Junyi Chen , Mengjia Wu , Qian Liu , Ying Ding , Yi Zhang

Despite recent advances, standard sequence labeling systems often fail when processing noisy user-generated text or consuming the output of an Optical Character Recognition (OCR) process. In this paper, we improve the noise-aware training…

Computation and Language · Computer Science 2021-05-26 Marcin Namysl , Sven Behnke , Joachim Köhler

Models that learn spurious correlations from training data often fail when deployed in new environments. While many methods aim to learn invariant representations to address this, they often underperform standard empirical risk minimization…

Machine Learning · Computer Science 2025-11-11 Ruqi Bai , Yao Ji , Zeyu Zhou , David I. Inouye

In any knowledge discovery process the value of extracted knowledge is directly related to the quality of the data used. Big Data problems, generated by massive growth in the scale of data observed in recent years, also follow the same…

Databases · Computer Science 2017-07-31 Diego García-Gil , Julián Luengo , Salvador García , Francisco Herrera

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and…

Information Theory · Computer Science 2019-01-30 Jonathan Scarlett , Volkan Cevher

As one of the most fundamental techniques in multimodal learning, cross-modal matching aims to project various sensory modalities into a shared feature space. To achieve this, massive and correctly aligned data pairs are required for model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Shuo Yang , Zhaopan Xu , Kai Wang , Yang You , Hongxun Yao , Tongliang Liu , Min Xu

Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Siqi Wang , Chau Pham , Bryan A. Plummer

Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jichang Li , Guanbin Li , Feng Liu , Yizhou Yu

Search techniques make use of elementary information such as term frequencies and document lengths in computation of similarity weighting. They can also exploit richer statistics, in particular the number of documents in which any two terms…

Information Retrieval · Computer Science 2020-07-20 Bodo Billerbeck , Justin Zobel , Nicholas Lester , Nick Craswell

Cross-modal retrieval aims to align different modalities via semantic similarity. However, existing methods often assume that image-text pairs are perfectly aligned, overlooking Noisy Correspondences in real data. These misaligned pairs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zhuoyao Liu , Yang Liu , Wentao Feng , Shudong Huang