English
Related papers

Related papers: On the Effects of Low-Quality Training Data on Inf…

200 papers

This paper advocates privacy preserving requirements on collection of user data for recommender systems. The purpose of our study is twofold. First, we ask if restrictions on data collection will hurt test quality of RNN-based…

Information Retrieval · Computer Science 2021-06-22 Gustav Hertz , Sandhya Sachidanandan , Balázs Tóth , Emil S. Jørgensen , Martin Tegnér

Supervised machine learning, in which models are automatically derived from labeled training data, is only as good as the quality of that data. This study builds on prior work that investigated to what extent 'best practices' around…

Machine Learning · Computer Science 2021-07-07 R. Stuart Geiger , Dominique Cope , Jamie Ip , Marsha Lotosh , Aayush Shah , Jenny Weng , Rebekah Tang

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each…

Computation and Language · Computer Science 2023-11-10 Ben Wu , Yue Li , Yida Mu , Carolina Scarton , Kalina Bontcheva , Xingyi Song

Information extraction from the scientific literature is one of the main techniques to transform unstructured knowledge hidden in the text into structured data which can then be used for decision-making in down-stream tasks. One such area…

Computation and Language · Computer Science 2024-12-17 Melanie McGrath , Harrison Bailey , Necva Bölücü , Xiang Dai , Sarvnaz Karimi , Cecile Paris

Machine learning models are widely adopted in scenarios that directly affect people. The development of software systems based on these models raises societal and legal concerns, as their decisions may lead to the unfair treatment of…

Machine Learning · Computer Science 2019-10-08 Inês Valentim , Nuno Lourenço , Nuno Antunes

The collection, transfer and integration of research information into different research Information systems can result in different data errors that can have a variety of negative effects on data quality. In order to detect errors at an…

Databases · Computer Science 2019-01-21 Otmane Azeroual , Gunter Saake , Mohammad Abuosba

Selecting high-quality pre-training data is important for creating capable language models, but existing methods rely on simple heuristics. We introduce QuRating, a method for selecting pre-training data that can capture human intuitions…

Computation and Language · Computer Science 2024-07-19 Alexander Wettig , Aatmik Gupta , Saumya Malik , Danqi Chen

Many computer scientists use the aggregated answers of online workers to represent ground truth. Prior work has shown that aggregation methods such as majority voting are effective for measuring relatively objective features. For subjective…

Computation and Language · Computer Science 2021-04-06 Jiele Wu , Chau-Wai Wong , Xinyan Zhao , Xianpeng Liu

In the current IT world, developers write code while system operators run the code mostly as a black box. The connection between both worlds is typically established with log messages: the developer provides hints to the (unknown) operator,…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Alexander Acker , Jorge Cardoso , Odej Kao

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

Computation and Language · Computer Science 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

In large organisations, identifying experts on a given topic is crucial in leveraging the internal knowledge spread across teams and departments. So-called enterprise expert retrieval systems automatically discover and structure employees'…

Information Retrieval · Computer Science 2024-10-08 Jens-Joris Decorte , Jeroen Van Hautte , Chris Develder , Thomas Demeester

Instruction Fine-Tuning (IFT) significantly enhances the zero-shot capabilities of pretrained Large Language Models (LLMs). While coding data is known to boost LLM reasoning abilities during pretraining, its role in activating internal…

Artificial Intelligence · Computer Science 2024-12-13 Xinlu Zhang , Zhiyu Zoey Chen , Xi Ye , Xianjun Yang , Lichang Chen , William Yang Wang , Linda Ruth Petzold

Clinical auditing requires codified data for aggregation and analysis of patterns. However in the medical domain obtaining structured data can be difficult as the most natural, expressive and comprehensive way to record a clinical encounter…

Computers and Society · Computer Science 2016-06-14 Sedigheh Khademi , Christopher Palmer , Pari Delir Haghighi , Philip Lewis , Frada Burstein

Identifying the training datasets that influence a language model's outputs is essential for minimizing the generation of harmful content and enhancing its performance. Ideally, we can measure the influence of each dataset by removing it…

Computation and Language · Computer Science 2024-06-14 Masaru Isonuma , Ivan Titov

Universal lesion detection has great value for clinical practice as it aims to detect various types of lesions in multiple organs on medical images. Deep learning methods have shown promising results, but demanding large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Xiaoyu Bai , Benteng Ma , Changyang Li , Yong Xia

When humans judge the affective content of texts, they also implicitly assess the correctness of such judgment, that is, their confidence. We hypothesize that people's (in)confidence that they performed well in an annotation task leads to…

Computation and Language · Computer Science 2021-03-03 Enrica Troiano , Sebastian Padó , Roman Klinger

Search methods based on Pretrained Language Models (PLM) have demonstrated great effectiveness gains compared to statistical and early neural ranking models. However, fine-tuning PLM-based rankers requires a great amount of annotated…

Information Retrieval · Computer Science 2023-09-13 Sophia Althammer , Guido Zuccon , Sebastian Hofstätter , Suzan Verberne , Allan Hanbury

Accurate ground truth estimation in medical screening programs often relies on coalitions of experts and peer second opinions. Algorithms that efficiently aggregate noisy annotations can enhance screening workflows, particularly when data…

Machine Learning · Computer Science 2025-10-07 Tim Bary , Tiffanie Godelaine , Axel Abels , Benoît Macq

With the remarkable generative capabilities of large language models (LLMs), using LLM-generated data to train downstream models has emerged as a promising approach to mitigate data scarcity in specific domains and reduce time-consuming…

Computation and Language · Computer Science 2025-06-26 Yuchang Zhu , Huazhen Zhong , Qunshu Lin , Haotong Wei , Xiaolong Sun , Zixuan Yu , Minghao Liu , Zibin Zheng , Liang Chen

The process of annotating data within the legal sector is filled with distinct challenges that differ from other fields, primarily due to the inherent complexities of legal language and documentation. The initial task usually involves…

Information Retrieval · Computer Science 2024-07-26 Harshil Darji , Jelena Mitrović , Michael Granitzer