English
Related papers

Related papers: On the data requirements of probing

200 papers

Selecting high-quality and diverse training samples from extensive datasets plays a crucial role in reducing training overhead and enhancing the performance of Large Language Models (LLMs). However, existing studies fall short in assessing…

Computation and Language · Computer Science 2025-10-14 Zhuo Li , Yuhao Du , Xiaoqi Jiao , Yiwen Guo , Yuege Feng , Xiang Wan , Anningzhe Gao , Jinpeng Hu

Due to the increasing volume, volatility, and diversity of data in virtually all areas of our lives, the ability to detect duplicates in potentially linked data sources is more important than ever before. However, while research is already…

Databases · Computer Science 2024-01-01 Fabian Panse , Wolfram Wingerath , Benjamin Wollmer

Obtaining human-like performance in NLP is often argued to require compositional generalisation. Whether neural networks exhibit this ability is usually studied by training models on highly compositional synthetic data. However,…

Computation and Language · Computer Science 2022-04-01 Verna Dankers , Elia Bruni , Dieuwke Hupkes

As the significance of understanding the cause-and-effect relationships among variables increases in the development of modern systems and algorithms, learning causality from observational data has become a preferred and efficient approach…

Machine Learning · Computer Science 2024-11-28 Xiaoxuan Li , Yao Liu , Ruoyu Wang , Lina Yao

Highly overparametrized neural networks can display curiously strong generalization performance - a phenomenon that has recently garnered a wealth of theoretical and empirical research in order to better understand it. In contrast to most…

Machine Learning · Computer Science 2020-09-29 Jorg Bornschein , Francesco Visin , Simon Osindero

Suppose data are fitted to some parametric model but that the true model happens to be one with an additional parameter. When a parameter is to be estimated one can use likelihood estimation in the wider model or in the narrow model.…

Methodology · Statistics 2026-03-27 Nils Lid Hjort

This paper targets the question of predicting machine learning classification model performance, when taking into account the number of training examples per class and not just the overall number of training examples. This leads to the a…

Machine Learning · Computer Science 2024-03-12 Thomas Mühlenstädt , Jelena Frtunikj

Large Language Models (LLMs) are often used as automated judges to evaluate text, but their effectiveness can be hindered by various unintentional biases. We propose using linear classifying probes, trained by leveraging differences between…

Computation and Language · Computer Science 2025-03-25 Sharan Maiya , Yinhong Liu , Ramit Debnath , Anna Korhonen

There is an ongoing debate in the NLP community whether modern language models contain linguistic knowledge, recovered through so-called probes. In this paper, we study whether linguistic knowledge is a necessary condition for the good…

Computation and Language · Computer Science 2022-01-04 Vassilina Nikoulina , Maxat Tezekbayev , Nuradil Kozhakhmet , Madina Babazhanova , Matthias Gallé , Zhenisbek Assylbekov

Because large language models are expensive to pretrain on different datasets, using smaller-scale experiments to decide on data is crucial for reducing costs. Which benchmarks and methods of making decisions from observed performance at…

Causal inference is one of the hallmarks of human intelligence. While the field of CausalNLP has attracted much interest in the recent years, existing causal inference datasets in NLP primarily rely on discovering causality from empirical…

Computation and Language · Computer Science 2024-04-18 Zhijing Jin , Jiarui Liu , Zhiheng Lyu , Spencer Poff , Mrinmaya Sachan , Rada Mihalcea , Mona Diab , Bernhard Schölkopf

NLP models have progressed drastically in recent years, according to numerous datasets proposed to evaluate performance. Questions remain, however, about how particular dataset design choices may impact the conclusions we draw about model…

Computation and Language · Computer Science 2023-10-27 Kaiser Sun , Adina Williams , Dieuwke Hupkes

The ability of Large Language Models (LLMs) to perform reasoning tasks such as deduction has been widely investigated in recent years. Yet, their capacity to generate proofs-faithful, human-readable explanations of why conclusions…

Artificial Intelligence · Computer Science 2026-01-21 Hui Yang , Jiaoyan Chen , Uli Sattler

We investigate the problem of determining the predictive confidence (or, conversely, uncertainty) of a neural classifier through the lens of low-resource languages. By training models on sub-sampled datasets in three different languages, we…

Computation and Language · Computer Science 2022-10-28 Dennis Ulmer , Jes Frellsen , Christian Hardmeier

Many machine learning models require setting a parameter that controls their size before training, e.g. number of neurons in DNNs, or inducing points in GPs. Increasing capacity typically improves performance until all the information from…

Machine Learning · Statistics 2025-12-22 Guiomar Pescador-Barrios , Sarah Filippi , Mark van der Wilk

A common use of NLP is to facilitate the understanding of large document collections, with a shift from using traditional topic models to Large Language Models. Yet the effectiveness of using LLM for large corpus understanding in real-world…

Computation and Language · Computer Science 2025-06-05 Zongxia Li , Lorena Calvo-Bartolomé , Alexander Hoyle , Paiheng Xu , Alden Dima , Juan Francisco Fung , Jordan Boyd-Graber

Neural language models (LMs) can be used to evaluate the truth of factual statements in two ways: they can be either queried for statement probabilities, or probed for internal representations of truthfulness. Past work has found that these…

Computation and Language · Computer Science 2023-12-08 Kevin Liu , Stephen Casper , Dylan Hadfield-Menell , Jacob Andreas

The rapid proliferation of large language models and natural language processing (NLP) applications creates a crucial need for uncertainty quantification to mitigate risks such as hallucinations and to enhance decision-making reliability in…

Computation and Language · Computer Science 2024-05-06 Margarida M. Campos , António Farinhas , Chrysoula Zerva , Mário A. T. Figueiredo , André F. T. Martins

While there exists a large amount of literature on the general challenges of and best practices for trustworthy online A/B testing, there are limited studies on sample size estimation, which plays a crucial role in trustworthy and efficient…

Methodology · Statistics 2023-08-21 Jing Zhou , Jiannan Lu , Anas Shallah

Natural Language Processing prides itself to be an empirically-minded, if not outright empiricist field, and yet lately it seems to get itself into essentialist debates on issues of meaning and measurement ("Do Large Language Models…

Computation and Language · Computer Science 2023-10-30 David Schlangen