English
Related papers

Related papers: Information-Theoretic Probing with Minimum Descrip…

200 papers

This paper introduces a new notion of dimensionality of probabilistic models from an information-theoretic view point. We call it the "descriptive dimension"(Ddim). We show that Ddim coincides with the number of independent parameters for…

Machine Learning · Computer Science 2019-10-28 Kenji Yamanishi

We introduce a group of related methods for binary classification tasks using probes of the hidden state activations in large language models (LLMs). Performance is on par with the largest and most advanced LLMs currently available, but…

Machine Learning · Computer Science 2024-08-22 John Scoville , Shang Gao , Devanshu Agrawal , Javed Qadrud-Din

Factual knowledge extraction aims to explicitly extract knowledge parameterized in pre-trained language models for application in downstream tasks. While prior work has been investigating the impact of supervised fine-tuning data on the…

Computation and Language · Computer Science 2025-05-30 Xuan Gong , Hanbo Huang , Shiyu Liang

The reliability of large language models (LLMs) is greatly compromised by their tendency to hallucinate, underscoring the need for precise identification of knowledge gaps within LLMs. Various methods for probing such gaps exist, ranging…

Computation and Language · Computer Science 2025-06-02 Raoyuan Zhao , Abdullatif Köksal , Ali Modarressi , Michael A. Hedderich , Hinrich Schütze

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

Computation and Language · Computer Science 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann

Large Language Models (LLMs) are increasingly used to generate textual explanations of process models discovered from event logs. Producing explanations from large behavioral abstractions (e.g., directly-follows graphs or Petri nets) can be…

Machine Learning · Computer Science 2025-10-14 P. van Oerle , R. H. Bemthuis , F. A. Bukhsh

Multiple studies have probed representations emerging in neural networks trained for end-to-end NLP tasks and examined what word-level linguistic information may be encoded in the representations. In classical probing, a classifier is…

Computation and Language · Computer Science 2021-10-26 Rudolf Rosa , Tomáš Musil , David Mareček

Fine-tuned large language models (LLMs) often exhibit overconfidence, particularly when trained on small datasets, resulting in poor calibration and inaccurate uncertainty estimates. Evidential Deep Learning (EDL), an uncertainty-aware…

Machine Learning · Computer Science 2025-02-12 Yawei Li , David Rügamer , Bernd Bischl , Mina Rezaei

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

In real-world NLP applications, Large Language Models (LLMs) offer promising solutions due to their extensive training on vast datasets. However, the large size and high computation demands of LLMs limit their practicality in many…

Artificial Intelligence · Computer Science 2025-04-01 Juanhui Li , Sreyashi Nag , Hui Liu , Xianfeng Tang , Sheikh Sarwar , Limeng Cui , Hansu Gu , Suhang Wang , Qi He , Jiliang Tang

Interpretable text representations should expose coordinates that are not only predictive, but also meaningful enough for independent auditors to apply. Existing discriminative representations often use anonymous embedding directions, while…

Computation and Language · Computer Science 2026-05-21 Tong Wang , Yiqing Xu , Leo Yang Yang

Fine-tuning LLMs for classification typically maps inputs directly to labels. We ask whether attaching brief explanations to each label during fine-tuning yields better models. We evaluate conversational response quality along three axes:…

Machine Learning · Computer Science 2026-03-03 Vivswan Shah , Randy Cogill , Hanwei Yue , Gopinath Chennupati , Rinat Khaziev

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

The Minimum Description Length principle for online sequence estimation/prediction in a proper learning setup is studied. If the underlying model class is discrete, then the total expected square loss is a particularly interesting…

Statistics Theory · Mathematics 2007-07-16 Jan Poland , Marcus Hutter

Estimating the number of sources impinging on an array of sensors is a well known and well investigated problem. A common approach for solving this problem is to use an information theoretic criterion, such as Minimum Description Length…

Information Theory · Computer Science 2009-11-11 Eran Fishler , H. Vincent Poor

Label distribution learning (LDL) is an effective method to predict the label description degree (a.k.a. label distribution) of a sample. However, annotating label distribution (LD) for training samples is extremely costly. So recent…

Machine Learning · Computer Science 2024-05-14 Yuheng Jia , Jiawei Tang , Jiahao Jiang

Pretrained language models (LMs) are prone to arithmetic errors. Existing work showed limited success in probing numeric values from models' representations, indicating that these errors can be attributed to the inherent unreliability of…

Computation and Language · Computer Science 2025-10-27 Marek Kadlčík , Michal Štefánik , Timothee Mickus , Michal Spiegel , Josef Kuchař

In-context learning (ICL) is an important paradigm for adapting large language models (LLMs) to new tasks, but the generalization behavior of ICL remains poorly understood. We investigate the inductive biases of ICL from the perspective of…

Computation and Language · Computer Science 2023-05-23 Chenglei Si , Dan Friedman , Nitish Joshi , Shi Feng , Danqi Chen , He He

Pre-trained contextual representations have led to dramatic performance improvements on a range of downstream tasks. Such performance improvements have motivated researchers to quantify and understand the linguistic information encoded in…

Computation and Language · Computer Science 2022-03-28 Alexander Immer , Lucas Torroba Hennigen , Vincent Fortuin , Ryan Cotterell