English
Related papers

Related papers: Measuring Uncertainty in Transformer Circuits with…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks. However, the truthfulness of their outputs is not guaranteed, and their tendency toward overconfidence further limits reliability. Uncertainty…

Computation and Language · Computer Science 2026-03-23 Qi Cao , Andrew Gambardella , Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Probabilistic Circuits (PCs) are deep generative models that support exact and efficient probabilistic inference. Yet in autoregressive language modeling, PCs still lag behind Transformer-based large language models (LLMs), suggesting an…

Machine Learning · Computer Science 2026-05-14 Zhiyu Zhao , Xuejie Liu , Muhan Zhang , Anji Liu

In-context learning (ICL) is one of the most powerful and most unexpected capabilities to emerge in recent transformer-based large language models (LLMs). Yet the mechanisms that underlie it are poorly understood. In this paper, we…

Detecting Alzheimer's Disease (AD) from narrative transcripts remains a challenging task for large language models (LLMs), particularly under out-of-distribution (OOD) and data-scarce conditions. While in-context learning (ICL) provides a…

Computation and Language · Computer Science 2025-11-11 Puzhen Su , Yongzhu Miao , Chunxi Guo , Jintao Tang , Shasha Li , Ting Wang

Just like the previous generation of task-tuned models, large language models (LLMs) that are adapted to tasks via prompt-based methods like in-context-learning (ICL) perform well in some setups but not in others. This lack of consistency…

Computation and Language · Computer Science 2023-12-11 Lucas Weber , Elia Bruni , Dieuwke Hupkes

Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions,…

Machine Learning · Computer Science 2024-12-03 Yifan Xu , Xue Jiang , Dongrui Wu

Electronic control units (ECUs) embedded within modern vehicles generate a large number of asynchronous events known as diagnostic trouble codes (DTCs). These discrete events form complex temporal sequences that reflect the evolving health…

Artificial Intelligence · Computer Science 2026-03-20 Hugo Math

In-context learning (ICL) has emerged as a powerful capability of large pretrained transformers, enabling them to solve new tasks implicit in example input-output pairs without any gradient updates. Despite its practical success, the…

Machine Learning · Computer Science 2025-07-15 Joshua Hill , Benjamin Eyre , Elliot Creager

Schema-guided reasoning pipelines ask LLMs to produce explicit intermediate structures -- rubrics, checklists, verification queries -- before committing to a final decision. But do these structures causally determine the output, or merely…

Artificial Intelligence · Computer Science 2026-03-18 Oleg Somov , Mikhail Chaichuk , Mikhail Seleznyov , Alexander Panchenko , Elena Tutubalina

Existing methods derive clinical functional metrics from ventricular semantic segmentation in cardiac cine sequences. While performing well on overall segmentation, they struggle with the end slices. To address this, we extract global…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yiwei Liu , Liang Zhong , Lingyi Wen , Yuankai Wu

A major shortcoming of medical practice is the lack of an objective measure of conscious level. Impairment of consciousness is common, e.g. following brain injury and seizures, which can also interfere with sensory processing and volitional…

Neurons and Cognition · Quantitative Biology 2025-12-24 Alexis Pomares Pastor , Ines Ribeiro Violante , Gregory Scott

Large Language Models (LLMs) changed the way we design and interact with software systems. Their ability to process and extract information from text has drastically improved productivity in a number of routine tasks. Developers that want…

Machine Learning · Computer Science 2025-08-26 Federico Errica , Giuseppe Siracusano , Davide Sanvito , Roberto Bifulco

Counterfactual explanations (CEs) enhance the interpretability of machine learning models by describing what changes to an input are necessary to change its prediction to a desired class. These explanations are commonly used to guide users'…

Machine Learning · Computer Science 2024-03-07 Anna P. Meyer , Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Deep learning-based support systems have demonstrated encouraging results in numerous clinical applications involving the processing of time series data. While such systems often are very accurate, they have no inherent mechanism for…

Machine Learning · Computer Science 2020-12-16 Kristoffer Wickstrøm , Karl Øyvind Mikalsen , Michael Kampffmeyer , Arthur Revhaug , Robert Jenssen

Explainable Artificial Intelligence (XAI) methods are increasingly used in safety-critical domains, yet there is no unified framework to jointly evaluate fidelity, interpretability, robustness, fairness, and completeness. We address this…

Artificial Intelligence · Computer Science 2026-04-10 Md. Ariful Islam , Md Abrar Jahin , M. F. Mridha , Nilanjan Dey

This paper introduces a reconfigurable intelligent surface (RIS) to support parameter estimation in machine-type communications (MTC). We focus on a network where single-antenna sensors transmit spatially correlated measurements to a…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Sergi Liesegang , Antonio Pascual-Iserte , Olga Muñoz

This paper introduces the concept of Transient Slack Capability (TSC), a set of three necessary device-level conditions to ensure stability under sustained power perturbations. TSC states that a device must (1) possess sufficient stored…

Systems and Control · Electrical Eng. & Systems 2025-05-26 Rodrigo Bernal , Federico Milano

Air Traffic Control (ATC) is a safety-critical domain in which incorrect interpretation of instructions may lead to severe operational consequences. While large language models (LLMs) demonstrate strong general performance, their…

Computation and Language · Computer Science 2026-05-13 Yujing Chang , Yash Guleria , Duc-Thinh Pham , Nhut-Huy Pham , Ningli Wang , Vu N. Duong , Sameer Alam

Coherent groups of generators, i.e., machines with perfectly correlated rotor angles, play an important role in power system stability analysis. This paper introduces a real-time methodology based on hierarchical clustering techniques for…

Signal Processing · Electrical Eng. & Systems 2021-03-01 Faycal Znidi , Hamzeh Davarikia , Heena Rathore

We introduce the target controllability score (TCS), a concept for evaluating node importance under actuator constraints and designated target objectives, formulated within a virtual system setting. The TCS consists of the target volumetric…

Optimization and Control · Mathematics 2026-04-24 Kazuhiro Sato