English
Related papers

Related papers: Measuring Uncertainty in Transformer Circuits with…

200 papers

Deploying large language models for clinical Text-to-SQL requires distinguishing two qualitatively different causes of output diversity: (i) input ambiguity that should trigger clarification, and (ii) model instability that should trigger…

Computation and Language · Computer Science 2026-05-19 Angelo Ziletti , Leonardo D'Ambrosi

As large language models (LLMs) are increasingly deployed in high-stakes and operational settings, evaluation strategies based solely on aggregate accuracy are often insucient to characterize system reliability. This study proposes a…

Artificial Intelligence · Computer Science 2026-05-06 Hikmat Karimov , Rahid Zahid Alekberli

Electrochemical impedance spectroscopy (EIS) is a widely used tool for characterization of fuel cells and other electrochemical conversion systems. When applied to the on-line monitoring in the context of in-field applications, the…

Live sequence charts (LSCs) have been proposed as an inter-object scenario-based specification and visual programming language for reactive systems. In this paper, we introduce a logic-based framework to check the consistency of an LSC…

Logic in Computer Science · Computer Science 2010-02-17 Hai-Feng Guo , Wen Zheng , Mahadevan Subramaniam

We introduce the Integrated Tsallis Combination (ITC), a hybrid impurity measure for decision tree learning that combines normalized Tsallis entropy with an exponential polarization component. While many existing measures sacrifice…

Machine Learning · Statistics 2026-03-17 Edouard Lansiaux , Idriss Jairi , Hayfa Zgaya-Biau

In-context Learning (ICL) is an emerging few-shot learning paradigm on Language Models (LMs) with inner mechanisms un-explored. There are already existing works describing the inner processing of ICL, while they struggle to capture all the…

Computation and Language · Computer Science 2025-02-21 Hakaze Cho , Mariko Kato , Yoshihiro Sakai , Naoya Inoue

Ensuring the integrity of quantum circuits is a significant challenge in the Noisy Intermediate-Scale Quantum (NISQ) era, where circuits are subject to compilation transformations, hardware constraints, and potential adversarial…

Quantum Physics · Physics 2026-04-30 Ejaz Ahmed , Boshuai Ye , Syed Hamza Shah , Muhammad Azeem Akbar , Arif Ali Khan

For iterative learning control (ILC), one of the basic problems left to address is how to solve the contradiction between convergence conditions for the output tracking error and for the input signal (or error). This problem is considered…

Systems and Control · Electrical Eng. & Systems 2019-10-24 Deyuan Meng , Jingyao Zhang

Probabilistic decoding in Large Language Models (LLMs) often yields inconsistent outputs, particularly on complex or long-form questions. Self-Consistency (SC) mitigates this for short-form QA by majority voting over exact strings, whereas…

Computation and Language · Computer Science 2026-03-02 Jungsuk Oh , Jay-Yoon Lee

Intrusion detection systems (IDSs) for 5G networks must handle complex, high-volume traffic. Although opaque "black-box" models can achieve high accuracy, their lack of transparency hinders trust and effective operational response. We…

Cryptography and Security · Computer Science 2026-04-21 Saeid Sheikhi , Panos Kostakos , Lauri Loven

In recent years, explaining decisions made by complex machine learning models has become essential in high-stakes domains such as energy systems, healthcare, finance, and autonomous systems. However, the reliability of these explanations,…

Machine Learning · Computer Science 2026-02-06 Poushali Sengupta , Sabita Maharjan , Frank Eliassen , Shashi Raj Pandey , Yan Zhang

Predictions of uncertainty-aware models are diverse, ranging from single point estimates (often averaged over prediction samples) to predictive distributions, to set-valued or credal-set representations. We propose a novel unified…

Machine Learning · Computer Science 2025-02-18 Shireen Kudukkil Manchingal , Muhammad Mubashar , Kaizheng Wang , Fabio Cuzzolin

This paper proposes CES, a task to evaluate the abilities of LLMs in simulating program execution and using that reasoning in programming tasks. Besides measuring the correctness of variable predictions during execution simulation, CES…

Software Engineering · Computer Science 2026-04-08 Changshu Liu , Yang Chen , Reyhaneh Jabbarvand

Controllability scores provide principled information on where intervention should be applied in large-scale network systems when explicit control design is difficult. Two representative controllability scores are the volumetric…

Optimization and Control · Mathematics 2026-03-27 Kazuhiro Sato

Extensively evaluating the capabilities of (large) language models is difficult. Rapid development of state-of-the-art models induce benchmark saturation, while creating more challenging datasets is labor-intensive. Inspired by the recent…

Computation and Language · Computer Science 2025-06-02 Alan Sun

In the evolving landscape of ECG signal analysis, the challenge of limited transparency in machine learning models remains a significant barrier to their effective integration into clinical practice. This study addresses this issue by…

Signal Processing · Electrical Eng. & Systems 2024-12-09 Toygar Tanyel , Sezgin Atmaca , Kaan Gökçe , M. Yiğit Balık , Arda Güler , Emre Aslanger , İlkay Öksüz

Conformal prediction methods create prediction bands with distribution-free guarantees but do not explicitly capture epistemic uncertainty, which can lead to overconfident predictions in data-sparse regions. Although recent conformal scores…

Machine Learning · Statistics 2025-06-11 Luben M. C. Cabezas , Vagner S. Santos , Thiago R. Ramos , Rafael Izbicki

Click-through rate (CTR) prediction plays an important role in online advertising systems. On the one hand, traditional CTR prediction models capture the collaborative signals in tabular data via feature interaction modeling, but they lose…

Information Retrieval · Computer Science 2025-09-10 Rui Dong , Wentao Ouyang , Xiangzheng Liu

Deep learning has improved automated electrocardiogram (ECG) classification, but limited insight into prediction reliability hinders its use in safety-critical settings. This paper proposes UCTECG-Net, an uncertainty-aware hybrid…

Machine Learning · Computer Science 2026-02-19 Hamzeh Asgharnezhad , Pegah Tabarisaadi , Abbas Khosravi , Roohallah Alizadehsani , U. Rajendra Acharya

Sparse autoencoders (SAEs) are a popular tool for interpreting large language model activations, but their utility in addressing open questions in interpretability remains unclear. In this work, we demonstrate their effectiveness by using…

Machine Learning · Computer Science 2025-04-21 Dmitrii Kharlapenko , Stepan Shabalin , Fazl Barez , Arthur Conmy , Neel Nanda