English
Related papers

Related papers: Measuring Uncertainty in Transformer Circuits with…

200 papers

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Instance-dependent cost-sensitive (IDCS) classifiers offer a promising approach to improving cost-efficiency in credit scoring by tailoring loss functions to instance-specific costs. However, the impact of such loss functions on the…

Machine Learning · Computer Science 2025-09-03 Matteo Ballegeer , Matthias Bogaert , Dries F. Benoit

Explainable AI (XAI) in high-stakes domains should help stakeholders trust and verify system outputs. Yet Chain-of-Thought methods reason before concluding, and logical gaps or hallucinations can yield conclusions that do not reliably align…

Artificial Intelligence · Computer Science 2026-01-13 Chen Qian , Yimeng Wang , Yu Chen , Lingfei Wu , Andreas Stathopoulos

Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference time. However, uncertainty quantification for ICL remains…

Machine Learning · Statistics 2025-04-23 Zhe Huang , Simone Rossi , Rui Yuan , Thomas Hannagan

Mechanistic interpretability work attempts to reverse engineer the learned algorithms present inside neural networks. One focus of this work has been to discover 'circuits' -- subgraphs of the full model that explain behaviour on specific…

Machine Learning · Computer Science 2024-07-12 Joseph Miller , Bilal Chughtai , William Saunders

Chain-of-thought (CoT) reasoning improves the problem-solving ability of large language models (LLMs), but generated reasoning traces may not faithfully reflect the model's actual decision process. Existing CoT unfaithfulness detectors…

Artificial Intelligence · Computer Science 2026-05-26 Xu Shen , Zhen Tan , Song Wang , Pingjun Hong , Rui Miao , Xin Wang , Tianlong Chen

Electrochemical impedance spectroscopy (EIS) is an effective method for studying the electrochemical systems. The interpretation of EIS is the biggest challenge in this technology, which requires reasonable modeling. However, the modeling…

Data Analysis, Statistics and Probability · Physics 2019-07-04 Shan Zhu , Xinyang Sun , Yuxuan Wang , Naiqin Zhao , Junwei Sha

We introduce \textsc{CAT}, a framework designed to evaluate and visualize the \emph{interplay} of \emph{accuracy} and \emph{response consistency} of Large Language Models (LLMs) under controllable input variations, using multiple-choice…

Computation and Language · Computer Science 2026-01-01 Paulo Cavalin , Cassia Sanctos , Marcelo Grave , Claudio Pinhanez , Yago Primerano

Explainable Artificial Intelligence (XAI) methods (SHAP, LIME) are increasingly adopted to interpret models in high-stakes businesses. However, the credibility of these explanations, their stability under realistic data perturbations,…

Artificial Intelligence · Computer Science 2026-03-06 Alin-Gabriel Vaduva , Simona-Vasilica Oprea , Adela Bara

In-context learning (ICL) has emerged as an effective approach to enhance the performance of large language models (LLMs). However, its effectiveness varies significantly across models and tasks, posing challenges for practitioners to…

Computation and Language · Computer Science 2025-07-15 Dingzriui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

Causal analysis helps us understand variables that are responsible for system failures. This improves fault detection and makes system more reliable. In this work, we present a new method that combines causal inference with machine learning…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Karthik Peddi , Sai Ram Aditya Parisineni , Hemanth Macharla , Mayukha Pal

As large language models (LLMs) advance toward expert-level performance in engineering domains, reliable reasoning under user-specified constraints becomes critical. In circuit analysis, for example, a numerically correct solution is…

Software Engineering · Computer Science 2026-04-23 Mayank Ravishankara

Large language models (LLMs) such as DeepSeek-R1 have achieved remarkable performance across diverse reasoning tasks. To uncover the principles that govern their behaviour, we introduce the Electronic Circuit Principles (ECP), which maps…

Computation and Language · Computer Science 2025-10-27 Qiguang Chen , Libo Qin , Jinhao Liu , Dengyun Peng , Jiaqi Wang , Mengkang Hu , Zhi Chen , Wanxiang Che , Ting Liu

This paper introduces a novel in-context learning (ICL) framework, inspired by large language models (LLMs), for soft-input soft-output channel equalization in coded multiple-input multiple-output (MIMO) systems. The proposed approach…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Zihang Song , Matteo Zecchin , Bipin Rajendran , Osvaldo Simeone

Current paradigms for code verification rely heavily on external mechanisms-such as execution-based unit tests or auxiliary LLM judges-which are often labor-intensive or limited by the judging model's own capabilities. This raises a…

Software Engineering · Computer Science 2026-02-10 Yicheng He , Zheng Zhao , Zhou Kaiyu , Bryan Dai , Jie Fu , Yonghui Yang

In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks,…

Computation and Language · Computer Science 2024-06-06 Evan Becker , Stefano Soatto

The fields of explainable AI and mechanistic interpretability aim to uncover the internal structure of neural networks, with circuit discovery as a central tool for understanding model computations. Existing approaches, however, rely on…

Machine Learning · Computer Science 2026-03-05 Elena Golimblevskaia , Aakriti Jain , Bruno Puri , Ammar Ibrahim , Wojciech Samek , Sebastian Lapuschkin

Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL), where models adapt to new tasks through example-based prompts without requiring parameter updates. However, understanding how tasks are…

Computation and Language · Computer Science 2025-11-11 Baturay Saglam , Xinyang Hu , Zhuoran Yang , Dionysis Kalogerias , Amin Karbasi

Evaluating mathematical reasoning in LLMs is constrained by limited benchmark sizes and inherent model stochasticity, yielding high-variance accuracy estimates and unstable rankings across platforms. On difficult problems, an LLM may fail…

Machine Learning · Computer Science 2026-02-04 Zihan Dong , Zhixian Zhang , Yang Zhou , Can Jin , Ruijia Wu , Linjun Zhang

Recent research in retrieval-augmented generation (RAG) has concentrated on retrieving useful information from candidate documents. However, numerous methodologies frequently neglect the calibration capabilities of large language models…

Computation and Language · Computer Science 2025-06-23 Guanhua Chen , Yutong Yao , Lidia S. Chao , Xuebo Liu , Derek F. Wong