English
Related papers

Related papers: TRACE: A Framework for Analyzing and Enhancing Ste…

200 papers

Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal prediction provides finite-sample, distribution-free coverage guarantees, its practical…

Machine Learning · Statistics 2026-05-11 Zhenhan Fang , Aixin Tan , Jian Huang

Temporal causal representation learning methods assume that causal mechanisms switch instantaneously between discrete domains, yet real-world systems often exhibit continuous mechanism transitions. For example, a vehicle's dynamics evolve…

Machine Learning · Computer Science 2026-01-30 Shicheng Fan , Kun Zhang , Lu Cheng

The ubiquity of dynamic data in domains such as weather, healthcare, and energy underscores a growing need for effective interpretation and retrieval of time-series data. These data are inherently tied to domain-specific contexts, such as…

Machine Learning · Computer Science 2026-02-03 Jialin Chen , Ziyu Zhao , Gaukhar Nurbek , Aosong Feng , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

We introduce TRACE, a cross-domain engineering framework for trustworthy agentic AI in operationally critical domains. TRACE combines a four-layer reference architecture with an explicit classical-ML vs. LLM-validator split (L2a/L2b), a…

Computation and Language · Computer Science 2026-05-06 Serhii Zabolotnii

Evaluating LLM reliability via scalar probabilities often fails to capture the structural dynamics of reasoning. We introduce TRACED, a framework that assesses reasoning quality through theoretically grounded geometric kinematics. By…

Artificial Intelligence · Computer Science 2026-05-05 Xinyan Jiang , Ninghao Liu , Di Wang , Lijie Hu

Multi-video event understanding demands models that can locate and attribute query-relevant evidence scattered across long, heterogeneous video corpora. Existing large vision-language models (LVLMs) often underperform in this regime because…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Pengyu Yan , Akhil Gorugantu , Mahesh Bhosale , Abdul Wasi , Vishvesh Trivedi , David Doermann

Human activity recognition (HAR) in smart homes remains challenging because many daily activities exhibit similar local sensor patterns, while minimally intrusive sensing provides sparse and ambiguous observations. As a result, methods…

Large Language Models (LLMs) leverage step-by-step reasoning to solve complex problems. Standard evaluation practice involves generating a complete reasoning trace and assessing the correctness of the final answer presented at its…

Computation and Language · Computer Science 2025-04-30 Hasan Abed Al Kader Hammoud , Hani Itani , Bernard Ghanem

Large Language Model interfaces are increasingly verbose, exposing intermediate reasoning traces alongside final answers. Traces are framed as transparency mechanisms, yet it is unclear how people use them to solve problems. We report a…

Human-Computer Interaction · Computer Science 2026-05-26 Daniela Fernandes , Daniel Buschek , Lev Tankelevitch , Thomas Kosch , Robin Welsch

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

Computation and Language · Computer Science 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

Language model (LM) "reasoning", commonly described as Chain-of-Thought or test-time scaling, often improves benchmark performance, but the dynamics underlying this process remain poorly understood. We study these dynamics through the lens…

The rapid evolution of large language models (LLMs) represents a substantial leap forward in natural language understanding and generation. However, alongside these advancements come significant challenges related to the accountability and…

Computation and Language · Computer Science 2024-07-09 Cheng Wang , Xinyang Lu , See-Kiong Ng , Bryan Kian Hsiang Low

Evaluating large language models (LLMs) on final-answer correctness is the dominant paradigm. This approach, however, provides a coarse signal for model improvement and overlooks the quality of the underlying reasoning process. We argue…

Artificial Intelligence · Computer Science 2025-10-24 Heejin Do , Jaehui Hwang , Dongyoon Han , Seong Joon Oh , Sangdoo Yun

Step-by-step reasoning is widely used to enhance the reasoning ability of large language models (LLMs) in complex problems. Evaluating the quality of reasoning traces is crucial for understanding and improving LLM reasoning. However,…

Computation and Language · Computer Science 2025-09-23 Jinu Lee , Julia Hockenmaier

Universal Multimodal Retrieval requires unified embedding models capable of interpreting diverse user intents, ranging from simple keywords to complex compositional instructions. While Multimodal Large Language Models (MLLMs) possess strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Xiangzhao Hao , Shijie Wang , Tianyu Yang , Tianyue Wang , Haiyun Guo , Jinqiao Wang

Large language models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, yet their decision-making processes remain difficult to interpret. Existing explanation methods often lack trustworthy structural insight and are…

Machine Learning · Computer Science 2026-02-24 Yujiao Yang

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

Self-Consistency mitigates hallucinations in Large Language Models (LLMs) by sampling multiple reasoning paths,but it lacks a systematic approach to determine the optimal number of samples or select the most faithful rationale. To address…

Computation and Language · Computer Science 2025-02-05 Guangya Wan , Yuqi Wu , Jie Chen , Sheng Li

Modern transformer models exhibit phase transitions during training, distinct shifts from memorisation to abstraction, but the mechanisms underlying these transitions remain poorly understood. Prior work has often focused on endpoint…

Computation and Language · Computer Science 2025-05-26 Nura Aljaafari , Danilo S. Carvalho , André Freitas

Large reasoning models (LRMs) often generate long, seemingly coherent reasoning traces yet still produce incorrect answers, making hallucination detection challenging. Although trajectories contain useful signals, directly using trace text…

Machine Learning · Computer Science 2026-05-06 Jianxiong Zhang , Bing Guo , Yuming Jiang , Haobo Wang , Bo An , Sean Du