English
Related papers

Related papers: Project Ariadne: A Structural Causal Framework for…

200 papers

Large language models (LLMs) are increasingly used as judges of chain-of-thought (CoT) reasoning, but it remains unclear whether they can reliably assess process faithfulness rather than just answer plausibility. We introduce C2-Faith, a…

Computation and Language · Computer Science 2026-03-06 Avni Mittal , Rauno Arike

Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the…

Computation and Language · Computer Science 2025-03-04 Hongzhan Lin , Yang Deng , Yuxuan Gu , Wenxuan Zhang , Jing Ma , See-Kiong Ng , Tat-Seng Chua

We introduce AgenticSimLaw, a role-structured, multi-agent debate framework that provides transparent and controllable test-time reasoning for high-stakes tabular decision-making tasks. Unlike black-box approaches, our courtroom-style…

Artificial Intelligence · Computer Science 2026-01-30 Jon Chun , Kathrine Elkins , Yong Suk Lee

LLM-based agents increasingly coordinate decisions in multi-agent systems, often attaching natural-language reasoning to actions. However, reasoning is neither free nor automatically reliable: it incurs computational cost and, without…

Multiagent Systems · Computer Science 2026-04-14 Feliks Bańka , Jarosław A. Chudziak

There are two main barriers to using large language models (LLMs) in clinical reasoning. Firstly, while LLMs exhibit significant promise in Natural Language Processing (NLP) tasks, their performance in complex reasoning and planning falls…

Artificial Intelligence · Computer Science 2024-12-31 Shengxin Hong , Liang Xiao , Xin Zhang , Jianxia Chen

Large-scale telecom and datacenter infrastructures rely on multi-layered service and resource models, where failures propagate across physical and logical components and affect multiple customers. Traditional approaches to root cause…

Artificial Intelligence · Computer Science 2026-01-13 Nicolas Tacheny

Large language models can consult information that fixed static analyzers cannot, such as documentation, current security advisories, version-specific metadata, and informal API contracts. This makes LLMs a compelling option for program…

Software Engineering · Computer Science 2026-05-14 Jacqueline L. Mitchell , Chao Wang

The enterprise governance of Generative AI (GenAI) in regulated sectors, such as Human Resources (HR), demands scalable yet reproducible auditing mechanisms. While Large Language Model (LLM)-as-a-Judge approaches offer scalability, their…

Software Engineering · Computer Science 2026-01-21 Murtuza N. Shergadwala

We propose a hybrid architecture that integrates decision tree-based symbolic reasoning with the generative capabilities of large language models (LLMs) within a coordinated multi-agent framework. Unlike prior approaches that loosely couple…

Artificial Intelligence · Computer Science 2025-08-08 Andrew Kiruluta

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Large Language Models (LLMs) have revolutionized natural language processing, yet they struggle with inconsistent reasoning, particularly in novel domains and complex logical sequences. This research introduces Proof of Thought, a framework…

Artificial Intelligence · Computer Science 2024-10-24 Debargha Ganguly , Srinivasan Iyengar , Vipin Chaudhary , Shivkumar Kalyanaraman

Large Language Models (LLMs) offer natural language explanations as an alternative to feature attribution methods for model interpretability. However, despite their plausibility, they may not reflect the model's true reasoning faithfully.…

Computation and Language · Computer Science 2025-12-29 Kerem Zaman , Shashank Srivastava

Concept-based explanations quantify how high-level concepts (e.g., gender or experience) influence model behavior, which is crucial for decision-makers in high-stakes domains. Recent work evaluates the faithfulness of such explanations by…

Computation and Language · Computer Science 2026-01-21 Gilat Toker , Nitay Calderon , Ohad Amosy , Roi Reichart

Large language models (LLMs) are increasingly used in scientific domains. While they can produce reasoning-like content via methods such as chain-of-thought prompting, these outputs are typically unstructured and informal, obscuring whether…

Artificial Intelligence · Computer Science 2025-11-18 Pengze Li , Jiaqi Liu , Junchi Yu , Lihao Liu , Mingyu Ding , Wanli Ouyang , Shixiang Tang , Xi Chen

Large Language Models (LLMs) and Large Reasoning Models (LRMs) are increasingly used for critical tasks, yet they provide no guarantees about the correctness of their solutions. Users must decide whether to trust the model's answer, aided…

Human-Computer Interaction · Computer Science 2026-05-19 Vardhan Palod , Upasana Biswas , Subbarao Kambhampati

Ethical principles for algorithms are gaining importance as more and more stakeholders are affected by "high-risk" algorithmic decision-making (ADM) systems. Understanding how these systems work enables stakeholders to make informed…

Human-Computer Interaction · Computer Science 2023-05-26 Timothée Schmude , Laura Koesten , Torsten Möller , Sebastian Tschiatschek

Generative search engines and deep research LLM agents promise trustworthy, source-grounded synthesis, yet users regularly encounter overconfidence, weak sourcing, and confusing citation practices. We introduce DeepTRACE, a novel…

Computation and Language · Computer Science 2025-09-08 Pranav Narayanan Venkit , Philippe Laban , Yilun Zhou , Kung-Hsiang Huang , Yixin Mao , Chien-Sheng Wu

With the development of foundation model (FM), agentic AI systems are getting more attention, yet their inherent issues like hallucination and poor reasoning, coupled with the frequent ad-hoc nature of system design, lead to unreliable and…

Artificial Intelligence · Computer Science 2026-01-28 Minh-Dung Dao , Quy Minh Le , Hoang Thanh Lam , Duc-Trong Le , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…