English
Related papers

Related papers: Disagreement as Data: Reasoning Trace Analytics in…

200 papers

Large Language Models (LLMs) and Large Reasoning Models (LRMs) are increasingly used for critical tasks, yet they provide no guarantees about the correctness of their solutions. Users must decide whether to trust the model's answer, aided…

Human-Computer Interaction · Computer Science 2026-05-19 Vardhan Palod , Upasana Biswas , Subbarao Kambhampati

Reading assessments are essential for enhancing students' comprehension, yet many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition. This study investigates the use of…

Computers and Society · Computer Science 2025-03-05 Eduardo Davalos , Yike Zhang , Namrata Srivastava , Jorge Alberto Salas , Sara McFadden , Sun-Joo Cho , Gautam Biswas , Amanda Goodwin

What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large…

Computation and Language · Computer Science 2025-09-03 Katharine Kowalyshyn , Matthias Scheutz

Retrieval-Augmented Generation (RAG) grounds large language models (LLMs) in external evidence, but fails when retrieved sources conflict or contain outdated or subjective information. Prior work address these issues independently but lack…

Computation and Language · Computer Science 2025-12-19 Shubham Mishra , Samyek Jain , Gorang Mehrishi , Shiv Tiwari , Harsh Sharma , Pratik Narang , Dhruv Kumar

Recent advances in Large Language Models (LLMs) have upgraded them from sophisticated text generators to autonomous agents capable of cooperation and tool use in multi-agent systems (MAS). However, it remains unclear how disagreements shape…

Computation and Language · Computer Science 2025-10-03 Tianjie Ju , Bowen Wang , Hao Fei , Mong-Li Lee , Wynne Hsu , Yun Li , Qianren Wang , Pengzhou Cheng , Zongru Wu , Haodong Zhao , Zhuosheng Zhang , Gongshen Liu

Qualitative data analysis provides insight into the underlying perceptions and experiences within unstructured data. However, the time-consuming nature of the coding process, especially for larger datasets, calls for innovative approaches,…

Human-Computer Interaction · Computer Science 2024-03-12 Elisabeth Kirsten , Annalina Buckmann , Abraham Mhaidli , Steffen Becker

Multi-agent systems (MAS) can substantially extend the reasoning capacity of large language models (LLMs), yet most frameworks still aggregate agent outputs with majority voting. This heuristic discards the evidential structure of reasoning…

Artificial Intelligence · Computer Science 2026-02-11 Wei Yang , Shixuan Li , Heng Ping , Peiyu Zhang , Paul Bogdan , Jesse Thomason

Numerous large language model (LLM) agents have been built for different tasks like web navigation and online shopping due to LLM's wide knowledge and text-understanding ability. Among these works, many of them utilize in-context examples…

Artificial Intelligence · Computer Science 2024-03-12 Ruiwen Zhou , Yingxuan Yang , Muning Wen , Ying Wen , Wenhao Wang , Chunling Xi , Guoqiang Xu , Yong Yu , Weinan Zhang

As large language model (LLM) agents evolve from isolated tool users into coordinated teams, reinforcement learning (RL) must optimize not only individual actions but also how work is spawned, delegated, communicated, aggregated, and…

Computation and Language · Computer Science 2026-05-05 Chenchen Zhang

Recent advancements in large language models (LLMs) revolutionize the field of intelligent agents, enabling collaborative multi-agent systems capable of tackling complex problems across various domains. However, the potential of conformity…

Computation and Language · Computer Science 2025-02-12 Zhiyuan Weng , Guikun Chen , Wenguan Wang

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

Computation and Language · Computer Science 2024-08-07 Philipp Mondorf , Barbara Plank

Dialogue data has been a key source for understanding learning processes, offering critical insights into how students engage in collaborative discussions and how these interactions shape their knowledge construction. The advent of Large…

Computation and Language · Computer Science 2025-04-29 Ying Na , Shihui Feng

Test-time scaling, which leverages additional computation during inference to improve model accuracy, has enabled a new class of Large Language Models (LLMs) that are able to reason through complex problems by understanding the goal,…

Computation and Language · Computer Science 2025-11-25 Shaltiel Shmidman , Asher Fredman , Oleg Sudakov , Meriem Bendris

Recent advances in reasoning-focused Large Language Models (LLMs) have introduced Chain-of-Thought (CoT) traces - intermediate reasoning steps generated before a final answer. These traces, as in DeepSeek R1, guide inference and train…

Computation and Language · Computer Science 2026-04-20 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Recent advances in natural language processing highlight two key factors for improving reasoning in large language models (LLMs): (i) allocating more test-time compute tends to help on harder problems but often introduces redundancy in the…

Computation and Language · Computer Science 2025-11-04 Riccardo Alberghi , Elizaveta Demyanenko , Luca Biggio , Luca Saglietti

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Large Reasoning Models (LRMs) still exhibit large performance gaps between English and other languages, yet much current work assumes these gaps can be closed simply by making reasoning in every language resemble English reasoning. This…

Computation and Language · Computer Science 2026-04-07 Dayeon Ki , Kevin Duh , Marine Carpuat

Research shows that dialogue, the interactive process through which participants articulate their thinking, plays a central role in constructing shared understanding, coordinating action, and shaping learning outcomes in teams. Analysing…

Large language models (LLMs) and agent techniques have brought a fundamental shift in the functionality and development paradigm of data analysis tasks (a.k.a LLM/Agent-as-Data-Analyst), demonstrating substantial impact across both academia…