English
Related papers

Related papers: Thinking vs. Doing: Agents that Reason by Scaling …

200 papers

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

Human education transcends mere knowledge transfer, it relies on co-adaptation dynamics -- the mutual adjustment of teaching and learning strategies between agents. Despite its centrality, computational models of co-adaptive teacher-student…

Computers and Society · Computer Science 2025-05-07 Francesco Balzan , Pedro P. Santos , Maurizio Gabbrielli , Mahault Albarracin , Manuel Lopes

While large language models (LLMs) have demonstrated impressive capabilities across tasks in language understanding and interactive decision making, their abilities for reasoning (e.g. chain-of-thought prompting) and acting (e.g. action…

Computation and Language · Computer Science 2023-03-13 Shunyu Yao , Jeffrey Zhao , Dian Yu , Nan Du , Izhak Shafran , Karthik Narasimhan , Yuan Cao

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models…

While Large Vision-Language Models (LVLMs) have significantly advanced GUI agents' capabilities in parsing textual instructions, interpreting screen content, and executing tasks, a critical challenge persists: the irreversibility of agent…

Artificial Intelligence · Computer Science 2026-01-27 Shaokang Wang , Pei Fu , Ruoceng Zhang , Shaojie Zhang , Xiuwen Xi , Jiahui Yang , Bin Qin , Ying Huang , Zhenbo Luo , Jian Luan

Large language models (LLMs) excel at solving problems with clear and complete statements, but often struggle with nuanced environments or interactive tasks which are common in most real-world scenarios. This highlights the critical need…

While integrating tools like Code Interpreter and Search has significantly enhanced Large Language Model (LLM) reasoning in models like ChatGPT Agent and Gemini-Pro, practical guidance on optimal tool use is lacking. The core challenge is…

Computation and Language · Computer Science 2025-10-03 Yongchao Chen , Jiefeng Chen , Rui Meng , Ji Yin , Na Li , Chuchu Fan , Chi Wang , Tomas Pfister , Jinsung Yoon

Scaling test-time computation improves large language model performance without additional training. Recent work demonstrates that techniques such as repeated sampling, self-verification, and self-reflection can significantly enhance task…

Artificial Intelligence · Computer Science 2025-12-15 Dongwon Jung , Peng Shi , Yi Zhang

Unified models can handle both multimodal understanding and generation within a single architecture, yet they typically operate in a single pass without iteratively refining their outputs. Many multimodal tasks, especially those involving…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Leon Liangyu Chen , Haoyu Ma , Zhipeng Fan , Ziqi Huang , Animesh Sinha , Xiaoliang Dai , Jialiang Wang , Zecheng He , Jianwei Yang , Chunyuan Li , Junzhe Sun , Chu Wang , Serena Yeung-Levy , Felix Juefei-Xu

Verifiers have been demonstrated to enhance LLM reasoning via test-time scaling (TTS). Yet, they face significant challenges in complex domains. Error propagation from incorrect intermediate reasoning can lead to false positives for…

Benefiting from the powerful capabilities of large language models (LLMs), agents based on LLMs have shown the potential to address domain-specific tasks and emulate human behaviors. However, the content generated by these agents remains…

Artificial Intelligence · Computer Science 2023-08-29 Shi Jinxin , Zhao Jiabao , Wang Yilei , Wu Xingjiao , Li Jiawen , He Liang

Language is often considered a key aspect of human thinking, providing us with exceptional abilities to generalize, explore, plan, replan, and adapt to new situations. However, Reinforcement Learning (RL) agents are far from human-level…

Artificial Intelligence · Computer Science 2024-01-19 Shengran Hu , Jeff Clune

LLM agents are increasingly expected to function as general-purpose systems capable of resolving open-ended user requests. While existing benchmarks focus on domain-aware environments for developing specialized agents, evaluating…

Artificial Intelligence · Computer Science 2026-02-24 Xiaochuan Li , Ryan Ming , Pranav Setlur , Abhijay Paladugu , Andy Tang , Hao Kang , Shuai Shao , Rong Jin , Chenyan Xiong

Recent progress in reasoning with large language models (LLMs), such as DeepSeek-R1, demonstrates impressive capabilities in domains like mathematics and coding, by exhibiting complex cognitive behaviors such as verification, goal…

Artificial Intelligence · Computer Science 2025-10-14 Xiao Yu , Baolin Peng , Ruize Xu , Michel Galley , Hao Cheng , Suman Nath , Jianfeng Gao , Zhou Yu

LLM-driven GUI agents are increasingly used in production systems to automate workflows and simulate users for evaluation and optimization. Yet most GUI-agent evaluations emphasize task success and provide limited evidence on whether agents…

Information Retrieval · Computer Science 2026-04-10 Maria Movin , Claudia Hauff , Aron Henriksson , Panagiotis Papapetrou

Test-time scaling has emerged as a widely adopted inference-time strategy for boosting reasoning performance. However, its effectiveness has been studied almost exclusively in English, leaving its behavior in other languages largely…

Computation and Language · Computer Science 2025-05-22 Prasoon Bajpai , Tanmoy Chakraborty

We are exploring the enhancement of models of agent behaviour with more "human-like" decision making strategies than are presently available. Our motivation is to developed with a view to as the decision analysis and support for electric…

Multiagent Systems · Computer Science 2009-12-22 Yee Ming Chen , Bo-Yuan Wang , Hung-Ming Shiu

Large language models (LLMs) achieve strong performance when all task-relevant information is available upfront, as in static prediction and instruction-following problems. However, many real-world decision-making tasks are inherently…

Artificial Intelligence · Computer Science 2026-02-05 Xiaofeng Lin , Sirou Zhu , Yilei Chen , Mingyu Chen , Hejian Sang , Ioannis Paschalidis , Zhipeng Wang , Aldo Pacchiano , Xuezhou Zhang

A common failure mode in long-horizon agentic test-time scaling is error propagation, where factual errors or invalid deductions introduced at intermediate steps persist in the agent's belief state and contaminate later reasoning. Existing…

Artificial Intelligence · Computer Science 2026-05-22 Woomin Song , Beomjun Kim , Daewon Choi , Sai Muralidhar Jayanthi , Saket Dingliwal , Jinwoo Shin , Aram Galstyan

Design patterns have been used in various fields of inquiry and endeavour to externalize procedural knowledge in a form that supports human reasoning and coordination. In this paper, we show that contemporary Large Language Model…

Human-Computer Interaction · Computer Science 2026-02-05 Joseph Corneli , Charles J. Danoff , Raymond S. Puzio , Sridevi Ayloo , Sergio Belich , Andre Wilkinson , Mary Tedeschi , Pauline Mosley