English
Related papers

Related papers: daVinci-Agency: Unlocking Long-Horizon Agency Data…

200 papers

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

While agent evaluation has shifted toward long-horizon tasks, most benchmarks still emphasize local, step-level reasoning rather than the global constrained optimization (e.g., time and financial budgets) that demands genuine planning…

Artificial Intelligence · Computer Science 2026-01-27 Yinger Zhang , Shutong Jiang , Renhao Li , Jianhong Tu , Yang Su , Lianghao Deng , Xudong Guo , Chenxu Lv , Junyang Lin

This paper examines how different types of large language model (LLM) agents perform on scientific visualization (SciVis) tasks, where users generate visualization workflows from natural-language instructions. We compare three primary…

Artificial Intelligence · Computer Science 2026-05-14 Jackson Vonderhorst , Kuangshi Ai , Haichao Miao , Shusen Liu , Chaoli Wang

Equipping LLMs with tool-use capabilities via Agentic Reinforcement Learning (Agentic RL) is bottlenecked by two challenges: the lack of scalable, robust execution environments and the scarcity of realistic training data that captures…

Current agentic frameworks underperform on long-horizon tasks. As reasoning depth increases, sequential orchestration becomes brittle, context windows impose hard limits that degrade performance, and opaque execution traces make failures…

Artificial Intelligence · Computer Science 2026-02-17 Salaheddin Alzu'bi , Baran Nama , Arda Kaz , Anushri Eswaran , Weiyuan Chen , Sarvesh Khetan , Rishab Bala , Tu Vu , Sewoong Oh

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across a wide range of NLP tasks, yet they remain prone to factual inaccuracies and hallucinations. This limitation poses significant risks in high-stakes…

Artificial Intelligence · Computer Science 2026-04-24 Vipula Rawte , Ryan Rossi , Franck Dernoncourt , Nedim Lipka

The foundational pretraining phase determines a model's capability ceiling, as post-training struggles to overcome capability foundations established during pretraining, yet it remains critically under-explored. This stems from a structural…

Artificial Intelligence · Computer Science 2026-03-31 Yiwei Qin , Yixiu Liu , Tiantian Mi , Muhang Xie , Zhen Huang , Weiye Si , Pengrui Lu , Siyuan Feng , Xia Wu , Liming Liu , Ye Luo , Jinlong Hou , Qipeng Guo , Yu Qiao , Pengfei Liu

Recent advancements in Large Language Model (LLM) agents have enabled complex multi-turn agentic tasks requiring extensive tool calling, where conversations can span dozens of API calls with increasingly large context windows. However,…

Computation and Language · Computer Science 2026-02-03 Elias Lumer , Faheem Nizar , Akshaya Jangiti , Kevin Frank , Anmol Gulati , Mandar Phadate , Vamse Kumar Subbiah

Information-seeking is a core capability for AI agents, requiring them to gather and reason over tool-generated information across long trajectories. However, such multi-step information-seeking tasks remain challenging for agents backed by…

Artificial Intelligence · Computer Science 2025-11-25 Jaewoo Lee , Archiki Prasad , Justin Chih-Yao Chen , Zaid Khan , Elias Stengel-Eskin , Mohit Bansal

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

Artificial Intelligence · Computer Science 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Recently, Diffusion Large Language Models (dLLMs) have demonstrated unique efficiency advantages, enabled by their inherently parallel decoding mechanism and flexible generation paradigm. Meanwhile, despite the rapid advancement of Search…

Artificial Intelligence · Computer Science 2026-02-10 Jiahao Zhao , Shaoxuan Xu , Zhongxiang Sun , Fengqi Zhu , Jingyang Ou , Yuling Shi , Chongxuan Li , Xiao Zhang , Jun Xu

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

Recent advances in Large Language Models (LLMs) have shown that their reasoning capabilities can be significantly improved through Reinforcement Learning with Verifiable Reward (RLVR), particularly in domains like mathematics and…

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Recent mechanistic studies suggest that large language models (LLMs) may utilize their depth inefficiently in standard single-turn tasks. Whether this still holds in autonomous agent settings, where models must perform multi-turn planning,…

Artificial Intelligence · Computer Science 2026-05-28 Zhenyu Cui , Xiangzhong Luo

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks but remain fundamentally static, unable to adapt their internal parameters to novel tasks, evolving knowledge domains, or dynamic interaction…