English
Related papers

Related papers: CoVe: Training Interactive Tool-Use Agents via Con…

200 papers

Developing AI agents to autonomously manipulate graphical user interfaces is a long challenging task. Recent advances in data scaling law inspire us to train computer-use agents with a scaled instruction set, yet using behavior cloning to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Fanbin Lu , Zhisheng Zhong , Ziqin Wei , Shu Liu , Chi-Wing Fu , Jiaya Jia

Language Model (LM) agents have demonstrated remarkable capabilities in solving tasks that require multiple interactions with the environment. However, they remain vulnerable in environments where a single error often leads to irrecoverable…

Artificial Intelligence · Computer Science 2026-02-24 Jongwon Jeong , Jungtaek Kim , Kangwook Lee

Tool-calling agents are increasingly deployed in real-world customer-facing workflows. Yet most studies on tool-calling agents focus on idealized settings with general, fixed, and well-specified tasks. In real-world applications, user…

Computation and Language · Computer Science 2026-04-23 Ziyi Wang , Yuxuan Lu , Yimeng Zhang , Pei Chen , Ziwei Dong , Jing Huang , Jiri Gesi , Xianfeng Tang , Chen Luo , Qun Liu , Yisi Sang , Hanqing Lu , Manling Li , Jin Lai , Dakuo Wang

Language models (LMs) can solve tasks such as answering questions about tables or images by writing programs. However, using primitive functions often leads to verbose and error-prone programs, and higher-level functions require expert…

Artificial Intelligence · Computer Science 2024-01-24 Zhiruo Wang , Daniel Fried , Graham Neubig

Generating long, informative, and factual outputs remains a major challenge for Large Language Models (LLMs). Existing benchmarks for long-form generation typically assess real-world queries with hard-to-verify metrics or use synthetic…

Computation and Language · Computer Science 2025-10-29 Zikai Xiao , Fei Huang , Jianhong Tu , Jianhui Wei , Wen Ma , Yuxuan Zhou , Jian Wu , Bowen Yu , Zuozhu Liu , Junyang Lin

The development of Multimodal Virtual Agents has made significant progress through the integration of Multimodal Large Language Models. However, mainstream training paradigms face key challenges: Behavior Cloning is simple and effective…

Machine Learning · Computer Science 2026-01-06 Keyu Wang , Bingchen Miao , Wendong Bu , Yu Wu , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Jun Xiao , Yueting Zhuang

Recent advances in large language models (LLMs) and agent system designs have empowered agents with unprecedented levels of capability. However, existing agent benchmarks are showing a trend of rapid ceiling-hitting by newly developed…

Artificial Intelligence · Computer Science 2026-03-25 Dadi Guo , Tianyi Zhou , Dongrui Liu , Chen Qian , Qihan Ren , Shuai Shao , Zhiyuan Fan , Yi R. Fung , Kun Wang , Linfeng Zhang , Jing Shao

As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While…

Software Engineering · Computer Science 2026-04-28 Yifan Zhang , Jianmin Ye , Jiahao Yang , Xi Wang

Interactive tool-using agents must solve real-world tasks via multi-turn interaction with both humans and external environments, requiring dialogue state tracking, multi-step tool execution, while following complex instructions.…

Artificial Intelligence · Computer Science 2026-03-11 Jiaxuan Gao , Jiaao Chen , Chuyi He , Shusheng Xu , Di Jin , Yi Wu

Extending the capabilities of Large Language Models (LLMs) with functions or tools for environment interaction has led to the emergence of the agent paradigm. In industry, training an LLM is not always feasible because of the scarcity of…

Computation and Language · Computer Science 2025-01-14 Saptarshi Sengupta , Harsh Vashistha , Kristal Curtis , Akshay Mallipeddi , Abhinav Mathur , Joseph Ross , Liang Gou

Reinforcement learning with verifiable rewards (RLVR) has advanced the reasoning capabilities of large language models. However, existing methods rely solely on outcome rewards, without explicitly optimizing verification or leveraging…

Software Engineering · Computer Science 2025-10-22 Yiyang Jin , Kunzhao Xu , Hang Li , Xueting Han , Yanmin Zhou , Cheng Li , Jing Bai

Recent work synthesizes agentic tasks for post-training tool-using LLMs, yet robust generalization under shifts in tasks and toolsets remains an open challenge. We trace this brittleness to insufficient diversity in synthesized tasks.…

Artificial Intelligence · Computer Science 2026-03-13 Aili Chen , Chi Zhang , Junteng Liu , Jiangjie Chen , Chengyu Du , Yunji Li , Ming Zhong , Qin Wang , Zhengmao Zhu , Jiayuan Song , Ke Ji , Junxian He , Pengyu Zhao , Yanghua Xiao

Scenario-based testing using simulations is a cornerstone of Autonomous Vehicles (AVs) software validation. So far, developers needed to choose between low-fidelity 2D simulators to explore the scenario space efficiently, and high-fidelity…

Robotics · Computer Science 2025-05-21 Marc Kaufeld , Korbinian Moller , Alessio Gambi , Paolo Arcaini , Johannes Betz

The rapid progress of large foundation models has accelerated the development of task-specialized agents across diverse domains. However, the effectiveness of agents remains tightly coupled with the quality of training data, while curating…

Artificial Intelligence · Computer Science 2026-02-04 Yeonsung Jung , Trilok Padhi , Sina Shaham , Dipika Khullar , Joonhyun Jeong , Ninareh Mehrabi , Eunho Yang

Authorship Verification (AV) (do two documents have the same author?) is essential in many real-life applications. AV is often used in privacy-sensitive domains that require an offline proprietary model that is deployed on premises, making…

Computation and Language · Computer Science 2025-02-11 Sahana Ramnath , Kartik Pandey , Elizabeth Boschee , Xiang Ren

Multi-agent embodied systems hold promise for complex collaborative manipulation, yet face critical challenges in spatial coordination, temporal reasoning, and shared workspace awareness. Inspired by human collaboration where cognitive…

Prior works on training software engineering agents have explored utilizing existing resources such as issues on GitHub repositories to construct software engineering tasks and corresponding test suites. These approaches face two key…

Software Engineering · Computer Science 2026-01-13 Yiqi Zhu , Apurva Gandhi , Graham Neubig

To integrate seamlessly into real-world software engineering, Code Agents must evolve from passive instruction followers into proactive collaborative partners. However, current evaluation paradigms predominantly reward "guessing" user…

Software Engineering · Computer Science 2026-03-03 Jialin Li , Yuan Wu , Yi Chang

Agentic vision-language models are increasingly trained to "think with images" by calling image operations. However, we show that high final-answer accuracy often hides unfaithful visual reasoning: models may invoke tools on irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinhai Hou , Shaoyuan Xu , Manan Biyani , Moyan Li , Jia Liu , Todd C. Hollon , Bryan Wang

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

Machine Learning · Statistics 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni
‹ Prev 1 2 3 10 Next ›