English
Related papers

Related papers: CoVe: Training Interactive Tool-Use Agents via Con…

200 papers

While the advancement of large language models has spurred the development of AI agents to automate tasks, numerous use cases inherently require agents to collaborate with humans due to humans' latent preferences, domain expertise, or the…

Artificial Intelligence · Computer Science 2025-12-09 Yijia Shao , Vinay Samuel , Yucheng Jiang , John Yang , Diyi Yang

Reinforcement learning for LLM agents is typically conducted on a static data distribution, which fails to adapt to the agent's evolving behavior and leads to poor coverage of complex environment interactions. To address these challenges,…

Computation and Language · Computer Science 2026-04-20 Shidong Yang , Ziyu Ma , Tongwen Huang , Yiming Hu , Yong Wang , Xiangxiang Chu

Understanding and adhering to soft constraints is essential for safe and socially compliant autonomous driving. However, such constraints are often implicit, context-dependent, and difficult to specify explicitly. In this work, we present…

Robotics · Computer Science 2025-08-07 Longling Geng , Huangxing Li , Viktor Lado Naess , Mert Pilanci

Self-evolving agents should not train on examples they cannot justify. Data-free self-evolving search agents offer a scalable route to systems that generate their own questions, answer them, and improve from their own feedback without human…

Artificial Intelligence · Computer Science 2026-05-25 Yamato Arai , Yuma Ichikawa

Instruction-based editing holds vast potential due to its simple and efficient interactive editing format. However, instruction-based editing, particularly for video, has been constrained by limited training data, hindering its practical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Bin Xia , Jiyang Liu , Yuechen Zhang , Bohao Peng , Ruihang Chu , Yitong Wang , Xinglong Wu , Bei Yu , Jiaya Jia

High-quality structured data with rich annotations are critical components in intelligent vehicle systems dealing with road scenes. However, data curation and annotation require intensive investments and yield low-diversity scenarios. The…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Shubham Dokania , Anbumani Subramanian , Manmohan Chandraker , C. V. Jawahar

Variational Autoencoders (VAEs) have become increasingly popular and deployed in safety-critical applications. In such applications, we want to give certified probabilistic guarantees on performance under adversarial attacks. We propose a…

Machine Learning · Computer Science 2025-04-29 Changming Xu , Debangshu Banerjee , Deepak Vasisht , Gagandeep Singh

The optimization of quality of experience (QoE) in multi-user virtual reality (VR) interactions demands a delicate balance between ultra-low latency, high-fidelity motion synchronization, and equitable resource allocation. While adaptive…

Machine Learning · Computer Science 2025-06-26 Ziru Zhang , Jiadong Yu , Danny H. K. Tsang

In the realm of autonomous agents, ensuring safety and reliability in complex and dynamic environments remains a paramount challenge. Safe reinforcement learning addresses these concerns by introducing safety constraints, but still faces…

Robotics · Computer Science 2024-07-03 Hyeokjin Kwon , Gunmin Lee , Junseo Lee , Songhwai Oh

Anthropic proposes the concept of skills for LLM agents to tackle multi-step professional tasks that simple tool invocations cannot address. A tool is a single, self-contained function, whereas a skill is a structured bundle of…

Existing benchmarks for AI coding agents focus on isolated, single-issue tasks such as fixing a bug or adding a small feature. However, real-world software engineering is a long-horizon endeavor: developers interpret high-level…

Software Engineering · Computer Science 2026-05-25 Tue Le , Minh V. T. Thai , Dung Nguyen Manh , Huy Phan Nhat , Nghi D. Q. Bui

While most efforts to improve LLM-based tool-using agents focus on the agent itself - through larger models, better prompting, or fine-tuning - agent performance increasingly plateaus due to the quality of the tool interfaces these agents…

Artificial Intelligence · Computer Science 2026-04-30 Ruocheng Guo , Kaiwen Dong , Xiang Gao , Kamalika Das

Training reliable tool-augmented agents remains a significant challenge, largely due to the difficulty of credit assignment in multi-step reasoning. While process-level reward models offer a promising direction, existing LLM-based judges…

Artificial Intelligence · Computer Science 2026-04-28 Yuxuan Jiang , Francis Ferraro

Virtual Network Embedding (VNE) is a fundamental resource allocation challenge that is associated with hard and multifaceted constraints in network function virtualization (NFV). Existing works for VNE struggle to handle such complex…

Networking and Internet Architecture · Computer Science 2025-07-28 Tianfu Wang , Long Yang , Chao Wang , Chuan Qin , Liwei Deng , Wei Wu , Junyang Wang , Li Shen , Hui Xiong

Today, tool-calling agents are commonly evaluated or tested on static datasets of execution traces, including input commands, agent responses, and associated tool calls. However, internal production datasets are often insufficient or…

Computation and Language · Computer Science 2026-05-22 Shuaiqi Wang , Aadyaa Maddi , Zinan Lin , Giulia Fanti

Relational databases underpin critical infrastructure across a wide range of domains, yet the design of generalizable pre-training strategies for learning from relational databases remains an open challenge due to task heterogeneity.…

Machine Learning · Computer Science 2026-02-02 Quang Truong , Zhikai Chen , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Qualitative coding relies on a researcher's application of codes to textual data. As coding proceeds across large datasets, interpretations of codes often shift (temporal drift), reducing the credibility of the analysis. Existing…

Human-Computer Interaction · Computer Science 2026-04-22 Athikash Jeyaganthan , Kai Xu , Franziska Becker , Steffen Koch

Visual reinforcement learning (RL) suffers from poor sample efficiency due to high-dimensional observations in complex tasks. While existing works have shown that vision-language models (VLMs) can assist RL, they often focus on knowledge…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Canming Xia , Peixi Peng , Guang Tan , Zhan Su , Haoran Xu , Zhenxian Liu , Luntong Li

Building scalable vision-language models to learn from diverse, multimodal data remains an open challenge. In this paper, we introduce an Efficient Vision-languagE foundation model, namely EVE, which is one unified multimodal Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Junyi Chen , Longteng Guo , Jia Sun , Shuai Shao , Zehuan Yuan , Liang Lin , Dongyu Zhang

Iterative industrial design-simulation optimization is bottlenecked by the CAD-CAE semantic gap: translating simulation feedback into valid geometric edits under diverse, coupled constraints. To fill this gap, we propose COSMO-Agent…

Artificial Intelligence · Computer Science 2026-05-21 Liyuan Deng , Shujian Deng , Yongkang Chen , Yongkang Dai , Zhihang Zhong , Linyang Li , Xiao Sun , Yilei Shi , Huaxi Huang