English
Related papers

Related papers: SkillFlow: Flow-Driven Recursive Skill Evolution f…

200 papers

Spatial understanding is a critical aspect of most robotic tasks, particularly when generalization is important. Despite the impressive results of deep generative models in complex manipulation tasks, the absence of a representation that…

Robotics · Computer Science 2024-09-10 Niklas Funk , Julen Urain , Joao Carvalho , Vignesh Prasad , Georgia Chalvatzaki , Jan Peters

Recent progress in flow-based generative models and reinforcement learning (RL) has improved text-image alignment and visual quality. However, current RL training for flow models still has two main problems: (i) GRPO-style fixed per-prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kaijie Chen , Zhiyang Xu , Ying Shen , Zihao Lin , Yuguang Yao , Lifu Huang

Real-world trip planning requires transforming open-ended user requests into executable itineraries under strict spatial, temporal, and budgetary constraints while aligning with user preferences. Existing LLM-based agents struggle with…

Artificial Intelligence · Computer Science 2025-12-15 Yuxing Chen , Basem Suleiman , Qifan Chen

Recent advances in large language models (LLMs) have sparked growing interest in building generalist agents that can learn through online interactions. However, applying reinforcement learning (RL) to train LLM agents in multi-turn,…

Artificial Intelligence · Computer Science 2025-10-07 Hanchen Zhang , Xiao Liu , Bowen Lv , Xueqiao Sun , Bohao Jing , Iat Long Iong , Zhenyu Hou , Zehan Qi , Hanyu Lai , Yifan Xu , Rui Lu , Hongning Wang , Jie Tang , Yuxiao Dong

Modern AI systems increasingly rely on workflows composed of multiple interacting agents, some powered by large language models (LLMs) and others by conventional computational modules. This paper analyzes the fundamental tradeoffs between…

Artificial Intelligence · Computer Science 2026-05-26 Ya-Ting Yang , Quanyan Zhu

Large language models (LLMs) have recently been used for sequential decision making in interactive environments. However, leveraging environment reward signals for continual LLM actor improvement is not straightforward. We propose Skill Set…

Machine Learning · Computer Science 2024-06-25 Kolby Nottingham , Bodhisattwa Prasad Majumder , Bhavana Dalvi Mishra , Sameer Singh , Peter Clark , Roy Fox

Video generation models trained on heterogeneous data with likelihood-surrogate objectives can produce visually plausible rollouts that violate physical constraints in embodied manipulation. Although reinforcement-learning post-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhenyang Ni , Yijiang Li , Ruochen Jiao , Simon Sinong Zhan , Sipeng Chen , Zhenfei Yin , Minshuo Chen , Philip Torr , Zhaoran Wang , Qi Zhu

Multi-agent systems provide a powerful way to extend large language models (LLMs) by decomposing a complex task into specialized subtasks handled by different agents. However, their performance is often hindered by error propagation,…

Machine Learning · Computer Science 2026-05-14 Zheng Wang , Yuang Liu , Yangkai Ding

Reinforcement learning (RL) has become a pivotal technology in the post-training phase of large language models (LLMs). Traditional task-colocated RL frameworks suffer from significant scalability bottlenecks, while task-separated RL…

Agentic AI enables LLM to dynamically reason, plan, and interact with tools to solve complex tasks. However, agentic workflows often require many iterative reasoning steps and tool invocations, leading to significant operational expense,…

Artificial Intelligence · Computer Science 2026-02-03 Sami Abuzakuk , Anne-Marie Kermarrec , Rishi Sharma , Rasmus Moorits Veski , Martijn de Vos

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

Machine Learning · Computer Science 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi

With the rapid evolution of Large Language Model (LLM) agent ecosystems, centralized skill marketplaces have emerged as pivotal infrastructure for augmenting agent capabilities. However, these marketplaces face unprecedented security…

Cryptography and Security · Computer Science 2026-03-24 Zihan Guo , Zhiyu Chen , Xiaohang Nie , Jianghao Lin , Yuanjian Zhou , Weinan Zhang

The transition from monolithic language models to modular, skill-equipped agents marks a defining shift in how large language models (LLMs) are deployed in practice. Rather than encoding all procedural knowledge within model weights, agent…

Multiagent Systems · Computer Science 2026-02-18 Renjun Xu , Yang Yan

LLM-based agent systems increasingly rely on agent skills sourced from open registries to extend their capabilities, yet the openness of such ecosystems makes skills difficult to thoroughly vet. Existing attacks rely on injecting malicious…

Cryptography and Security · Computer Science 2026-04-08 Zenghao Duan , Yuxin Tian , Zhiyi Yin , Liang Pang , Jingcheng Deng , Zihao Wei , Shicheng Xu , Yuyao Ge , Xueqi Cheng

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement…

Computation and Language · Computer Science 2025-03-26 Haoqiang Kang , Enna Sachdeva , Piyush Gupta , Sangjae Bae , Kwonjoon Lee

We present an agentic flow consisting of multiple agents that combine specialized LLMs and hardware simulation tools to collaboratively complete the complex task of Register Transfer Level (RTL) generation without human intervention. A key…

Software Engineering · Computer Science 2025-11-07 Athma Narayanan , Mahesh Subedar , Omesh Tickoo

Large language model (LLM) agent systems are increasingly expected to improve after deployment, but existing work often decouples two adaptation targets: skill evolution and multi-agent system (MAS) restructuring. This separation can create…

Multiagent Systems · Computer Science 2026-05-19 Shuai Pan , Yixiang Liu , Jiaye Gao , Te Gao , Weiwen Liu , Jianghao Lin , Zhihui Fu , Jun Wang , Weinan Zhang , Yong Yu

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Modern software systems require code that is not only functional but also maintainable and well-structured. Although Large Language Models (LLMs) are increasingly used to automate software development, most studies focus on isolated,…

Software Engineering · Computer Science 2025-11-14 Wasique Islam Shafin , Md Nakhla Rafi , Zhenhao Li , Tse-Hsun Chen

Equipping Large Language Model (LLM) agents with domain-specific skills is critical for tackling complex tasks. Yet, manual authoring creates a severe scalability bottleneck. Conversely, automated skill generation often yields fragile or…

Artificial Intelligence · Computer Science 2026-04-28 Jingwei Ni , Yihao Liu , Xinpeng Liu , Yutao Sun , Mengyu Zhou , Pengyu Cheng , Dexin Wang , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang