English
Related papers

Related papers: Uni-Skill: Building Self-Evolving Skill Repository…

200 papers

Learning natural and diverse behaviors from human motion datasets remains challenging in physics-based character control. Existing conditional adversarial models often suffer from tight and biased embedding distributions where embeddings…

Graphics · Computer Science 2024-11-12 Nian Liu , Libin Liu , Zilong Zhang , Zi Wang , Hongzhao Xie , Tengyu Liu , Xinyi Tong , Yaodong Yang , Zhaofeng He

We introduce Skills-Coach, a novel automated framework designed to significantly enhance the self-evolution of skills within Large Language Model (LLM)-based agents. Addressing the current fragmentation of the skill ecosystem, Skills-Coach…

Computation and Language · Computer Science 2026-05-01 Yu Tian , Jiawei Chen , Lifan Zheng , Mingxiang Tao , Xinyi Zeng , Zhaoxia Yin , Hang Su , Xian Sun

Tool-use capability is a fundamental component of LLM agents, enabling them to interact with external systems through structured function calls. However, existing research exhibits inconsistent interaction representations, largely overlooks…

Artificial Intelligence · Computer Science 2026-05-26 Yijuan Liang , Xinghao Chen , Yifan Ge , Ziyi Wu , Hao Wu , Changyu Zeng , Wei Xing , Xiaoyu Shen

In recent years, a variety of powerful LLM-based agentic systems have been applied to automate complex tasks through task orchestration. However, existing orchestration methods still face key challenges, including strategy collapse under…

Artificial Intelligence · Computer Science 2026-05-15 Mingda Zhang , Tiesunlong Shen , Haoran Luo , Wenjin Liu , Zikai Xiao , Erik Cambria , Xiaoying Tang

Embodied vision-based real-world systems, such as mobile robots, require a careful balance between energy consumption, compute latency, and safety constraints to optimize operation across dynamic tasks and contexts. As local computation…

With the powerful reasoning capabilities of large language models (LLMs) and vision-language models (VLMs), many recent works have explored using them for decision-making. However, most of these approaches rely solely on language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihao Sun , Zhilong Zhang , Yang Yu , Pierre-Luc Bacon

Self-evolving agents present a promising path toward continual adaptation by distilling task interactions into reusable knowledge artifacts. In practice, this paradigm remains hindered by two coupled bottlenecks: data inefficiency, where…

Artificial Intelligence · Computer Science 2026-05-12 Feng Xiong , Zengbin Wang , Yong Wang , Xuecai Hu , Jinghan He , Liang Lin , Yuan Liu , Xiangxiang Chu

Federated Learning (FL) has become a practical and widely adopted distributed learning paradigm. However, the lack of a comprehensive and standardized solution covering diverse use cases makes it challenging to use in practice. In addition,…

Machine Learning · Computer Science 2024-01-02 Xiaoyuan Liu , Tianneng Shi , Chulin Xie , Qinbin Li , Kangping Hu , Haoyu Kim , Xiaojun Xu , The-Anh Vu-Le , Zhen Huang , Arash Nourian , Bo Li , Dawn Song

Robots are more capable of achieving manipulation tasks for everyday activities than before. But the safety of manipulation skills that robots employ is still an open problem. Considering all possible failures during skill learning…

Robotics · Computer Science 2023-05-05 Abdullah Cihan Ak , Eren Erdal Aksoy , Sanem Sariel

Agentic large language models often rely on skills, reusable natural language procedures that guide planning, action, and tool use. In practice, skills are typically improved through prompt engineering or by aligning the task LLM itself,…

Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single…

Computation and Language · Computer Science 2024-04-04 Siddhant Arora , Hayato Futami , Jee-weon Jung , Yifan Peng , Roshan Sharma , Yosuke Kashiwagi , Emiru Tsunoo , Karen Livescu , Shinji Watanabe

A novel skill learning approach is proposed that allows a robot to acquire human-like visuospatial skills for object manipulation tasks. Visuospatial skills are attained by observing spatial relationships among objects through…

Robotics · Computer Science 2017-06-06 S. Reza Ahmadzadeh , Fulvio Mastrogiovanni , Petar Kormushev

Financial institutions and regulators require systems that integrate heterogeneous data to assess risks from stock fluctuations to systemic vulnerabilities. Existing approaches often treat these tasks in isolation, failing to capture…

Machine Learning · Computer Science 2026-01-07 Gongao Zhang , Haijiang Zeng , Lu Jiang

Existing robot policies predominantly adopt the task-centric approach, requiring end-to-end task data collection. This results in limited generalization to new tasks and difficulties in pinpointing errors within long-horizon, multi-stage…

Skill-based programming of robots provides a flexible approach for automation. Existing solutions neglect the optimization of motion sequences, leading to inefficiencies in execution. This work introduces a planning method that enhances…

Robotics · Computer Science 2026-03-03 Andreas Gaugenrieder , Hari Hara Balasubramaniam , Jannik Möhrle , Rüdiger Daub

Modern scientific ecosystems are rich in procedural knowledge across repositories, APIs, scripts, notebooks, documentation, databases, and papers, yet much of this knowledge remains fragmented across heterogeneous artifacts that agents…

Artificial Intelligence · Computer Science 2026-04-07 Shuaike Shen , Wenduo Cheng , Mingqian Ma , Alistair Turcan , Martin Jinye Zhang , Jian Ma

Embodied intelligence has witnessed remarkable progress in recent years, driven by advances in computer vision, natural language processing, and the rise of large-scale multimodal models. Among its core challenges, robot manipulation stands…

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo

Recent advancements in vision-language pre-training via contrastive learning have significantly improved performance across computer vision tasks. However, in the medical domain, obtaining multimodal data is often costly and challenging due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Ameera Bawazir , Kebin Wu , Wenbin Li

Embodied manipulation is a fundamental ability in the realm of embodied artificial intelligence. Although current embodied manipulation models show certain generalizations in specific settings, they struggle in new environments and tasks…