English
Related papers

Related papers: Ace-Skill: Bootstrapping Multimodal Agents with Pr…

200 papers

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched…

Acquiring new knowledge without forgetting what has been learned in a sequence of tasks is the central focus of continual learning (CL). While tasks arrive sequentially, the training data are often prepared and annotated independently,…

Machine Learning · Computer Science 2024-01-31 Thuy-Trang Vu , Shahram Khadivi , Mahsa Ghorbanali , Dinh Phung , Gholamreza Haffari

Mixture-of-Experts (MoE) models promise efficient scaling of large language models (LLMs) by activating only a small subset of experts per token, but their parallelized inference pipelines make elastic serving challenging. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-06 Gursimran Singh , Timothy Yu , Haley Li , Cheng Chen , Hanieh Sadri , Qintao Zhang , Yu Zhang , Ying Xiong , Yong Zhang , Zhenan Fan

Current embodied intelligent systems still face a substantial gap between high-level reasoning and low-level physical execution in open-world environments. Although Vision-Language-Action (VLA) models provide strong perception and intuitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dongjie Huo , Haoyun Liu , Guoqing Liu , Dekang Qi , Zhiming Sun , Maoguo Gao , Jianxin He , Yandan Yang , Xinyuan Chang , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

The Entity Set Expansion (ESE) task aims to expand a handful of seed entities with new entities belonging to the same semantic class. Conventional ESE methods are based on mono-modality (i.e., literal modality), which struggle to deal with…

Computation and Language · Computer Science 2023-07-28 Yangning Li , Tingwei Lu , Yinghui Li , Tianyu Yu , Shulin Huang , Hai-Tao Zheng , Rui Zhang , Jun Yuan

In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as…

Machine Learning · Computer Science 2023-01-13 Tao Zhong , Zhixiang Chi , Li Gu , Yang Wang , Yuanhao Yu , Jin Tang

Edge-cloud synergies provide a promising paradigm for privacy-preserving deployment of foundation models, where lightweight on-device models adapt to domain-specific data and cloud-hosted models coordinate knowledge sharing. However, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Yuze Liu , Shibo Chu , Tiehua Zhang , Hao Zhou , Zhishu Shen , Jinze Wang , Jianzhong Qi , Feng Xia

While recent autonomous agents demonstrate impressive capabilities, they predominantly rely on manually scripted workflows and handcrafted heuristics, inherently limiting their potential for open-ended improvement. To address this, we…

Artificial Intelligence · Computer Science 2026-05-28 Ziyang Liu , Xinyan Guo , Xuchen Wei , Han Hao , Liu Yang

The cultivation of expertise for large language models (LLMs) to solve tasks of specific areas often requires special-purpose tuning with calibrated behaviors on the expected stable outputs. To avoid huge cost brought by manual preparation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuncheng Yang , Yulei Qin , Tong Wu , Zihan Xu , Gang Li , Pengcheng Guo , Hang Shao , Yuchen Shi , Ke Li , Xing Sun , Jie Yang , Yun Gu

Learning natural and diverse behaviors from human motion datasets remains challenging in physics-based character control. Existing conditional adversarial models often suffer from tight and biased embedding distributions where embeddings…

Graphics · Computer Science 2024-11-12 Nian Liu , Libin Liu , Zilong Zhang , Zi Wang , Hongzhao Xie , Tengyu Liu , Xinyi Tong , Yaodong Yang , Zhaofeng He

The long-term goal of machine learning is to learn general visual representations from a small amount of data without supervision, mimicking three advantages of human cognition: i) no need for labels, ii) robustness to data scarcity, and…

Machine Learning · Computer Science 2023-08-29 Jingyao Wang , Zeen Song , Wenwen Qiang , Changwen Zheng

Current context augmentation methods, such as retrieval-augmented generation, are essential for solving knowledge-intensive reasoning tasks. However, they typically adhere to a rigid, brute-force strategy that executes retrieval at every…

Computation and Language · Computer Science 2026-01-15 Rubing Chen , Jian Wang , Wenjie Li , Xiao-Yong Wei , Qing Li

Conventional agent systems often struggle in open-ended environments where task distributions continuously drift and external supervision is scarce. Their reliance on static toolsets or offline training lags behind these dynamics, leaving…

Artificial Intelligence · Computer Science 2026-02-09 Haotian Li , Shijun Yang , Weizhen Qi , Silei Zhao , Rui Hua , Mingzhu Song , Xiaojian Yang , Chao Peng

We propose BOSS, an approach that automatically learns to solve new long-horizon, complex, and meaningful tasks by growing a learned skill library with minimal supervision. Prior work in reinforcement learning require expert supervision, in…

Robotics · Computer Science 2023-10-18 Jesse Zhang , Jiahui Zhang , Karl Pertsch , Ziyi Liu , Xiang Ren , Minsuk Chang , Shao-Hua Sun , Joseph J. Lim

Reinforcement learning for LLM agents is typically conducted on a static data distribution, which fails to adapt to the agent's evolving behavior and leads to poor coverage of complex environment interactions. To address these challenges,…

Computation and Language · Computer Science 2026-04-20 Shidong Yang , Ziyu Ma , Tongwen Huang , Yiming Hu , Yong Wang , Xiangxiang Chu

Multi-agent reinforcement learning (MARL) suffers from the non-stationarity problem, which is the ever-changing targets at every iteration when multiple agents update their policies at the same time. Starting from first principle, in this…

Machine Learning · Computer Science 2022-12-05 Chuming Li , Jie Liu , Yinmin Zhang , Yuhong Wei , Yazhe Niu , Yaodong Yang , Yu Liu , Wanli Ouyang

Incremental multi-view clustering aims to achieve stable clustering results while addressing the stability-plasticity dilemma (SPD) in view-incremental scenarios. The core challenge is that the model must have enough plasticity to quickly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zisen Kong , Bo Zhong , Pengyuan Li , Dongxia Chang , Yiming Wang , Yongyong Chen

Fine-tuning large pre-trained language models with Evol-Instruct has achieved encouraging results across a wide range of tasks. However, designing effective evolving methods for instruction evolution requires substantial human expertise.…

Computation and Language · Computer Science 2024-06-04 Weihao Zeng , Can Xu , Yingxiu Zhao , Jian-Guang Lou , Weizhu Chen

Large language model (LLM) agent systems are increasingly expected to improve after deployment, but existing work often decouples two adaptation targets: skill evolution and multi-agent system (MAS) restructuring. This separation can create…

Multiagent Systems · Computer Science 2026-05-19 Shuai Pan , Yixiang Liu , Jiaye Gao , Te Gao , Weiwen Liu , Jianghao Lin , Zhihui Fu , Jun Wang , Weinan Zhang , Yong Yu

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun