English
Related papers

Related papers: Strategy Discovery and Mixture in Lifelong Learnin…

200 papers

Recent advancements in reinforcement learning (RL) have led to remarkable achievements in robot locomotion capabilities. However, the complexity and ``black-box'' nature of neural network-based RL policies hinder their interpretability and…

Robotics · Computer Science 2024-03-22 Fernando Acero , Zhibin Li

Policy distillation, which transfers a teacher policy to a student policy has achieved great success in challenging tasks of deep reinforcement learning. This teacher-student framework requires a well-trained teacher model which is…

Machine Learning · Computer Science 2020-06-09 Kwei-Herng Lai , Daochen Zha , Yuening Li , Xia Hu

Advances in robot learning have enabled robots to generate skills for a variety of tasks. Yet, robot learning is typically sample inefficient, struggles to learn from data sources exhibiting varied behaviors, and does not naturally…

The robotic handling of compliant and deformable food raw materials, characterized by high biological variation, complex geometrical 3D shapes, and mechanical structures and texture, is currently in huge demand in the ocean space,…

Deep reinforcement learning (DRL) is a booming area of artificial intelligence. Many practical applications of DRL naturally involve more than one collaborative learners, making it important to study DRL in a multi-agent context. Previous…

Machine Learning · Computer Science 2019-10-22 Gang Chen

Although the diffusion model has achieved remarkable performance in the field of image generation, its high inference delay hinders its wide application in edge devices with scarce computing resources. Therefore, many training-free sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weilun Feng , Chuanguang Yang , Zhulin An , Libo Huang , Boyu Diao , Fei Wang , Yongjun Xu

In recent years, pre-trained multimodal large models have attracted widespread attention due to their outstanding performance in various multimodal applications. Nonetheless, the extensive computational resources and vast datasets required…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhengyang Liang , Meiyu Liang , Wei Huang , Yawen Li , Zhe Xue

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In this paper, we focus on label distribution skew in federated…

Machine Learning · Computer Science 2024-09-23 Jianghu Lu , Shikun Li , Kexin Bao , Pengju Wang , Zhenxing Qian , Shiming Ge

In recent years, Evolutionary Strategies were actively explored in robotic tasks for policy search as they provide a simpler alternative to reinforcement learning algorithms. However, this class of algorithms is often claimed to be…

Robotics · Computer Science 2021-11-10 Vladislav Kurenkov , Bulat Maksudov

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Probability distributions are key components of many learning from demonstration (LfD) approaches. While the configuration of a manipulator is defined by its joint angles, poses are often best explained within several task spaces. In many…

Robotics · Computer Science 2020-10-08 Emmanuel Pignat , João Silvério , Sylvain Calinon

The generalization ability of most meta-reinforcement learning (meta-RL) methods is largely limited to test tasks that are sampled from the same distribution used to sample training tasks. To overcome the limitation, we propose Latent…

Machine Learning · Computer Science 2022-01-19 Suyoung Lee , Sae-Young Chung

Knowledge distillation (KD) is an effective model compression technique where a compact student network is taught to mimic the behavior of a complex and highly trained teacher network. In contrast, Mutual Learning (ML) provides an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Usma Niyaz , Deepti R. Bathula

Masked diffusion large language models (dLLMs) are a promising alternative to autoregressive generation. While reinforcement learning (RL) methods have recently been adapted to dLLM fine-tuning, their objectives typically depend on…

Machine Learning · Computer Science 2026-05-20 Yuyuan Chen , Shiyi Wang , Peter Potaptchik , Jaeyeon Kim , Michael S. Albergo

We study the problem of unsupervised skill discovery, whose goal is to learn a set of diverse and useful skills with no external reward. There have been a number of skill discovery methods based on maximizing the mutual information (MI)…

Machine Learning · Computer Science 2022-02-09 Seohong Park , Jongwook Choi , Jaekyeom Kim , Honglak Lee , Gunhee Kim

Reinforcement learning from human feedback (RLHF) has evolved to be one of the main methods for fine-tuning large language models (LLMs). However, existing RLHF methods are non-robust, and their performance deteriorates if the downstream…

Machine Learning · Computer Science 2025-03-04 Debmalya Mandal , Paulius Sasnauskas , Goran Radanovic

Knowledge Distillation (KD) is a fundamental technique for compressing large language models (LLMs) into compact, efficient student models. However, existing white-box KD methods mainly focus on balancing ground truth and student-generated…

Computation and Language · Computer Science 2025-08-11 Lingyuan Liu , Mengxiang Zhang

Federated fine-tuning of Large Language Models faces severe statistical heterogeneity. However, existing model-level defenses often overlook the root cause: intrinsic data distribution mismatches. In this work, we first establish Federated…

Machine Learning · Computer Science 2026-05-19 Ziheng Ren , Zhanming Shen , Hao Wang , Ning Liu , You Song

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Machine learning force field (MLFF) has emerged as a powerful data-driven tool for atomistic simulations, enabling large-scale and complex atomic systems to be simulated with accuracy comparable to \textit{ab initio} methods. However, MLFFs…

Chemical Physics · Physics 2026-04-06 Ruiyang Chen , Qingyuan Zhang , Ji Chen