中文
相关论文

相关论文: Enhancing Control Policy Smoothness by Aligning Ac…

200 篇论文

Reinforcement learning (RL) has demonstrated impressive performance in decision-making tasks like embodied control, autonomous driving and financial trading. In many decision-making tasks, the agents often encounter the problem of executing…

机器学习 · 计算机科学 2024-07-23 Jing-Cheng Pang , Tian Xu , Shengyi Jiang , Yu-Ren Liu , Yang Yu

Reinforcement learning has long struggled with poor sample efficiency. One promising approach to mitigate this problem is leveraging group-invariant Markov Decision Processes ($G$-invariant MDPs). Existing works in this direction have…

机器学习 · 计算机科学 2026-05-25 Shuai Zhen , Yifan Zhang , Yuling Wang , Yanhua Yu

In current model-free reinforcement learning (RL) algorithms, stability criteria based on sampling methods are commonly utilized to guide policy optimization. However, these criteria only guarantee the infinite-time convergence of the…

机器人学 · 计算机科学 2023-10-16 Shengjie Wang , Fengbo Lan , Xiang Zheng , Yuxue Cao , Oluwatosin Oseni , Haotian Xu , Tao Zhang , Yang Gao

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

机器学习 · 计算机科学 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

机器学习 · 计算机科学 2025-01-31 Se-Wook Yoo , Seung-Woo Seo

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

机器学习 · 计算机科学 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

Prioritized Experience Replay (PER) enables the model to learn more about relatively important samples by artificially changing their accessed frequencies. However, this non-uniform sampling method shifts the state-action distribution that…

机器学习 · 计算机科学 2023-11-27 Zhuoying Chen , Huiping Li , Zhaoxu Wang

Sampling-based motion planners have experienced much success due to their ability to efficiently and evenly explore the state space. However, for many tasks, it may be more efficient to not uniformly explore the state space, especially when…

机器人学 · 计算机科学 2018-06-07 Clark Zhang , Jinwook Huh , Daniel D. Lee

We propose a method for tackling catastrophic forgetting in deep reinforcement learning that is \textit{agnostic} to the timescale of changes in the distribution of experiences, does not require knowledge of task boundaries, and can adapt…

机器学习 · 计算机科学 2019-06-18 Christos Kaplanis , Murray Shanahan , Claudia Clopath

This paper introduces a new biologically-inspired training method named Continual Learning through Adjustment Suppression and Sparsity Promotion (CLASSP). CLASSP is based on two main principles observed in neuroscience, particularly in the…

神经与进化计算 · 计算机科学 2024-06-11 Oswaldo Ludwig

Existing Temporal Action Detection (TAD) methods typically take a pre-processing step in converting an input varying-length video into a fixed-length snippet representation sequence, before temporal boundary estimation and action…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Sauradip Nag , Xiatian Zhu , Yi-Zhe Song , Tao Xiang

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

机器学习 · 计算机科学 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

机器人学 · 计算机科学 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

At the heart of reinforcement learning are actions -- decisions made in response to observations of the environment. Actions are equally fundamental in the modeling of stochastic processes, as they trigger discontinuous state transitions…

机器学习 · 统计学 2025-10-31 Ruimin He , Shaowei Lin

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

机器学习 · 计算机科学 2021-11-02 Michael McCabe , Jed Brown

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

机器学习 · 计算机科学 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

机器学习 · 计算机科学 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

This paper addresses the problem of safe autonomous navigation in unknown obstacle-filled environments using only local sensory information. We propose a smooth feedback controller derived from an unconstrained penalty-based formulation…

系统与控制 · 电气工程与系统科学 2025-11-14 Lyes Smaili , Soulaimane Berkane

Learning-based methods for dexterous manipulation have made notable progress in recent years. However, learned policies often still lack reliability and exhibit limited robustness to important factors of variation. One failure pattern that…

We aim to develop off-policy DRL algorithms that not only exceed state-of-the-art performance but are also simple and minimalistic. For standard continuous control benchmarks, Soft Actor-Critic (SAC), which employs entropy maximization,…

机器学习 · 计算机科学 2020-12-08 Che Wang , Yanqiu Wu , Quan Vuong , Keith Ross