中文
相关论文

相关论文: State-Action Inpainting Diffuser for Continuous Co…

200 篇论文

Standard discrete diffusion models treat all unobserved states identically by mapping them to an absorbing [MASK] token. This creates an 'information void' where semantic information that could be inferred from unmasked tokens is lost…

Conditional diffusion models can create unseen images in various settings, aiding image interpolation. Interpolation in latent spaces is well-studied, but interpolation with specific conditions like text or poses is less understood. Simple…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Qiyuan He , Jinghao Wang , Ziwei Liu , Angela Yao

This article proposes a novel approach to traffic signal control that combines phase re-service with reinforcement learning (RL). The RL agent directly determines the duration of the next phase in a pre-defined sequence. Before the RL…

系统与控制 · 电气工程与系统科学 2024-08-05 Zhiyao Zhang , George Gunter , Marcos Quinones-Grueiro , Yuhang Zhang , William Barbour , Gautam Biswas , Daniel Work

We propose a novel offline reinforcement learning (offline RL) approach, introducing the Diffusion-model-guided Implicit Q-learning with Adaptive Revaluation (DIAR) framework. We address two key challenges in offline RL: out-of-distribution…

机器学习 · 计算机科学 2024-10-16 Jaehyun Park , Yunho Kim , Sejin Kim , Byung-Jun Lee , Sundong Kim

Delays are inherent to most dynamical systems. Besides shifting the process in time, they can significantly affect their performance. For this reason, it is usually valuable to study the delay and account for it. Because they are dynamical…

机器学习 · 计算机科学 2023-09-21 Pierre Liotet

Spiking Neural Networks (SNNs) are widely regarded as an energy-efficient paradigm for modeling and processing temporal and event-driven information. Incorporating delays in SNNs has been proven to be an effective mechanism for improving…

机器学习 · 计算机科学 2026-05-08 Dewei Bai , Hongxiang Peng , Yunyun Zeng , Ziyu Zhang , Hong Qu

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

机器学习 · 计算机科学 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

World models have recently gained prominence for action-conditioned visual prediction in complex environments. However, relying on only a few recent observations causes them to lose long-term context. Consequently, within a few steps, the…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Nedko Savov , Naser Kazemi , Deheng Zhang , Danda Pani Paudel , Xi Wang , Luc Van Gool

For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazards. While existing…

机器学习 · 计算机科学 2022-03-09 Vincent Lim , Ellen Novoseller , Jeffrey Ichnowski , Huang Huang , Ken Goldberg

Modern deep reinforcement learning (DRL) methods have made significant advances in handling continuous action spaces. However, real-world control systems, especially those requiring precise and reliable performance, often demand…

机器学习 · 计算机科学 2026-04-10 Xuyang Li , Romit Maulik

We study reinforcement learning (RL) in settings where observations are high-dimensional, but where an RL agent has access to abstract knowledge about the structure of the state space, as is the case, for example, when a robot is tasked to…

机器学习 · 计算机科学 2022-05-31 Yao Liu , Dipendra Misra , Miro Dudík , Robert E. Schapire

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

系统与控制 · 计算机科学 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger

Aligning diffusion models with human preferences remains challenging, particularly when reward models are unavailable or impractical to obtain, and collecting large-scale preference datasets is prohibitively expensive. \textit{This raises a…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Xiaoxuan He , Siming Fu , Wanli Li , Zhiyuan Li , Dacheng Yin , Kang Rong , Fengyun Rao , Bo Zhang

Diffusion Policy (DP) enables robots to learn complex behaviors by imitating expert demonstrations through action diffusion. However, in practical applications, hardware limitations often degrade data quality, while real-time constraints…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jiahua Ma , Yiran Qin , Yixiong Li , Xuanqi Liao , Yulan Guo , Ruimao Zhang

This paper introduces a continuous-time constrained nonlinear control scheme which implements a model predictive control strategy as a continuous-time dynamic system. The approach is based on the idea that the solution of the optimal…

系统与控制 · 计算机科学 2017-09-20 Marco M. Nicotra , Dominic Liao-McPherson , Ilya V. Kolmanovsky

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

机器学习 · 计算机科学 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

This paper employs a policy iteration reinforcement learning (RL) method to study continuous-time linear-quadratic mean-field control problems in infinite horizon. The drift and diffusion terms in the dynamics involve the states, the…

最优化与控制 · 数学 2024-11-05 Na Li , Xun Li , Zuo Quan Xu

Delays frequently occur in real-world environments, yet standard reinforcement learning (RL) algorithms often assume instantaneous perception of the environment. We study random sensor delays in POMDPs, where observations may arrive…

机器学习 · 计算机科学 2026-04-17 Armin Karamzade , Kyungmin Kim , JB Lanier , Davide Corsi , Roy Fox

Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration…