中文
相关论文

相关论文: Model-Free Episodic Control with State Aggregation

200 篇论文

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

系统与控制 · 电气工程与系统科学 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Learning from data of past tasks can substantially improve the accuracy of mechatronic systems. Often, for fast and safe learning a model of the system is required. The aim of this paper is to develop a model-free approach for fast and safe…

系统与控制 · 电气工程与系统科学 2020-07-06 Maurice Poot , Jim Portegies , Tom Oomen

Diffusion models, known for their tremendous ability to generate novel and high-quality samples, have recently raised concerns due to their data memorization behavior, which poses privacy risks. Recent approaches for memory mitigation…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Xiao Liu , Xiaoliu Guan , Yu Wu , Jiaxu Miao

Both the human brain and artificial learning agents operating in real-world or comparably complex environments are faced with the challenge of online model selection. In principle this challenge can be overcome: hierarchical Bayesian…

机器学习 · 计算机科学 2017-12-05 David G. Nagy , Gergő Orbán

In this paper, we propose an adaptive event-triggered reinforcement learning control for continuous-time nonlinear systems, subject to bounded uncertainties, characterized by complex interactions. Specifically, the proposed method is…

机器学习 · 计算机科学 2024-10-01 Umer Siddique , Abhinav Sinha , Yongcan Cao

Episodic training is a mainstream training strategy for few-shot learning. In few-shot scenarios, however, this strategy is often inferior to some non-episodic training strategy, e. g., Neighbourhood Component Analysis (NCA), which…

机器学习 · 计算机科学 2024-02-02 Tao Zhang

In this work, we present compelling evidence that controlling model capacity during fine-tuning can effectively mitigate memorization in diffusion models. Specifically, we demonstrate that adopting Parameter-Efficient Fine-Tuning (PEFT)…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Raman Dutt , Pedro Sanchez , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Reinforcement learning holds tremendous promise in accelerator controls. The primary goal of this paper is to show how this approach can be utilised on an operational level on accelerator physics problems. Despite the success of model-free…

机器学习 · 计算机科学 2022-01-27 Simon Hirlaender , Niky Bruchon

Multi-agent reinforcement learning (MARL) algorithms have made promising progress in recent years by leveraging the centralized training and decentralized execution (CTDE) paradigm. However, existing MARL algorithms still suffer from the…

机器学习 · 计算机科学 2021-10-20 Xiao Ma , Wu-Jun Li

The sample-inefficiency problem in Artificial Intelligence refers to the inability of current Deep Reinforcement Learning models to optimize action policies within a small number of episodes. Recent studies have tried to overcome this…

人工智能 · 计算机科学 2020-12-29 Ismael T. Freire , Adrián F. Amil , Vasiliki Vouloutsi , Paul F. M. J. Verschure

Model-free algorithms are brought into the control system's research with the emergence of reinforcement learning algorithms. However, there are two practical challenges of reinforcement learning-based methods. First, learning by…

系统与控制 · 电气工程与系统科学 2024-09-18 Mi Zhou , Erik Verriest , Chaouki Abdallah

Machine learning, artificial intelligence and especially deep learning based approaches are often used to simplify or eliminate the burden of programming industrial robots. Using these approaches robots inherently learn a skill instead of…

机器人学 · 计算机科学 2021-04-22 Sanaz Behbahani , Siddharth Chhatpar , Said Zahrai , Vishakh Duggal , Mohak Sukhwani

Existing Deep Reinforcement Learning (DRL) algorithms suffer from sample inefficiency. Generally, episodic control-based approaches are solutions that leverage highly-rewarded past experiences to improve sample efficiency of DRL algorithms.…

机器学习 · 计算机科学 2023-02-21 Zhuo Li , Derui Zhu , Yujing Hu , Xiaofei Xie , Lei Ma , Yan Zheng , Yan Song , Yingfeng Chen , Jianjun Zhao

Many tasks require flexibly modifying perception and behavior based on current goals. Humans can retrieve episodic memories from days to years ago, using them to contextualize and generalize behaviors across novel but structurally related…

神经与进化计算 · 计算机科学 2025-12-22 Yicong Zheng , Nora Wolf , Charan Ranganath , Randall C. O'Reilly , Kevin L. McKee

A fundamental challenge in continual learning is to balance the trade-off between learning new tasks and remembering the previously acquired knowledge. Gradient Episodic Memory (GEM) achieves this balance by utilizing a subset of past…

机器学习 · 计算机科学 2024-10-02 Bo Liu , Mao Ye , Peter Stone , Qiang Liu

Model-based reinforcement learning (MBRL) and model-free reinforcement learning (MFRL) evolve along distinct paths but converge in the design of Dyna-Q [1]. However, modern RL methods still struggle with effective transferability across…

机器学习 · 计算机科学 2025-12-18 Quanxi Zhou , Wencan Mao , Manabu Tsukada , John C. S. Lui , Yusheng Ji

Aggregators have emerged as crucial tools for the coordination of distributed, controllable loads. To be used effectively, an aggregator must be able to communicate the available flexibility of the loads they control, as known as the…

最优化与控制 · 数学 2022-06-01 Tongxin Li , Bo Sun , Yue Chen , Zixin Ye , Steven H. Low , Adam Wierman

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in…

机器学习 · 计算机科学 2019-03-05 Zhizheng Zhang , Jiale Chen , Zhibo Chen , Weiping Li

In control applications there is often a compromise that needs to be made with regards to the complexity and performance of the controller and the computational resources that are available. For instance, the typical hardware platform in…

系统与控制 · 电气工程与系统科学 2020-11-30 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

系统与控制 · 电气工程与系统科学 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar