English
Related papers

Related papers: State Representation Learning for Control: An Over…

200 papers

Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their…

Artificial Intelligence · Computer Science 2024-09-10 Jasmina Gajcin , Jovan Jeromela , Ivana Dusparic

Agents that are aware of the separation between themselves and their environments can leverage this understanding to form effective representations of visual input. We propose an approach for learning such structured representations for RL…

Machine Learning · Computer Science 2023-09-06 Kevin Gmelin , Shikhar Bahl , Russell Mendonca , Deepak Pathak

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

State representation learning, or the ability to capture latent generative factors of an environment, is crucial for building intelligent agents that can perform a wide variety of tasks. Learning such representations without supervision…

Machine Learning · Computer Science 2020-11-09 Ankesh Anand , Evan Racah , Sherjil Ozair , Yoshua Bengio , Marc-Alexandre Côté , R Devon Hjelm

Reinforcement learning (RL) in recommendation systems offers the potential to optimize recommendations for long-term user engagement. However, the environment often involves large state and action spaces, which makes it hard to efficiently…

Information Retrieval · Computer Science 2023-09-20 Yijia Dai , Wen Sun

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

For a robotic grasping task in which diverse unseen target objects exist in a cluttered environment, some deep learning-based methods have achieved state-of-the-art results using visual input directly. In contrast, actor-critic deep…

Machine Learning · Computer Science 2020-02-28 Taewon Kim , Yeseong Park , Youngbin Park , Il Hong Suh

The recent mainstream reinforcement learning control for quadruped robots often relies on privileged information, demanding meticulous selection and precise estimation, thereby imposing constraints on the development process. This work…

Robotics · Computer Science 2024-10-22 Shiyi Chen , Zeyu Wan , Shiyang Yan , Chun Zhang , Weiyi Zhang , Qiang Li , Debing Zhang , Fasih Ud Din Farrukh

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learning is limited to sparse coding where extracting…

Machine Learning · Computer Science 2018-11-19 Vincent Liu , Raksha Kumaraswamy , Lei Le , Martha White

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

Machine Learning · Computer Science 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

In reinforcement learning-based (RL-based) traffic signal control (TSC), decisions on the signal timing are made based on the available information on vehicles at a road intersection. This forms the state representation for the RL…

Systems and Control · Electrical Eng. & Systems 2024-11-13 Lawrence Francis , Blessed Guda , Ahmed Biyabani

Unsupervised machine learning models build an internal representation of their training data without the need for explicit human guidance or feature engineering. This learned representation provides insights into which features of the data…

Quantum Physics · Physics 2024-01-09 Felix Frohnert , Evert van Nieuwenburg

While reinforcement learning (RL) methods that learn an internal model of the environment have the potential to be more sample efficient than their model-free counterparts, learning to model raw observations from high dimensional sensors…

Machine Learning · Computer Science 2023-06-27 Raj Ghugare , Homanga Bharadhwaj , Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

One significant simplification in most previous work on robot learning is the closed-world assumption where the robot is assumed to know ahead of time a complete set of predicates describing the state of the physical world. However, robots…

Artificial Intelligence · Computer Science 2017-10-10 Qiaozi Gao , Lanbo She , Joyce Y. Chai

Learning latent representations from complex data is central to modern machine learning, spanning temporal, multimodal, and partially observed systems. In such settings, representations are better understood as latent states capturing…

Machine Learning · Computer Science 2026-05-18 Gwenolé Quellec

In this paper, we propose a fast reinforcement learning (RL) control algorithm that enables online control of large-scale networked dynamic systems. RL is an effective way of designing model-free linear quadratic regulator (LQR) controllers…

Systems and Control · Electrical Eng. & Systems 2020-09-16 Tomonori Sadamoto , Aranya Chakrabortty , Jun-ichi Imura

Learning a good state representation is a critical skill when dealing with multiple tasks in Reinforcement Learning as it allows for transfer and better generalization between tasks. However, defining what constitute a useful representation…

Machine Learning · Computer Science 2022-10-06 Valentin Guillet , Dennis G. Wilson , Carlos Aguilar-Melchor , Emmanuel Rachelson

In reinforcement learning with image-based inputs, it is crucial to establish a robust and generalizable state representation. Recent advancements in metric learning, such as deep bisimulation metric approaches, have shown promising results…

Machine Learning · Computer Science 2024-11-12 Jianda Chen , Wen Zheng Terence Ng , Zichen Chen , Sinno Jialin Pan , Tianwei Zhang

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

With the fast improvement of machine learning, reinforcement learning (RL) has been used to automate human tasks in different areas. However, training such agents is difficult and restricted to expert users. Moreover, it is mostly limited…

Machine Learning · Computer Science 2023-03-21 André Correia , Luís A. Alexandre