English
Related papers

Related papers: Learning to Control using Image Feedback

200 papers

Feedback-based control is the de-facto standard when it comes to controlling classical stochastic systems and processes. However, standard feedback-based control methods are challenged by quantum systems due to measurement induced…

Quantum Physics · Physics 2024-05-14 Kai Meinerz , Simon Trebst , Mark Rudner , Evert van Nieuwenburg

Recent trends in robot arm control have seen a shift towards end-to-end solutions, using deep reinforcement learning to learn a controller directly from raw sensor data, rather than relying on a hand-crafted, modular pipeline. However, the…

Robotics · Computer Science 2016-12-14 Stephen James , Edward Johns

The control of high-dimensional systems, such as soft robots, requires models that faithfully capture complex dynamics while remaining computationally tractable. This work presents a framework that integrates Graph Neural Network…

As the third-generation neural networks, Spiking Neural Networks (SNNs) have great potential on neuromorphic hardware because of their high energy-efficiency. However, Deep Spiking Reinforcement Learning (DSRL), i.e., the Reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-04-12 Guisong Liu , Wenjie Deng , Xiurui Xie , Li Huang , Huajin Tang

Reinforcement learning is a model-free optimal control method that optimizes a control policy through direct interaction with the environment. For reaching tasks that end in regulation, popular discrete-action methods are not well suited…

Robotics · Computer Science 2021-06-23 Wouter Caarls

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

Deep neural networks (DNNs), trained with gradient-based optimization and backpropagation, are currently the primary tool in modern artificial intelligence, machine learning, and data science. In many applications, DNNs are trained offline,…

Machine Learning · Computer Science 2024-02-02 Jacob G. Elkins , Farbod Fahimi

We address the problem of learning feedback control where the controller is a network constructed solely of deterministic spiking neurons. In contrast to previous investigations that were based on a spike rate model of the neuron, the…

Neurons and Cognition · Quantitative Biology 2018-09-27 Tae Seung Kang , Arunava Banerjee

The concept of a controlled flow of a dynamical system, especially when the controlling process feeds information back about the system, is of central importance in control engineering. In this paper we build on the ideas presented by…

Quantum Physics · Physics 2017-08-02 John E. Gough

The significance of learning constraints from data is underscored by its potential applications in real-world problem-solving. While constraints are popular for modeling and solving, the approaches to learning constraints from data remain…

Machine Learning · Computer Science 2024-03-05 Eduardo Vyhmeister , Rocio Paez , Gabriel Gonzalez

This paper addresses the problem of controlling the temporal dynamics of complex nonlinear network-coupled dynamical systems, specifically in terms of neurodynamics. Based on the Lyapunov direct method, we derive a control strategy with…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Zhongye Xia , Weibin Li , Zhichao Liang , Kexin Lou , Quanying Liu

Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yufei Hu , Nacim Belkhir , Jesus Angulo , Angela Yao , Gianni Franchi

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

Systems and Control · Electrical Eng. & Systems 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

This paper introduces a model-based approach for training feedback controllers for an autonomous agent operating in a highly nonlinear (albeit deterministic) environment. We desire the trained policy to ensure that the agent satisfies…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Navid Hashemi , Bardh Hoxha , Danil Prokhorov , Georgios Fainekos , Jyotirmoy Deshmukh

The article sets and solves the task to control an error of the artificial neural network with variable signal conductivity. This kind of neural networks was especially developed to construct timetables. Behavior of such a neural network…

Optimization and Control · Mathematics 2016-08-17 Alexander Ignatenkov , Alexey Olshansky

Attention guidance is an approach to addressing dataset bias in deep learning, where the model relies on incorrect features to make decisions. Focusing on image classification tasks, we propose an efficient human-in-the-loop system to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Yi He , Xi Yang , Chia-Ming Chang , Haoran Xie , Takeo Igarashi

This work is concerned with solving neural network-based feedback controllers efficiently for optimal control problems. We first conduct a comparative study of two prevalent approaches: offline supervised learning and online direct policy…

Optimization and Control · Mathematics 2024-04-10 Yue Zhao , Jiequn Han

One approach for feedback control using high dimensional and rich sensor measurements is to classify the measurement into one out of a finite set of situations, each situation corresponding to a (known) control action. This approach…

Optimization and Control · Mathematics 2019-03-12 Hasan A. Poonawala , Niklas Lauffer , Ufuk Topcu

Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy-efficient computing, which is beneficial to mobile robotic applications. However, the…

Neural and Evolutionary Computing · Computer Science 2020-03-11 Zhenshan Bing , Claus Meschede , Guang Chen , Alois Knoll , Kai Huang

The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy…

Machine Learning · Computer Science 2020-12-18 Katharina Bieker , Sebastian Peitz , Steven L. Brunton , J. Nathan Kutz , Michael Dellnitz