English
Related papers

Related papers: Decentralized Multi-Robot Formation Control Using …

200 papers

Modular Reinforcement Learning (RL) decentralizes the control of multi-joint robots by learning policies for each actuator. Previous work on modular RL has proven its ability to control morphologically different agents with a shared…

Machine Learning · Computer Science 2022-10-28 Heng Dong , Tonghan Wang , Jiayuan Liu , Chongjie Zhang

We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained…

Machine Learning · Computer Science 2015-10-16 Hao Yi Ong , Kevin Chavez , Augustus Hong

Particle robots are novel biologically-inspired robotic systems where locomotion can be achieved collectively and robustly, but not independently. While its control is currently limited to a hand-crafted policy for basic locomotion tasks,…

Robotics · Computer Science 2025-05-12 Jeremy Shen , Erdong Xiao , Yuchen Liu , Chen Feng

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

Work-Related Musculoskeletal Disorders continue to be a major challenge in industrial environments, leading to reduced workforce participation, increased healthcare costs, and long-term disability. This study introduces a human-sensitive…

Robotics · Computer Science 2025-04-15 Vitor Martins , Sara M. Cerqueira , Mercedes Balcells , Elazer R Edelman , Cristina P. Santos

With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control policy is of…

Performance · Computer Science 2022-04-08 Bai Liu , Qiaomin Xie , Eytan Modiano

In this paper, we present an exploration and assessment of employing a centralized deep Q-network (DQN) controller as a substitute for the prevalent use of PID controllers in the context of 6DOF swimming robots. Our primary focus centers on…

Robotics · Computer Science 2024-01-31 Faraz Lotfi , Khalil Virji , Nicholas Dudek , Gregory Dudek

This article presents a motion planning and control framework for flexible robotic manipulators, integrating deep reinforcement learning (DRL) with a nonlinear partial differential equation (PDE) controller. Unlike conventional approaches…

Robotics · Computer Science 2025-06-11 Amir Hossein Barjini , Seyed Adel Alizadeh Kolagar , Sadeq Yaqubi , Jouni Mattila

Formation control of multi-agent systems has been a prominent research topic, spanning both theoretical and practical domains over the past two decades. Our study delves into the leader-follower framework, addressing two critical,…

Robotics · Computer Science 2023-08-15 Yanran Wang , Tatsuya Baba , Takashi Hikihara

Deep reinforcement learning has been recognized as an efficient technique to design optimal strategies for different complex systems without prior knowledge of the control landscape. To achieve a fast and precise control for quantum…

Quantum Physics · Physics 2021-01-05 Hailan Ma , Daoyi Dong , Steven X. Ding , Chunlin Chen

The leader-follower formation control analysis for multiple quad-rotor systems is investigated in this paper. To achieve predefined formation in the three-dimensional air space ($x,y$ and $z$), a novel local tracking control law and a…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Lixia Yan , Baoli Ma

Reinforcement learning (RL) is an effective approach for solving optimal control problems without knowing the exact information of the system model. However, the classical Q-learning method, a model-free RL algorithm, has its limitations,…

Optimization and Control · Mathematics 2025-06-04 Xiushan Jiang , Weihai Zhang

Controlling a team of robots in a coordinated manner is challenging because centralized approaches (where all computation is performed on a central machine) scale poorly, and globally referenced external localization systems may not always…

Robotics · Computer Science 2026-02-20 Abhishek Goudar , Angela P. Schoellig

Autonomous driving decision-making is a great challenge due to the complexity and uncertainty of the traffic environment. Combined with the rule-based constraints, a Deep Q-Network (DQN) based method is applied for autonomous driving lane…

Robotics · Computer Science 2019-04-03 Junjie Wang , Qichao Zhang , Dongbin Zhao , Yaran Chen

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

Reinforcement learning (RL) enables an agent to learn from trial-and-error experiences toward achieving long-term goals; automated planning aims to compute plans for accomplishing tasks using action knowledge. Despite their shared goal of…

Robotics · Computer Science 2021-03-17 Yohei Hayamizu , Saeid Amiri , Kishan Chandan , Keiki Takadama , Shiqi Zhang

Recent trends in robot arm control have seen a shift towards end-to-end solutions, using deep reinforcement learning to learn a controller directly from raw sensor data, rather than relying on a hand-crafted, modular pipeline. However, the…

Robotics · Computer Science 2016-12-14 Stephen James , Edward Johns

In this work, we consider the problem of network parameter optimization for rate maximization. We frame this as a joint optimization problem of power control, beam forming, and interference cancellation. We consider the setting where…

Machine Learning · Computer Science 2023-11-14 Heasung Kim , Sravan Kumar Ankireddy

Leveraging many sources of offline robot data requires grappling with the heterogeneity of such data. In this paper, we focus on one particular aspect of heterogeneity: learning from offline data collected at different control frequencies.…

Machine Learning · Computer Science 2022-07-27 Kaylee Burns , Tianhe Yu , Chelsea Finn , Karol Hausman

In this work we augment a Deep Q-Learning agent with a Reward Machine (DQRM) to increase speed of learning vision-based policies for robot tasks, and overcome some of the limitations of DQN that prevent it from converging to good-quality…

Robotics · Computer Science 2021-01-01 Alberto Camacho , Jacob Varley , Deepali Jain , Atil Iscen , Dmitry Kalashnikov