English
Related papers

Related papers: A Q-learning Control Method for a Soft Robotic Arm…

200 papers

Model-free reinforcement learning has been successfully applied to a range of challenging problems, and has recently been extended to handle large neural network policies and value functions. However, the sample complexity of model-free…

Machine Learning · Computer Science 2016-03-03 Shixiang Gu , Timothy Lillicrap , Ilya Sutskever , Sergey Levine

Traditional control methods effectively manage robot operations using models like motion equations but face challenges with issues of contact and friction, leading to unstable and imprecise controllers that often require manual tweaking.…

Robotics · Computer Science 2024-09-20 Bahador Beigomi , Zheng H. Zhu

Reinforcement learning provides a general framework for flexible decision making and control, but requires extensive data collection for each new task that an agent needs to learn. In other machine learning fields, such as natural language…

Machine Learning · Computer Science 2020-11-20 Avi Singh , Huihan Liu , Gaoyue Zhou , Albert Yu , Nicholas Rhinehart , Sergey Levine

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

Reinforcement Learning in domains with sparse rewards is a difficult problem, and a large part of the training process is often spent searching the state space in a more or less random fashion for any learning signals. For control problems,…

Machine Learning · Computer Science 2019-11-22 Eivind Bøhn , Signe Moe , Tor Arne Johansen

Soft robots are gaining popularity thanks to their intrinsic safety to contacts and adaptability. However, the potentially infinite number of Degrees of Freedom makes their modeling a daunting task, and in many cases only an approximated…

Robotics · Computer Science 2024-01-26 Gabriele Tiboni , Andrea Protopapa , Tatiana Tommasi , Giuseppe Averta

Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for…

Robotics · Computer Science 2024-03-29 Zifan Wang , Yufei Jia , Lu Shi , Haoyu Wang , Haizhou Zhao , Xueyang Li , Jinni Zhou , Jun Ma , Guyue Zhou

The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks. An important line of research in this regard is that of…

Robotics · Computer Science 2023-11-14 Luca Lach , Robert Haschke , Davide Tateo , Jan Peters , Helge Ritter , Júlia Borràs , Carme Torras

Reinforcement learning has witnessed significant advancements, particularly with the emergence of model-based approaches. Among these, $Q$-learning has proven to be a powerful algorithm in model-free settings. However, the extension of…

Machine Learning · Computer Science 2026-03-31 Han-Dong Lim , HyeAnn Lee , Donghwan Lee

The dominant way to control a robot manipulator uses hand-crafted differential equations leveraging some form of inverse kinematics / dynamics. We propose a simple, versatile joint-level controller that dispenses with differential equations…

Robotics · Computer Science 2021-08-23 Visak Kumar , David Hoeller , Balakumar Sundaralingam , Jonathan Tremblay , Stan Birchfield

A long-standing engineering problem, the control of soft robots is difficult because of their highly non-linear, heterogeneous, anisotropic, and distributed nature. Here, bridging engineering and biology, a neural reservoir is employed for…

Real-time proprioception is a challenging problem for soft robots, which have almost infinite degrees-of-freedom in body deformation. When multiple actuators are used, it becomes more difficult as deformation can also occur on actuators…

Robotics · Computer Science 2020-12-24 Rob B. N. Scharff , Guoxin Fang , Yingjun Tian , Jun Wu , Jo M. P. Geraedts , Charlie C. L. Wang

Q-learning is a regression-based approach that is widely used to formalize the development of an optimal dynamic treatment strategy. Finite dimensional working models are typically used to estimate certain nuisance parameters, and…

Methodology · Statistics 2020-03-30 Ashkan Ertefaie , James R. McKay , David Oslin , Robert L. Strawderman

Data-driven learning-based control methods such as reinforcement learning (RL) have become increasingly popular with recent proliferation of the machine learning paradigm. These methods address the parameter sensitiveness and unmodeled…

Systems and Control · Electrical Eng. & Systems 2023-12-08 Yihao Wan , Qianwen Xu , Tomislav Dragičević

The use of wearable robots has been widely adopted in rehabilitation training for patients with hand motor impairments. However, the uniqueness of patients' muscle loss is often overlooked. Leveraging reinforcement learning and a…

Robotics · Computer Science 2025-05-15 Shirui Lyu , Vittorio Caggiano , Matteo Leonetti , Dario Farina , Letizia Gionfrida

Autonomous unpowered flight is a challenge for control and guidance systems: all the energy the aircraft might use during flight has to be harvested directly from the atmosphere. We investigate the design of an algorithm that optimizes the…

Machine Learning · Computer Science 2017-07-19 Erwan Lecarpentier , Sebastian Rapp , Marc Melo , Emmanuel Rachelson

The use of Reinforcement Learning (RL) is still restricted to simulation or to enhance human-operated systems through recommendations. Real-world environments (e.g. industrial robots or power grids) are generally designed with safety…

Machine Learning · Computer Science 2020-08-14 Mathieu Seurin , Philippe Preux , Olivier Pietquin

Dexterous multi-fingered hands can accomplish fine manipulation behaviors that are infeasible with simple robotic grippers. However, sophisticated multi-fingered hands are often expensive and fragile. Low-cost soft hands offer an appealing…

Machine Learning · Computer Science 2017-03-21 Abhishek Gupta , Clemens Eppner , Sergey Levine , Pieter Abbeel

Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of…

Robotics · Computer Science 2024-05-17 Pascal Goldschmid , Aamir Ahmad

This work concerns the application of physics-informed neural networks to the modeling and control of complex robotic systems. Achieving this goal required extending Physics Informed Neural Networks to handle non-conservative effects. We…

Robotics · Computer Science 2023-07-07 Jingyue Liu , Pablo Borja , Cosimo Della Santina