English
Related papers

Related papers: Residual Feedback Learning for Contact-Rich Manipu…

200 papers

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

Robotics · Computer Science 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

In modern chip design, placement aims at placing millions of circuit modules, which is an essential step that significantly influences power, performance, and area (PPA) metrics. Recently, reinforcement learning (RL) has emerged as a…

Machine Learning · Computer Science 2024-12-11 Ke Xue , Ruo-Tong Chen , Xi Lin , Yunqi Shi , Shixiong Kai , Siyuan Xu , Chao Qian

To maintain structural integrity and functionality during the designed life cycle of a structure, engineers are expected to accommodate for natural hazards as well as operational load levels. Active control systems are an efficient solution…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Soheila Sadeghi Eshkevari , Soheil Sadeghi Eshkevari , Debarshi Sen , Shamim N. Pakzad

Reinforcement learning (RL) has become a predominant technique to align language models (LMs) with human preferences or promote outputs which are deemed to be desirable by a given reward function. Standard RL approaches optimize average…

Machine Learning · Computer Science 2025-10-27 Stephen Zhao , Aidan Li , Rob Brekelmans , Roger Grosse

Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a…

Robotics · Computer Science 2026-03-06 Yanda Yang , Sambeeta Das

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu

We propose a Reinforcement Learning (RL) based control design framework for handling complex tasks. The approach extends the concept of Reward Machines (RM) with Signal Temporal Logic (STL) formulas that can be used for event generation.…

Artificial Intelligence · Computer Science 2026-04-17 Ana María Gómez Ruiz , Thao Dang , Alexandre Donzé

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

Choosing an appropriate parameter set for the designed controller is critical for the final performance but usually requires a tedious and careful tuning process, which implies a strong need for automatic tuning methods. However, among…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Yuheng Lei , Jianyu Chen , Shengbo Eben Li , Sifa Zheng

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

Robotics · Computer Science 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo

The ball-balancing robot (ballbot) is a good platform to test the effectiveness of a balancing controller. Considering balancing control, conventional model-based feedback control methods have been widely used. However, contacts and…

Robotics · Computer Science 2022-08-23 Yifan Zhou , Jianghao Lin , Shuai Wang , Chong Zhang

Humans can flexibly generalize knowledge across domains by leveraging structured relational representations. While prior research has shown how such representations support analogical reasoning, less is known about how they are recruited to…

Artificial Intelligence · Computer Science 2025-12-01 Guillermo Puebla , Leonidas A. A. Doumas

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

This letter presents contact-safe Model-based Reinforcement Learning (MBRL) for robot applications that achieves contact-safe behaviors in the learning process. In typical MBRL, we cannot expect the data-driven model to generate accurate…

Robotics · Computer Science 2021-03-10 Cheng-Yu Kuo , Andreas Schaarschmidt , Yunduan Cui , Tamim Asfour , Takamitsu Matsubara

Growing demands in the semiconductor industry result in the need for enhanced performance of lithographic equipment. However, position tracking accuracy of high precision mechatronics is often limited by the presence of disturbance sources,…

Systems and Control · Electrical Eng. & Systems 2021-05-05 Ioannis Proimadis , Yorick Broens , Roland Tóth , Hans Butler

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

Safe reinforcement learning (SafeRL) is a prominent paradigm for autonomous driving, where agents are required to optimize performance under strict safety requirements. This dual objective creates a fundamental tension, as overly…

Machine Learning · Computer Science 2025-12-24 Mahesh Keswani , Raunak Bhattacharyya

Reinforcement Learning (RL) has shown great promise for efficiently learning force control policies in peg-in-hole tasks. However, robots often face difficulties due to visual occlusions by the gripper and uncertainties in the initial…

Robotics · Computer Science 2023-09-28 Tatsuya Kamijo , Ixchel G. Ramirez-Alpizar , Enrique Coronado , Gentiane Venture