English
Related papers

Related papers: CHEQ-ing the Box: Safe Variable Impedance Learning…

200 papers

Contact-rich tasks pose significant challenges for robotic systems due to inherent uncertainty, complex dynamics, and the high risk of damage during interaction. Recent advances in learning-based control have shown great potential in…

Robotics · Computer Science 2026-01-27 Heng Zhang , Rui Dai , Gokhan Solak , Pokuang Zhou , Yu She , Arash Ajoudani

The computational cost of stiff chemical kinetics remains a dominant bottleneck in reacting-flow simulation, yet hybrid integration strategies are typically driven by hand-tuned heuristics or supervised predictors that make myopic decisions…

Machine Learning · Computer Science 2026-04-02 Eloghosa Ikponmwoba , Opeoluwa Owoyele

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

In this paper, we investigate code-integrated reasoning, where models generate code when necessary and integrate feedback by executing it through a code interpreter. To acquire this capability, models must learn when and how to use external…

Computation and Language · Computer Science 2025-06-02 Fei Bai , Yingqian Min , Beichen Zhang , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Zheng Liu , Zhongyuan Wang , Ji-Rong Wen

Ensuring the safety of reinforcement learning (RL) algorithms is crucial to unlock their potential for many real-world tasks. However, vanilla RL and most safe RL approaches do not guarantee safety. In recent years, several methods have…

Machine Learning · Computer Science 2023-11-21 Hanna Krasowski , Jakob Thumm , Marlon Müller , Lukas Schäfer , Xiao Wang , Matthias Althoff

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

Artificial Intelligence · Computer Science 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Off-road navigation on vertically challenging terrain, involving steep slopes and rugged boulders, presents significant challenges for wheeled robots both at the planning level to achieve smooth collision-free trajectories and at the…

Robotics · Computer Science 2024-10-29 Tong Xu , Chenhui Pan , Xuesu Xiao

When using a tool, the grasps used for picking it up, reposing, and holding it in a suitable pose for the desired task could be distinct. Therefore, a key challenge for autonomous in-hand tool manipulation is finding a sequence of grasps…

Robotics · Computer Science 2023-04-06 Ethan K. Gordon , Rana Soltani Zarrin

Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other…

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

Machine Learning · Computer Science 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

This paper comprehensively surveys research trends in imitation learning for contact-rich robotic tasks. Contact-rich tasks, which require complex physical interactions with the environment, represent a central challenge in robotics due to…

Robotics · Computer Science 2025-06-17 Toshiaki Tsuji , Yasuhiro Kato , Gokhan Solak , Heng Zhang , Tadej Petrič , Francesco Nori , Arash Ajoudani

Reinforcement learning (RL) has recently been used for solving challenging decision-making problems in the context of automated driving. However, one of the main drawbacks of the presented RL-based policies is the lack of safety guarantees,…

Robotics · Computer Science 2021-07-16 Danial Kamran , Yu Ren , Martin Lauer

Enabling autonomous robots to interact in unstructured environments with dynamic objects requires manipulation capabilities that can deal with clutter, changes, and objects' variability. This paper presents a comparison of different…

Robotics · Computer Science 2019-02-01 Michel Breyer , Fadri Furrer , Tonci Novkovic , Roland Siegwart , Juan Nieto

Object insertion under tight tolerances ($< \hspace{-.02in} 1mm$) is an important but challenging assembly task as even small errors can result in undesirable contacts. Recent efforts focused on Reinforcement Learning (RL), which often…

Modern Reinforcement Learning (RL) algorithms promise to solve difficult motor control problems directly from raw sensory inputs. Their attraction is due in part to the fact that they can represent a general class of methods that allow to…

Human dexterity is an invaluable capability for precise manipulation of objects in complex tasks. The capability of robots to similarly grasp and perform in-hand manipulation of objects is critical for their use in the ever changing human…

Robotics · Computer Science 2024-10-25 Abraham Itzhak Weinberg , Alon Shirizly , Osher Azulay , Avishai Sintov

Design time uncertainty poses an important challenge when developing a self-adaptive system. As an example, defining how the system should adapt when facing a new environment state, requires understanding the precise effect of an…

Machine Learning · Computer Science 2022-10-13 Felix Feit , Andreas Metzger , Klaus Pohl

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

Deep reinforcement learning (RL) has been shown to be effective in producing approximate solutions to some vehicle routing problems (VRPs), especially when using policies generated by encoder-decoder attention mechanisms. While these…

Machine Learning · Computer Science 2024-12-19 Joshua Levin , Randall Correll , Takanori Ide , Takafumi Suzuki , Takaho Saito , Alan Arai