English
Related papers

Related papers: DiffSRL: Learning Dynamical State Representation f…

200 papers

The suspension system is a crucial part of the automotive chassis, improving vehicle ride comfort and isolating passengers from rough road excitation. Unlike passive suspension, which has constant spring and damping coefficients, active…

Robotics · Computer Science 2024-08-19 Anh N. Nhu , Ngoc-Anh Le , Shihang Li , Thang D. V. Truong

We aim to solve the problem of manipulating deformable objects, particularly elastic bands, in real-world scenarios. However, deformable object manipulation (DOM) requires a policy that works on a large state space due to the unlimited…

Robotics · Computer Science 2025-05-02 Minseok Song , JeongHo Ha , Bonggyeong Park , Daehyung Park

Disentangled Representation Learning (DRL) aims to learn a model capable of identifying and disentangling the underlying factors hidden in the observable data in representation form. The process of separating underlying factors of variation…

Machine Learning · Computer Science 2024-06-28 Xin Wang , Hong Chen , Si'ao Tang , Zihao Wu , Wenwu Zhu

The open world is inherently dynamic, characterized by ever-evolving concepts and distributions. Continual learning (CL) in this dynamic open-world environment presents a significant challenge in effectively generalizing to unseen test-time…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Youngeun Kim , Jun Fang , Qin Zhang , Zhaowei Cai , Yantao Shen , Rahul Duggal , Dripta S. Raychaudhuri , Zhuowen Tu , Yifan Xing , Onkar Dabeer

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from…

Robotics · Computer Science 2018-02-08 Risto Kojcev , Nora Etxezarreta , Alejandro Hernández , Víctor Mayoral

Musculoskeletal robots provide superior advantages in flexibility and dexterity, positioning them as a promising frontier towards embodied intelligence. However, current research is largely confined to relative simple tasks, restricting the…

Robotics · Computer Science 2026-03-10 Wentao Zhao , Jun Guo , Kangyao Huang , Xin Liu , Huaping Liu

Several self-supervised representation learning methods have been proposed for reinforcement learning (RL) with rich observations. For real-world applications of RL, recovering underlying latent states is crucial, particularly when sensory…

Learned representations of dynamical systems reduce dimensionality, potentially supporting downstream reinforcement learning (RL). However, no established methods predict a representation's suitability for control and evaluation is largely…

Machine Learning · Computer Science 2020-11-25 Kevin Haninger , Raul Vicente Garcia , Joerg Krueger

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Deep reinforcement learning (DRL) has had success in virtual and simulated domains, but due to key differences between simulated and real-world environments, DRL-trained policies have had limited success in real-world applications. To…

Machine Learning · Computer Science 2025-03-17 Peter Böhm , Pauline Pounds , Archie C. Chapman

The vast majority of systems of practical interest are characterised by nonlinear dynamics. This renders the control and optimization of such systems a complex task due to their nonlinear behaviour. Additionally, standard methods such as…

Systems and Control · Electrical Eng. & Systems 2022-04-05 Akhil Ahmed , Ehecatl Antonio del Rio-Chanona , Mehmet Mercangoz

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…

Applications of reinforcement learning (RL) to stabilization problems of real systems are restricted since an agent needs many experiences to learn an optimal policy and may determine dangerous actions during its exploration. If we know a…

Machine Learning · Computer Science 2021-04-20 Junya Ikemoto , Toshimitsu Ushio

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Real-life control tasks involve matters of various substances---rigid or soft bodies, liquid, gas---each with distinct physical behaviors. This poses challenges to traditional rigid-body physics engines. Particle-based simulators have been…

Machine Learning · Computer Science 2019-04-19 Yunzhu Li , Jiajun Wu , Russ Tedrake , Joshua B. Tenenbaum , Antonio Torralba

The robotic manipulation of Deformable Linear Objects (DLOs) is a fundamental challenge due to the high-dimensional, non-linear dynamics of flexible structures and the complexity of maintaining topological integrity during contact-rich…

Ensuring safety and robustness of robot skills is becoming crucial as robots are required to perform increasingly complex and dynamic tasks. The former is essential when performing tasks in cluttered environments, while the latter is…

Robotics · Computer Science 2025-04-29 Ken-Joel Simmoteit , Philipp Schillinger , Leonel Rozo

Latent state space models are a fundamental and widely used tool for modeling dynamical systems. However, they are difficult to learn from data and learned models often lack performance guarantees on inference tasks such as filtering and…

Machine Learning · Computer Science 2016-05-31 Wen Sun , Arun Venkatraman , Byron Boots , J. Andrew Bagnell

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building…

Machine Learning · Computer Science 2025-09-30 Boxuan Zhang , Runqing Wang , Wei Xiao , Weipu Zhang , Jian Sun , Gao Huang , Jie Chen , Gang Wang