English
Related papers

Related papers: SAMBA: Safe Model-Based & Active Reinforcement Lea…

200 papers

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

This paper proposes tackling safety-critical stochastic Reinforcement Learning (RL) tasks with a sample-based, model-based approach. At the core of the method lies a Model Predictive Control (MPC) scheme that acts as function approximation,…

Systems and Control · Electrical Eng. & Systems 2025-07-30 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Visual attention modeling, important for interpreting and prioritizing visual stimuli, plays a significant role in applications such as marketing, multimedia, and robotics. Traditional saliency prediction models, especially those based on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Alireza Hosseini , Amirhossein Kazerouni , Saeed Akhavan , Michael Brudno , Babak Taati

State-space models (SSMs) have emerged as an efficient strategy for building powerful language models, avoiding the quadratic complexity of computing attention in transformers. Despite their promise, the interpretability and steerability of…

Machine Learning · Computer Science 2026-05-22 Vamshi Sunku Mohan , Kaustubh Gupta , Aneesha Das , Chandan Singh

Task failures in prior fine-grained robotic manipulation methods often stem from suboptimal initial grasping, which is critical for subsequent manipulation and reducing the requirement for complex pose adjustments. To address this, we…

Robotics · Computer Science 2025-11-20 Juyi Sheng , Yangjun Liu , Sheng Xu , Zhixin Yang , Mengyuan Liu

There are two major approaches for sequence labeling. One is the probabilistic gradient-based methods such as conditional random fields (CRF) and neural networks (e.g., RNN), which have high accuracy but drawbacks: slow training, and no…

Machine Learning · Computer Science 2018-11-20 Xu Sun , Shuming Ma , Yi Zhang , Xuancheng Ren

This manuscript details and extends the SIMBa toolbox (System Identification Methods leveraging Backpropagation) presented in previous work, which uses well-established Machine Learning tools for discrete-time linear multi-step-ahead…

Systems and Control · Electrical Eng. & Systems 2024-09-26 Loris Di Natale , Muhammad Zakwan , Philipp Heer , Giancarlo Ferrari-Trecate , Colin N. Jones

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

The objective of Active Learning is to strategically label a subset of the dataset to maximize performance within a predetermined labeling budget. In this study, we harness features acquired through self-supervised learning. We introduce a…

Machine Learning · Computer Science 2023-12-27 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

We propose a novel active learning framework for activity recognition using wearable sensors. Our work is unique in that it takes physical and cognitive limitations of the oracle into account when selecting sensor data to be annotated by…

Machine Learning · Computer Science 2019-07-30 Zhila Esna Ashari , Hassan Ghasemzadeh

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yizhou Huang , Yihua Cheng , Kezhi Wang

Safe Reinforcement Learning (Safe RL) aims to ensure safety when an RL agent conducts learning by interacting with real-world environments where improper actions can induce high costs or lead to severe consequences. In this paper, we…

Machine Learning · Computer Science 2025-05-06 Hanping Zhang , Yuhong Guo

Autonomous-driving research has recently embraced deep Reinforcement Learning (RL) as a promising framework for data-driven decision making, yet a clear picture of how these algorithms are currently employed, benchmarked and evaluated is…

Robotics · Computer Science 2025-09-11 Elahe Delavari , Feeza Khan Khanzada , Jaerock Kwon

We develop provably safe and convergent reinforcement learning (RL) algorithms for control of nonlinear dynamical systems, bridging the gap between the hard safety guarantees of control theory and the convergence guarantees of RL theory.…

Machine Learning · Computer Science 2024-03-08 Wesley A. Suttle , Vipul K. Sharma , Krishna C. Kosaraju , S. Sivaranjani , Ji Liu , Vijay Gupta , Brian M. Sadler

Driver attention recognition in driving scenarios is a popular direction in traffic scene perception technology. It aims to understand human driver attention to focus on specific targets/objects in the driving scene. However, traffic scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Chunyu Zhao , Wentao Mu , Xian Zhou , Wenbo Liu , Fei Yan , Tao Deng

Learning to control a safety-critical system with latent dynamics (e.g. for deep brain stimulation) requires taking calculated risks to gain information as efficiently as possible. To address this problem, we present a…

Machine Learning · Computer Science 2020-07-09 Mariah L. Schrum , Mark Connolly , Eric Cole , Mihir Ghetiya , Robert Gross , Matthew C. Gombolay

Visual reinforcement learning has achieved remarkable progress in visual control and robotics, but its vulnerability to adversarial perturbations remains underexplored. Most existing black-box attacks focus on vector-based or…

Machine Learning · Computer Science 2025-11-14 Tairan Huang , Yulin Jin , Junxu Liu , Qingqing Ye , Haibo Hu

Safe Policy Improvement (SPI) is an important technique for offline reinforcement learning in safety critical applications as it improves the behavior policy with a high probability. We classify various SPI approaches from the literature…

Machine Learning · Computer Science 2022-08-02 Philipp Scholl , Felix Dietrich , Clemens Otte , Steffen Udluft

In this work, we introduce a stochastic maximum principle (SMP) approach for solving the reinforcement learning problem with the assumption that the unknowns in the environment can be parameterized based on physics knowledge. For the…

Optimization and Control · Mathematics 2023-06-14 Richard Archibald , Feng Bao , Jiongmin Yong