中文
相关论文

相关论文: On the Value of Online Learning for Radar Waveform…

200 篇论文

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

机器学习 · 计算机科学 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

机器学习 · 计算机科学 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

Existing grasp prediction approaches are mostly based on offline learning, while, ignoring the exploratory grasp learning during online adaptation to new picking scenarios, i.e., objects that are unseen or out-of-domain (OOD), camera and…

We study risk-sensitive reinforcement learning (RL), a crucial field due to its ability to enhance decision-making in scenarios where it is essential to manage uncertainty and minimize potential adverse outcomes. Particularly, our work…

机器学习 · 计算机科学 2024-07-11 Dake Zhang , Boxiang Lyu , Shuang Qiu , Mladen Kolar , Tong Zhang

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

Robots often need to learn the human's reward function online, during the current interaction. This real-time learning requires fast but approximate learning rules: when the human's behavior is noisy or suboptimal, current approximations…

机器人学 · 计算机科学 2024-01-05 Shaunak A. Mehta , Forrest Meng , Andrea Bajcsy , Dylan P. Losey

Online learning algorithms are designed to perform in non-stationary environments, but generally there is no notion of a dynamic state to model constraints on current and future actions as a function of past actions. State-based models are…

机器学习 · 计算机科学 2015-09-01 Peng Guan , Maxim Raginsky , Rebecca Willett

This paper focuses on learning a model of system dynamics online while satisfying safety constraints.Our motivation is to avoid offline system identification or hand-specified dynamics models and allowa system to safely and autonomously…

机器人学 · 计算机科学 2020-05-07 Mohammad Javad Khojasteh , Vikas Dhiman , Massimo Franceschetti , Nikolay Atanasov

This paper presents an online method that learns optimal decisions for a discrete time Markov decision problem with an opportunistic structure. The state at time $t$ is a pair $(S(t),W(t))$ where $S(t)$ takes values in a finite set…

最优化与控制 · 数学 2024-08-13 Michael J. Neely

Off-dynamics reinforcement learning (RL), where training and deployment transition dynamics are different, can be formulated as learning in a robust Markov decision process (RMDP) where uncertainties in transition dynamics are imposed.…

机器学习 · 计算机科学 2025-11-10 Yiting He , Zhishuai Liu , Weixin Wang , Pan Xu

This study presents the first comprehensive comparison of rule-based methods, traditional machine learning models, and deep learning models in radio wave sensing with frequency modulated continuous wave multiple input multiple output radar.…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Tomoya Tanaka , Tomonori Ikeda , Ryo Yonemoto

We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic platforms, we systematically ablate algorithmic, systems, and…

机器人学 · 计算机科学 2026-02-25 Yarden As , Dhruva Tirumala , René Zurbrügg , Chenhao Li , Stelian Coros , Andreas Krause , Markus Wulfmeier

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

机器学习 · 计算机科学 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

We consider the problem of learning the optimal policy for Markov decision processes with safety constraints. We formulate the problem in a reach-avoid setup. Our goal is to design online reinforcement learning algorithms that ensure safety…

机器学习 · 计算机科学 2026-01-21 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

This work focuses on classification over time series data. When a time series is generated by non-stationary phenomena, the pattern relating the series with the class to be predicted may evolve over time (concept drift). Consequently,…

机器学习 · 计算机科学 2020-04-02 Eric L. Manibardo , Ibai Laña , Jesus L. Lobo , Javier Del Ser

We demonstrate model-based, visual robot manipulation of linear deformable objects. Our approach is based on a state-space representation of the physical system that the robot aims to control. This choice has multiple advantages, including…

机器人学 · 计算机科学 2020-10-07 Mengyuan Yan , Yilin Zhu , Ning Jin , Jeannette Bohg

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

机器学习 · 计算机科学 2021-12-16 Xiaoxuan Wang , Rolf Stadler

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

机器学习 · 统计学 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

This paper presents a radar odometry method that combines probabilistic trajectory estimation and deep learned features without needing groundtruth pose information. The feature network is trained unsupervised, using only the on-board radar…

机器人学 · 计算机科学 2021-07-02 Keenan Burnett , David J. Yoon , Angela P. Schoellig , Timothy D. Barfoot

This paper considers meta-cognitive radars in an adversarial setting. A cognitive radar optimally adapts its waveform (response) in response to maneuvers (probes) of a possibly adversarial moving target. A meta-cognitive radar is aware of…

信号处理 · 电气工程与系统科学 2022-05-05 Kunal Pattanayak , Vikram Krishnamurthy , Christopher Berry