English
Related papers

Related papers: KARL: Kalman-Filter Assisted Reinforcement Learner…

200 papers

While Reinforcement Learning has made great strides towards solving ever more complicated tasks, many algorithms are still brittle to even slight changes in their environment. This is a limiting factor for real-world applications of RL.…

In the field of sensor fusion and state estimation for object detection and localization, ensuring accurate tracking in dynamic environments poses significant challenges. Traditional methods like the Kalman Filter (KF) often fail when…

Robotics · Computer Science 2024-10-15 Khaled Gabr , Mohamed Abdelkader , Imen Jarraya , Abdullah AlMusalami , Anis Koubaa

We propose a simple yet effective alternative to reward normalization in policy gradient reinforcement learning by integrating a 1D Kalman filter for online reward estimation. Instead of relying on fixed heuristics, our method recursively…

Machine Learning · Computer Science 2026-04-28 Zixuan Xia , Quanxi Li

Grasping moving objects, such as goods on a belt or living animals, is an important but challenging task in robotics. Conventional approaches rely on a set of manually defined object motion patterns for training, resulting in poor…

Robotics · Computer Science 2022-03-15 Tianhao Wu , Fangwei Zhong , Yiran Geng , Hongchen Wang , Yongjian Zhu , Yizhou Wang , Hao Dong

Current image-based reinforcement learning (RL) algorithms typically operate on the whole image without performing object-level reasoning. This leads to inefficient goal sampling and ineffective reward functions. In this paper, we improve…

Machine Learning · Computer Science 2020-11-16 Yufei Wang , Gautham Narayan Narasimhan , Xingyu Lin , Brian Okorn , David Held

Edge computing pushes the cloud computing boundaries beyond uncertain network resource by leveraging computational processes close to the source and target of data. Time-sensitive and data-intensive video surveillance applications benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-08 Seyed Yahya Nikouei , Yu Chen , Sejun Song , Timothy R. Faughnan

The Kalman filter (KF) is a widely-used algorithm for tracking dynamic systems that are captured by state space (SS) models. The need to fully describe a SS model limits its applicability under complex settings, e.g., when tracking based on…

Signal Processing · Electrical Eng. & Systems 2023-04-21 Itay Buchnik , Damiano Steger , Guy Revach , Ruud J. G. van Sloun , Tirza Routtenberg , Nir Shlezinger

Prior works on action representation learning mainly focus on designing various architectures to extract the global representations for short video clips. In contrast, many practical applications such as video alignment have strong demand…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Minghao Chen , Fangyun Wei , Chong Li , Deng Cai

Many interventional surgical procedures rely on medical imaging to visualise and track instruments. Such imaging methods not only need to be real-time capable, but also provide accurate and robust positional information. In ultrasound…

Automatic lane tracking involves estimating the underlying signal from a sequence of noisy signal observations. Many models and methods have been proposed for lane tracking, and dynamic targets tracking in general. The Kalman Filter is a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-29 Jiawei Huang , Zhaowen Wang

This paper proposes an adaptable path tracking control system based on Reinforcement Learning (RL) for autonomous cars. A four-parameter controller shapes the behavior of the vehicle to navigate on lane changes and roundabouts. The tuning…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Ana Carrasco , João Sequeira

RAM incorporates a motion-aware semantic tracker with adaptive Kalman filtering to achieve robust identity association under severe occlusions and dynamic interactions. A memory-augmented Temporal HMR module further enhances human motion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Sen Jia , Ning Zhu , Jinqin Zhong , Jiale Zhou , Huaping Zhang , Jenq-Neng Hwang , Lei Li

Real-world multi-agent reinforcement learning (MARL) systems must often operate under stale observations, stochastic communication delays, and intermittent packet loss. Policies trained under idealized synchronous conditions frequently…

Multiagent Systems · Computer Science 2026-05-27 Maxim Mednikov , Oren Gal

Flashcard schedulers rely on 1) student models to predict the flashcards a student knows; and 2) teaching policies to pick which cards to show next via these predictions. Prior student models, however, just use study data like the student's…

Computation and Language · Computer Science 2024-10-30 Matthew Shu , Nishant Balepur , Shi Feng , Jordan Boyd-Graber

Cooperative Adaptive Cruise Control (CACC) plays a pivotal role in enhancing traffic efficiency and safety in Connected and Autonomous Vehicles (CAVs). Reinforcement Learning (RL) has proven effective in optimizing complex decision-making…

Machine Learning · Computer Science 2024-07-15 Sicong Jiang , Seongjin Choi , Lijun Sun

The optimal predictor for a linear dynamical system (with hidden state and Gaussian noise) takes the form of an autoregressive linear filter, namely the Kalman filter. However, a fundamental problem in reinforcement learning and control…

Machine Learning · Computer Science 2019-05-27 Holden Lee , Cyril Zhang

Traditional tracking-by-detection systems typically employ Kalman filters (KF) for state estimation. However, the KF requires domain-specific design choices and it is ill-suited to handling non-linear motion patterns. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Momir Adžemović , Predrag Tadić , Andrija Petrović , Mladen Nikolić

With the recent advance of deep learning based object recognition and estimation, it is possible to consider object level SLAM where the pose of each object is estimated in the SLAM process. In this paper, based on a novel Lie group…

Robotics · Computer Science 2021-09-14 Yang Song , Zhuqing Zhang , Jun Wu , Yue Wang , Liang Zhao , Shoudong Huang

Distributed Multi-Agent Reinforcement Learning (MARL) algorithms has attracted a surge of interest lately mainly due to the recent advancements of Deep Neural Networks (DNNs). Conventional Model-Based (MB) or Model-Free (MF) RL algorithms…

Machine Learning · Computer Science 2022-01-03 Mohammad Salimibeni , Arash Mohammadi , Parvin Malekzadeh , Konstantinos N. Plataniotis

The extended Kalman filter is perhaps the most standard tool to estimate in real time the state of a dynamical system from noisy measurements of some function of the system, with extensive practical applications (such as position tracking…

Optimization and Control · Mathematics 2019-01-04 Yann Ollivier