English
Related papers

Related papers: QuaDUE-CCM: Interpretable Distributional Reinforce…

200 papers

We propose a robust nonlinear model predictive control (MPC) scheme for trajectory-tracking control of autonomous vehicles at the limits of handling on non-planar road surfaces. We derive the dynamics from first principles and selectively…

Systems and Control · Electrical Eng. & Systems 2026-04-22 Joscha F. Bongard , Georg Jank , Simon Sagmeister , Boris Lohmann

This paper studies the kinematic tracking control problem for aerial manipulators. Existing kinematic tracking control methods, which typically employ proportional-derivative feedback or tracking-error-based feedback strategies, may fail to…

Robotics · Computer Science 2026-01-21 Huazi Cao , Jiahao Shen , Zhengzhen Li , Qinquan Ren , Shiyu Zhao

We analyse quantile temporal-difference learning (QTD), a distributional reinforcement learning algorithm that has proven to be a key component in several successful large-scale applications of reinforcement learning. Despite these…

Visual Multi-Object Tracking (MOT) is a crucial component of robotic perception, yet existing Tracking-By-Detection (TBD) methods often rely on 2D cues, such as bounding boxes and motion modeling, which struggle under occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Buyin Deng , Lingxin Huang , Kai Luo , Fei Teng , Kailun Yang

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

This paper presents a round-trip strategy of multirotors subject to unknown flow disturbances. During the outbound flight, the vehicle immediately utilizes the wind disturbance estimations in feedback control, as an attempt to reduce the…

Robotics · Computer Science 2021-06-11 Jaeseung Byun , Simo A. Mäkiharju , Mark W. Mueller

Uncertainties in the environment and behavior model inaccuracies compromise the state estimation of a dynamic obstacle and its trajectory predictions, introducing biases in estimation and shifts in predictive distributions. Addressing these…

Robotics · Computer Science 2024-07-30 Minjun Sung , Hunmin Kim , Naira Hovakimyan

This paper presents novel method for distribution-free robust trajectory optimization and control of discrete-time, nonlinear, and non-Gaussian stochastic systems, with closed-loop guarantees on chance constraint satisfaction. Our framework…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Rihan Aaron D'Silva , Hiroyasu Tsukamoto

A key open challenge in agile quadrotor flight is how to combine the flexibility and task-level generality of model-free reinforcement learning (RL) with the structure and online replanning capabilities of model predictive control (MPC),…

Robotics · Computer Science 2026-01-21 Angel Romero , Elie Aljalbout , Yunlong Song , Davide Scaramuzza

Offline reinforcement learning (RL) aims to learn an effective policy from a pre-collected dataset. Most existing works are to develop sophisticated learning algorithms, with less emphasis on improving the data collection process. Moreover,…

Machine Learning · Computer Science 2023-12-20 Chenyu Sun , Hangwei Qian , Chunyan Miao

In control problems for insect-scale direct-drive experimental platforms under tandem wing influence, the primary challenge facing existing reinforcement learning models is their limited safety in the exploration process and the stability…

Artificial Intelligence · Computer Science 2024-05-24 Minghao Zhang , Bifeng Song , Changhao Chen , Xinyu Lang

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Selected, recent results, primarily from collider experiments but including some fixed target experiments, are presented as a survey of Quantum Chromodynamics (QCD). The concepts of leading order and next-to-leading order QCD are…

High Energy Physics - Experiment · Physics 2011-03-23 Gerald C. Blazey

Mechanical Ventilation (MV) is a critical life-support intervention in intensive care units (ICUs). However, optimal ventilator settings are challenging to determine because of the complexity of balancing patient-specific physiological…

Machine Learning · Computer Science 2024-12-18 Niloufar Eghbali , Tuka Alhanai , Mohammad M. Ghassemi

Constant-curvature Riemannian manifolds (CCMs) have been shown to be ideal embedding spaces in many application domains, as their non-Euclidean geometry can naturally account for some relevant properties of data, like hierarchy and…

Machine Learning · Computer Science 2019-05-27 Daniele Grattarola , Lorenzo Livi , Cesare Alippi

This study presents a learning-based nonlinear algorithm for tracking control of differential-drive mobile robots. The Computed Torque Method (CTM) suffers from inaccurate knowledge of system parameters, while Deep Reinforcement Learning…

Robotics · Computer Science 2025-09-03 Arman Javan Sekhavat Pishkhani

Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Eivind Bøhn , Erlend M. Coates , Dirk Reinhardt , Tor Arne Johansen

Cognitive diagnosis models have been widely used in different areas, especially intelligent education, to measure users' proficiency levels on knowledge concepts, based on which users can get personalized instructions. As the measurement is…

Computers and Society · Computer Science 2024-03-25 Fei Wang , Qi Liu , Enhong Chen , Chuanren Liu , Zhenya Huang , Jinze Wu , Shijin Wang

Numerous studies have focused on learning and understanding the dynamics of physical systems from video data, such as spatial intelligence. Artificial intelligence requires quantitative assessments of the uncertainty of the model to ensure…

Machine Learning · Computer Science 2024-12-18 Aoming Liang , Qi Liu , Lei Xu , Fahad Sohrab , Weicheng Cui , Changhui Song , Moncef Gabbouj

This paper investigates the application of a Model Predictive Controller (MPC) for the cruise control system of a quadrotor, focusing on hovering point stabilization and reference tracking. Initially, a full-state-feedback MPC is designed…

Systems and Control · Electrical Eng. & Systems 2025-04-21 Zekai Chen , Leon Kehler