English
Related papers

Related papers: Robust Exploration in Directed Controller Synthesi…

200 papers

Mixture-of-Experts (MoE) architectures have emerged as a cornerstone of modern AI systems. In particular, MoEs route inputs dynamically to specialized experts whose outputs are aggregated through weighted summation. Despite their widespread…

Machine Learning · Computer Science 2025-10-09 Fangshuo Liao , Anastasios Kyrillidis

Fast Adversarial Training (FAT) has proven effective in enhancing model robustness by encouraging networks to learn perturbation-invariant representations. However, FAT often suffers from catastrophic overfitting (CO), where the model…

Machine Learning · Computer Science 2026-04-28 Mengnan Zhao , Lihe Zhang , Bo Wang , Tianhang Zheng , Hong Zhong , Geyong Min

Overtaking on two-lane roads is a great challenge for autonomous vehicles, as oncoming traffic appearing on the opposite lane may require the vehicle to change its decision and abort the overtaking. Deep reinforcement learning (DRL) has…

Robotics · Computer Science 2023-08-21 Jinxiong Lu , Gokhan Alcan , Ville Kyrki

We study the robustness of deep reinforcement learning algorithms against distribution shifts within contextual multi-stage stochastic combinatorial optimization problems from the operations research domain. In this context, risk-sensitive…

Machine Learning · Computer Science 2024-02-16 Tobias Enders , James Harrison , Maximilian Schiffer

Deep Reinforcement Learning has enabled the control of increasingly complex and high-dimensional problems. However, the need of vast amounts of data before reasonable performance is attained prevents its widespread application. We employ…

Machine Learning · Computer Science 2020-04-08 Jan Scholten , Daan Wout , Carlos Celemin , Jens Kober

Attitude control of a novel regional truss-braced wing aircraft with low stability characteristics is addressed in this paper using Reinforcement Learning (RL). In recent years, RL has been increasingly employed in challenging applications,…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Mohsen Zahmatkesh , Seyyed Ali Emami , Afshin Banazadeh , Paolo Castaldi

Controller synthesis is a formal method approach for automatically generating Labeled Transition System (LTS) controllers that satisfy specified properties. The efficiency of the synthesis process, however, is critically dependent on…

Artificial Intelligence · Computer Science 2025-12-18 Toshihide Ubukata , Enhong Mu , Takuto Yamauchi , Mingyue Zhang , Jialong Li , Kenji Tei

A collective flashing ratchet transports Brownian particles using a spatially periodic, asymmetric, and time-dependent on-off switchable potential. The net current of the particles in this system can be substantially increased by feedback…

Machine Learning · Computer Science 2021-04-14 Dong-Kyum Kim , Hawoong Jeong

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

Machine Learning · Computer Science 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi

Despite success in many challenging problems, reinforcement learning (RL) is still confronted with sample inefficiency, which can be mitigated by introducing prior knowledge to agents. However, many transfer techniques in reinforcement…

Machine Learning · Computer Science 2022-09-21 Matheus Centa , Philippe Preux

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

Although quadcopters boast impressive traversal capabilities enabled by their omnidirectional maneuverability, the need for continuous pilot control in complex environments impedes their application in GNSS and telemetry-denied scenarios.…

Robotics · Computer Science 2026-05-26 Shiladitya Dutta , Aayush Gupta , Varun Saran , Avideh Zakhor

Deep reinforcement learning (DRL) policies have been shown to be deceived by perturbations (e.g., random noise or intensional adversarial attacks) on state observations that appear at test time but are unknown during training. To increase…

Machine Learning · Computer Science 2020-12-25 Xinghua Qu , Yew-Soon Ong , Abhishek Gupta , Zhu Sun

Dense embeddings are fundamental to modern machine learning systems, powering Retrieval-Augmented Generation (RAG), information retrieval, and representation learning. While instruction-conditioning has become the dominant approach for…

Machine Learning · Computer Science 2025-06-24 Miguel Romero , Shuoyang Ding , Corey D. Barret , Georgiana Dinu , George Karypis

When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alone can achieve. However, vision-enabled policies tend to…

Robotics · Computer Science 2026-05-29 Victor Kowalski , Chengxi Li , Dongheui Lee

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

The use of deep neural networks in reinforcement learning (RL) often suffers from performance degradation as model size increases. While soft mixtures of experts (SoftMoEs) have recently shown promise in mitigating this issue for online RL,…

Machine Learning · Computer Science 2025-02-28 Ghada Sokar , Johan Obando-Ceron , Aaron Courville , Hugo Larochelle , Pablo Samuel Castro

A long-cherished vision of drones is to autonomously traverse through clutter to reach every corner of the world using onboard sensing and computation. In this paper, we combine onboard 3D lidar sensing and sim-to-real reinforcement…

Robotics · Computer Science 2025-03-04 Guangtong Xu , Tianyue Wu , Zihan Wang , Qianhao Wang , Fei Gao