English
Related papers

Related papers: Harnessing the Power of Gradient-Based Simulations…

200 papers

Particle accelerators require constant tuning during operation to meet beam quality, total charge and particle energy requirements for use in a wide variety of physics, chemistry and biology experiments. Maximizing the performance of an…

Accelerator Physics · Physics 2021-06-16 Ryan Roussel , Adi Hanuka , Auralee Edelen

Reinforcement learning (RL) has emerged as a powerful approach for tackling complex problems. The recent introduction of multi-objective reinforcement learning (MORL) has further expanded the scope of RL by enabling agents to make…

Machine Learning · Computer Science 2023-10-26 Florian Felten , Daniel Gareev , El-Ghazali Talbi , Grégoire Danoy

In this paper, the problem of pilot contamination in a multi-cell massive multiple input multiple output (M-MIMO) system is addressed using deep reinforcement learning (DRL). To this end, a pilot assignment strategy is designed that adapts…

Signal Processing · Electrical Eng. & Systems 2021-03-26 Yasaman Omid , Seyed MohammadReza Hosseini , Seyyed MohammadMahdi Shahabi , Mohammad Shikh-Bahaei , Arumugam Nallanathan

Deep Reinforcement Learning (DRL) has been successfully applied in several research domains such as robot navigation and automated video game playing. However, these methods require excessive computation and interaction with the…

Machine Learning · Computer Science 2020-04-07 Ayberk Aydın , Elif Surer

Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with…

Robotics · Computer Science 2023-09-15 Lingfeng Tao , Jiucai Zhang , Xiaoli Zhang

Bilevel Optimization has witnessed notable progress recently with new emerging efficient algorithms and has been applied to many machine learning tasks such as data cleaning, few-shot learning, and neural architecture search. However,…

Machine Learning · Computer Science 2022-05-04 Junyi Li , Feihu Huang , Heng Huang

Multi-objective reinforcement learning (MORL) is the generalization of standard reinforcement learning (RL) approaches to solve sequential decision making problems that consist of several, possibly conflicting, objectives. Generally, in…

Artificial Intelligence · Computer Science 2019-10-08 Xi Chen , Ali Ghadirzadeh , Mårten Björkman , Patric Jensfelt

Reinforcement Learning (RL) is used extensively in Autonomous Systems (AS) as it enables learning at runtime without the need for a model of the environment or predefined actions. However, most applications of RL in AS, such as those based…

Artificial Intelligence · Computer Science 2024-10-01 Juan C. Rosero , Ivana Dusparic , Nicolás Cardozo

This paper introduces a new scalable multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We develop a high-performance MODRL framework that supports both single-policy and multi-policy strategies, as well…

Machine Learning · Computer Science 2020-09-09 Thanh Thi Nguyen , Ngoc Duy Nguyen , Peter Vamplew , Saeid Nahavandi , Richard Dazeley , Chee Peng Lim

PDE-Constrained Optimization (PDECO) problems can be accelerated significantly by employing gradient-based methods with surrogate models like neural operators compared to traditional numerical solvers. However, this approach faces two key…

Machine Learning · Computer Science 2025-06-17 Ze Cheng , Zhuoyu Li , Xiaoqiang Wang , Jianing Huang , Zhizhou Zhang , Zhongkai Hao , Hang Su

Deep reinforcement learning (DRL) has shown great promise in addressing multi-objective combinatorial optimization problems (MOCOPs). Nevertheless, the robustness of these learning-based solvers has remained insufficiently explored,…

Machine Learning · Computer Science 2026-01-06 Wei Liu , Yaoxin Wu , Yingqian Zhang , Thomas Bäck , Yingjie Fan

Optimization of beamlines and lattices is a common problem in accelerator physics, which is usually solved with semi-analytical methods and numerical optimization routines. However, these are usually of the gradient-free or…

Accelerator Physics · Physics 2025-07-14 Francisco Huhn , Francesco M. Velotti

Particle robots are novel biologically-inspired robotic systems where locomotion can be achieved collectively and robustly, but not independently. While its control is currently limited to a hand-crafted policy for basic locomotion tasks,…

Robotics · Computer Science 2025-05-12 Jeremy Shen , Erdong Xiao , Yuchen Liu , Chen Feng

Deep reinforcement learning (DRL) has successfully solved various problems recently, typically with a unimodal policy representation. However, grasping distinguishable skills for some tasks with non-unique optima can be essential for…

Machine Learning · Computer Science 2021-04-20 Jie Ren , Yewen Li , Zihan Ding , Wei Pan , Hao Dong

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

Multi-objective optimization (MOO) lies at the core of many machine learning (ML) applications that involve multiple, potentially conflicting objectives (e.g., multi-task learning, multi-objective reinforcement learning, among many others).…

Machine Learning · Computer Science 2024-12-18 Mingjing Xu , Peizhong Ju , Jia Liu , Haibo Yang

Deep reinforcement learning (RL) has been applied extensively to solve complex decision-making problems. In many real-world scenarios, tasks often have several conflicting objectives and may require multiple agents to cooperate, which are…

Artificial Intelligence · Computer Science 2026-03-03 Tianmeng Hu , Biao Luo , Chunhua Yang , Tingwen Huang

There is growing interest in reinforcement learning (RL) methods that leverage the simulator's derivatives to improve learning efficiency. While early gradient-based approaches have demonstrated superior performance compared to…

Robotics · Computer Science 2025-09-05 Joseph Amigo , Rooholla Khorrambakht , Elliot Chane-Sane , Nicolas Mansard , Ludovic Righetti

Robot design optimization, imitation learning and system identification share a common problem which requires optimization over robot or task parameters at the same time as optimizing the robot motion. To solve these problems, we can use…

Robotics · Computer Science 2022-09-05 Traiko Dinev , Carlos Mastalli , Vladimir Ivan , Steve Tonneau , Sethu Vijayakumar

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic