中文
相关论文

相关论文: Conflict-Averse Gradient Aggregation for Constrain…

200 篇论文

Lagrangian methods are widely used algorithms for constrained optimization problems, but their learning dynamics exhibit oscillations and overshoot which, when applied to safe reinforcement learning, leads to constraint-violating behavior…

最优化与控制 · 数学 2020-07-09 Adam Stooke , Joshua Achiam , Pieter Abbeel

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

机器学习 · 计算机科学 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč

Studies have shown that multi-objective optimization problems are hard problems. Such problems either require longer time to converge to an optimum solution, or may not converge at all. Recently some researchers have claimed that real…

神经与进化计算 · 计算机科学 2014-06-11 Shahab U. Ansari , Sameen Mansha

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

机器学习 · 计算机科学 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

Lexicographic multi-objective problems, which consist of multiple conflicting subtasks with explicit priorities, are common in real-world applications. Despite the advantages of Reinforcement Learning (RL) in single tasks, extending…

机器学习 · 计算机科学 2025-11-12 Ruiyu Qiu , Rui Wang , Guanghui Yang , Xiang Li , Zhijiang Shao

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

机器学习 · 计算机科学 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Transmission grid congestion increases as the electrification of various sectors requires transmitting more power. Topology control, through substation reconfiguration, can reduce congestion but its potential remains under-exploited in…

机器学习 · 计算机科学 2025-05-02 Thomas Lautenbacher , Ali Rajaei , Davide Barbieri , Jan Viebahn , Jochen L. Cremer

Training a unified model to take multiple targets into account is a trend towards artificial general intelligence. However, how to efficiently mitigate the training conflicts among heterogeneous data collected from different domains or…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Yuhang Zhou , Zihua Zhao , Haolin Li , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

In this paper, we propose a harmonized rotational gradient method, termed HRGrad, for simultaneously tackling multiscale time-dependent kinetic problems with varying small parameters. These parameters exhibit asymptotic transitions from…

机器学习 · 计算机科学 2026-04-28 Zhangyong Liang

Deploying Vision-Language-Action (VLA) models in real-world robotics exposes a core multi-task learning challenge: reconciling task interference in multi-task robotic learning. When multiple tasks are jointly fine-tuned in a single stage,…

机器人学 · 计算机科学 2026-03-11 Yuankai Luo , Woping Chen , Tong Liang , Zhenguo Li

Coordination among connected and autonomous vehicles (CAVs) is advancing due to developments in control and communication technologies. However, much of the current work is based on oversimplified and unrealistic task-specific assumptions,…

多智能体系统 · 计算机科学 2024-10-25 Rui Du , Kai Zhao , Jinlong Hou , Qiang Zhang , Peter Zhang

Merely pursuing performance may adversely affect the safety, while a conservative policy for safe exploration will degrade the performance. How to balance the safety and performance in learning-based control problems is an interesting yet…

系统与控制 · 电气工程与系统科学 2025-01-28 Xinyang Wang , Hongwei Zhang , Shimin Wang , Wei Xiao , Martin Guay

Policy gradient (PG) methods are popular reinforcement learning (RL) methods where a baseline is often applied to reduce the variance of gradient estimates. In multi-agent RL (MARL), although the PG theorem can be naturally extended, the…

Existing studies on constrained reinforcement learning (RL) may obtain a well-performing policy in the training environment. However, when deployed in a real environment, it may easily violate constraints that were originally satisfied…

机器学习 · 计算机科学 2024-05-06 Zhongchang Sun , Sihong He , Fei Miao , Shaofeng Zou

Ensuring the safety of Reinforcement Learning (RL) is crucial for its deployment in real-world applications. Nevertheless, managing the trade-off between reward and safety during exploration presents a significant challenge. Improving…

机器学习 · 计算机科学 2025-03-04 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Ming Jin , Alois Knoll

Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure. One reason lies in the insufficient training due to the asynchronous gradient…

计算机视觉与模式识别 · 计算机科学 2020-06-17 Li'an Zhuo , Baochang Zhang , Linlin Yang , Hanlin Chen , Qixiang Ye , David Doermann , Guodong Guo , Rongrong Ji

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

机器学习 · 计算机科学 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Combinatorial optimization problems (COPs) on the graph with real-life applications are canonical challenges in Computer Science. The difficulty of finding quality labels for problem instances holds back leveraging supervised learning…

机器学习 · 计算机科学 2021-08-10 Mostafa Pashazadeh , Kui Wu

When different objectives conflict with each other in multi-task learning, gradients begin to interfere and slow convergence, thereby potentially reducing the final model's performance. To address this, we introduce SON-GOKU, a scheduler…

机器学习 · 计算机科学 2025-12-10 Santosh Patapati

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

机器人学 · 计算机科学 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams