English
Related papers

Related papers: TVDO: Tchebycheff Value-Decomposition Optimization…

200 papers

Time-distributed Optimization (TDO) is an approach for reducing the computational burden of Model Predictive Control (MPC). When using TDO, optimization iterations are distributed over time by maintaining a running solution estimate and…

Optimization and Control · Mathematics 2021-02-25 Dominic Liao-McPherson , Terrence Skibik , Jordan Leung , Ilya Kolmanovsky , Marco M. Nicotra

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

Artificial Intelligence · Computer Science 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

In multi-agent reinforcement learning (MARL), self-interested agents attempt to establish equilibrium and achieve coordination depending on game structure. However, existing MARL approaches are mostly bound by the simultaneous actions of…

Multiagent Systems · Computer Science 2023-12-12 Bin Zhang , Lijuan Li , Zhiwei Xu , Dapeng Li , Guoliang Fan

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

Recent video-language models have shown great potential for video understanding, but still struggle with accurate temporal grounding for event-level perception. We observe that two main factors in video understanding (i.e., temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Wenzheng Zeng , Difei Gao , Mike Zheng Shou , Hwee Tou Ng

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

Computer Science and Game Theory · Computer Science 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

We consider a decision-making problem to find absolute ratings of alternatives that are compared in pairs under multiple criteria, subject to constraints in the form of two-sided bounds on ratios between the ratings. Given matrices of…

Optimization and Control · Mathematics 2024-03-22 Nikolai Krivulin

The recent success of single-agent reinforcement learning (RL) in Internet of things (IoT) systems motivates the study of multi-agent reinforcement learning (MARL), which is more challenging but more useful in large-scale IoT. In this…

Machine Learning · Computer Science 2020-09-01 Yue Xu , Zengde Deng , Mengdi Wang , Wenjun Xu , Anthony Man-Cho So , Shuguang Cui

Value function factorization methods are commonly used in cooperative multi-agent reinforcement learning, with QMIX receiving significant attention. Many QMIX-based methods introduce monotonicity constraints between the joint action value…

Machine Learning · Computer Science 2025-04-11 Chang Huang , Shatong Zhu , Junqiao Zhao , Hongtu Zhou , Chen Ye , Tiantian Feng , Changjun Jiang

In this paper we discuss policy iteration methods for approximate solution of a finite-state discounted Markov decision problem, with a focus on feature-based aggregation methods and their connection with deep reinforcement learning…

Machine Learning · Computer Science 2018-08-23 Dimitri P. Bertsekas

In this paper, we propose a novel model-based multi-agent reinforcement learning approach named Value Decomposition Framework with Disentangled World Model to address the challenge of achieving a common goal of multiple agents interacting…

Machine Learning · Computer Science 2025-09-29 Zhizun Wang , David Meger

Multi-agent credit assignment is a fundamental challenge for cooperative multi-agent reinforcement learning (MARL), where a team of agents learn from shared reward signals. The Individual-Global-Max (IGM) condition is a widely used…

Machine Learning · Computer Science 2026-02-04 Wen-Tse Chen , Yuxuan Li , Shiyu Huang , Jiayu Chen , Jeff Schneider

Multi-agent reinforcement learning (MARL) requires agents to explore within a vast joint action space to find joint actions that lead to coordination. Existing value-based MARL algorithms commonly rely on random exploration, such as…

Multiagent Systems · Computer Science 2025-02-10 Lukas Schäfer , Oliver Slumbers , Stephen McAleer , Yali Du , Stefano V. Albrecht , David Mguni

Optimizing static risk-averse objectives in Markov decision processes is difficult because they do not admit standard dynamic programming equations common in Reinforcement Learning (RL) algorithms. Dynamic programming decompositions that…

Optimization and Control · Mathematics 2024-07-04 Jia Lin Hau , Erick Delage , Mohammad Ghavamzadeh , Marek Petrik

In this paper, we derive optimality conditions (Chebyshev approximation) for multivariate functions. The theory of Chebyshev (uniform) approximation for univariate functions is very elegant. The optimality conditions are based on the notion…

Optimization and Control · Mathematics 2015-10-22 Nadezda Sukhorukova , Julien Ugon , David Yost

In this paper, we propose Total Variation Regularized Tensor-on-scalar Regression(TVTR), a novel method for estimating the association between a tensor outcome (a one dimensional or multidimensional array) and scalar predictors. While the…

Methodology · Statistics 2018-12-11 Ying Liu , Bowei Yan , Kathleen Merikangas , Haochang Shou

In a multi-agent environment, In order to overcome and alleviate the non-stationarity of the multi-agent environment, the mainstream method is to adopt the framework of Centralized Training Decentralized Execution (CTDE). This thesis is…

Multiagent Systems · Computer Science 2023-05-30 Zeng Da

Current multimodal large language models (MLLMs) struggle with fine-grained or precise understanding of visuals although they give comprehensive perception and reasoning in a spectrum of vision applications. Recent studies either develop…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ziang Yan , Zhilin Li , Yinan He , Chenting Wang , Kunchang Li , Xinhao Li , Xiangyu Zeng , Zilei Wang , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Non-independent and identically distributed (Non-IID) data across edge clients have long posed significant challenges to federated learning (FL) training in edge computing environments. Prior works have proposed various methods to mitigate…

Machine Learning · Computer Science 2025-04-25 Weijie Liu , Ziwei Zhan , Carlee Joe-Wong , Edith Ngai , Jingpu Duan , Deke Guo , Xu Chen , Xiaoxi Zhang

We present the first finite time global convergence analysis of policy gradient in the context of infinite horizon average reward Markov decision processes (MDPs). Specifically, we focus on ergodic tabular MDPs with finite state and action…

Machine Learning · Computer Science 2024-03-12 Navdeep Kumar , Yashaswini Murthy , Itai Shufaro , Kfir Y. Levy , R. Srikant , Shie Mannor