English
Related papers

Related papers: GRASP: Gradient Realignment via Active Shared Perc…

200 papers

Learning in multi-agent environments is difficult due to the non-stationarity introduced by an opponent's or partner's changing behaviors. Instead of reactively adapting to the other agent's (opponent or partner) behavior, we propose an…

Robotics · Computer Science 2021-10-18 Woodrow Z. Wang , Andy Shih , Annie Xie , Dorsa Sadigh

Self-adaptive systems are capable of adjusting their behavior to cope with the changes in environment and itself. These changes may cause runtime uncertainty, which refers to the system state of failing to achieve appropriate…

Software Engineering · Computer Science 2017-04-11 Zhuoqun Yang , Wei Zhang , Haiyan Zhao , Zhi Jin

DCOP algorithms usually rely on interaction graphs to operate. In open and dynamic environments, such methods need to address how this interaction graph is generated and maintained among agents. Existing methods require reconstructing the…

Artificial Intelligence · Computer Science 2022-12-08 Brighter Agyemang , Fenghui Ren , Jun Yan

In future intelligent transportation systems, autonomous cooperative planning (ACP), becomes a promising technique to increase the effectiveness and security of multi-vehicle interactions. However, multiple uncertainties cannot be fully…

Robotics · Computer Science 2026-04-23 Shiyao Zhang , Liwei Deng , Shuyu Zhang , Weijie Yuan , Hong Zhang

Problems arise when using reward functions to capture dependencies between sequential time-constrained goal states because the state-space must be prohibitively expanded to accommodate a history of successfully achieved sub-goals. Also,…

Artificial Intelligence · Computer Science 2019-02-13 Thomas J. Ringstrom , Paul R. Schrater

Distributed aggregative optimization is a recently emerged framework in which the agents of a network want to minimize the sum of local objective functions, each one depending on the agent decision variable (e.g., the local position of a…

Optimization and Control · Mathematics 2024-04-08 Guido Carnevale , Nicola Mimmo , Giuseppe Notarstefano

This paper presents an adaptive combination strategy for distributed learning over diffusion networks. Since learning relies on the collaborative processing of the stochastic information at the dispersed agents, the overall performance can…

Multiagent Systems · Computer Science 2020-10-27 Y. Efe Erginbas , Stefan Vlaski , Ali H. Sayed

Grokking is the phenomenon whereby, unlike the training performance, which peaks early in the training process, the test/generalization performance of a model stagnates over arbitrarily many epochs and then suddenly jumps to usually close…

Machine Learning · Computer Science 2026-05-19 Ali Saheb Pasand , Elvis Dohmatob

Distributed descent-based methods are an essential toolset to solving optimization problems in multi-agent system scenarios. Here the agents seek to optimize a global objective function through mutual cooperation. Oftentimes, cooperation is…

Optimization and Control · Mathematics 2019-08-28 Arunselvan Ramaswamy

Grasping unknown objects in unstructured environments is a critical challenge for service robots, which must operate in dynamic, real-world settings such as homes, hospitals, and warehouses. Success in these environments requires both…

Robotics · Computer Science 2026-02-17 Avihai Giuili , Rotem Atari , Avishai Sintov

Reinforcement learning algorithms rely on exploration to discover new behaviors, which is typically achieved by following a stochastic policy. In continuous control tasks, policies with a Gaussian distribution have been widely adopted.…

Machine Learning · Computer Science 2019-03-28 Dmytro Korenkevych , A. Rupam Mahmood , Gautham Vasan , James Bergstra

In urban planning, land use readjustment plays a pivotal role in aligning land use configurations with the current demands for sustainable urban development. However, present-day urban planning practices face two main issues. Firstly, land…

Artificial Intelligence · Computer Science 2023-11-10 Kejiang Qian , Lingjun Mao , Xin Liang , Yimin Ding , Jin Gao , Xinran Wei , Ziyi Guo , Jiajie Li

In the realm of multi-agent systems, the challenge of \emph{partial observability} is a critical barrier to effective coordination and decision-making. Existing approaches, such as belief state estimation and inter-agent communication,…

Artificial Intelligence · Computer Science 2026-02-18 Yiqin Yang , Xu Yang , Yuhua Jiang , Ni Mu , Hao Hu , Runpeng Xie , Ziyou Zhang , Siyuan Li , Yuan-Hua Ni , Qianchuan Zhao , Bo Xu

In cooperative multi-agent reinforcement learning (MARL), the permutation problem where the state space grows exponentially with the number of agents reduces sample efficiency. Additionally, many existing architectures struggle with…

Machine Learning · Computer Science 2025-03-18 Hyunwoo Park , Baekryun Seong , Sang-Ki Ko

Cooperative multi-agent systems require robust mechanisms for credit assignment under uncertainty. Here we introduce a variational framework, termed the Game-Theoretic Free Energy Principle (GT-FEP), that models coalition formation through…

Computer Science and Game Theory · Computer Science 2026-05-27 Djamel Bouchaffra , Faycal Ykhlef , Mustapha Lebbah , Hanane Azzag

We develop a dynamic generalized conditional gradient method (DGCG) for dynamic inverse problems with optimal transport regularization. We consider the framework introduced in (Bredies and Fanzon, ESAIM: M2AN, 54:2351-2382, 2020), where the…

Numerical Analysis · Mathematics 2023-08-16 Kristian Bredies , Marcello Carioni , Silvio Fanzon , Francisco Romero

We study policy gradient methods for reinforcement learning in non-Markovian decision processes (NMDPs), where observations and rewards depend on the entire interaction history. To handle this dependence, the agent maintains an internal…

Machine Learning · Computer Science 2026-05-12 Avik Kar , Siddharth Chandak , Rahul Singh , Soumitra Sinhahajari , Eric Moulines , Shalabh Bhatnagar , Nicholas Bambos

Ranking is a fundamental and widely studied problem in scenarios such as search, advertising, and recommendation. However, joint optimization for multi-scenario ranking, which aims to improve the overall performance of several ranking…

Artificial Intelligence · Computer Science 2018-09-18 Jun Feng , Heng Li , Minlie Huang , Shichen Liu , Wenwu Ou , Zhirong Wang , Xiaoyan Zhu

While the optimization landscape of policy gradient methods has been recently investigated for partially observed linear systems in terms of both static output feedback and dynamical controllers, they only provide convergence guarantees to…

Optimization and Control · Mathematics 2023-04-25 Feiran Zhao , Xingyun Fu , Keyou You

Autonomous agents rely on sensor data to construct representations of their environments, essential for predicting future events and planning their actions. However, sensor measurements suffer from limited range, occlusions, and sensor…