English
Related papers

Related papers: Newton Optimization on Helmholtz Decomposition for…

200 papers

Many economic games and machine learning approaches can be cast as competitive optimization problems where multiple agents are minimizing their respective objective function, which depends on all agents' actions. While gradient descent is a…

Machine Learning · Computer Science 2021-11-17 Jeffrey Ma , Alistair Letcher , Florian Schäfer , Yuanyuan Shi , Anima Anandkumar

Aiming to provide a new class of game dynamics with good long-term rationality properties, we derive a second-order inertial system that builds on the widely studied "heavy ball with friction" optimization method. By exploiting a well-known…

Optimization and Control · Mathematics 2015-03-03 Rida Laraki , Panayotis Mertikopoulos

In this paper, we present a novel Newton-based extremum seeking controller for the solution of multivariable model-free optimization problems in static maps. Unlike existing asymptotic and fixed-time results in the literature, we present a…

Optimization and Control · Mathematics 2020-12-25 Jorge I. Poveda , Miroslav Krstic

This article presents a "Hybrid Self-Attention NEAT" method to improve the original NeuroEvolution of Augmenting Topologies (NEAT) algorithm in high-dimensional inputs. Although the NEAT algorithm has shown a significant result in different…

Neural and Evolutionary Computing · Computer Science 2023-06-21 Saman Khamesian , Hamed Malek

Multiview representation learning is very popular for latent factor analysis. It naturally arises in many data analysis, machine learning, and information retrieval applications to model dependent structures among multiple data sources. For…

Machine Learning · Computer Science 2019-09-17 Zhehui Chen , Lin F. Yang , Chris J. Li , Tuo Zhao

In this paper has been considered probability-one global convergence of NFPH (Newton-Fixed Point Homotopy) algorithm for system of nonlinear equations and has been proposed a probability-one homotopy algorithm to solve a regularized…

Optimization and Control · Mathematics 2012-07-06 Yunchol Jong , Wonil Kim

The study of Newton's method in complex-valued neural networks faces many difficulties. In this paper, we derive Newton's method backpropagation algorithms for complex-valued holomorphic multilayer perceptrons, and investigate the…

Complex Variables · Mathematics 2014-06-23 Diana Thomson La Corte , Yi Ming Zou

In this paper, we propose a quasi-Newton method for solving smooth and monotone nonlinear equations, including unconstrained minimization and minimax optimization as special cases. For the strongly monotone setting, we establish two global…

Optimization and Control · Mathematics 2024-10-04 Ruichen Jiang , Aryan Mokhtari

We consider online learning in multi-player smooth monotone games. Existing algorithms have limitations such as (1) being only applicable to strongly monotone games; (2) lacking the no-regret guarantee; (3) having only asymptotic or slow…

Machine Learning · Computer Science 2023-09-06 Yang Cai , Weiqiang Zheng

In the theory of multi-agent systems, deception refers to the strategic manipulation of information to influence the behavior of other agents, ultimately altering the long-term dynamics of the entire system. Recently, this concept has been…

Systems and Control · Electrical Eng. & Systems 2025-08-27 Michael Tang , Miroslav Krstic , Jorge Poveda

Designing efficient and high-accuracy numerical methods for complex dynamic incompressible magnetohydrodynamics (MHD) equations remains a challenging problem in various analysis and design tasks. This is mainly due to the nonlinear coupling…

Numerical Analysis · Mathematics 2023-11-28 Xiaofei Guan , Boya Hu , Shipeng Mao , Xintong Wang , Zihao Yang

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent…

Machine Learning · Computer Science 2023-10-19 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

This paper investigates the equilibrium convergence properties of a proposed algorithm for potential games with continuous strategy spaces in the presence of feedback delays, a main challenge in multi-agent systems that compromises the…

Optimization and Control · Mathematics 2023-03-20 Yuanhanqing Huang , Jianghai Hu

We develop efficient and high-order accurate solvers for the Helmholtz equation on complex geometry. The schemes are based on the WaveHoltz algorithm which computes solutions of the Helmholtz equation by time-filtering solutions of the wave…

Numerical Analysis · Mathematics 2025-04-07 Daniel Appelo , Jeffrey W. Banks , William D. Henshaw , Donald W. Schwendeman

This paper studies two fundamental problems in regularized Graphon Mean-Field Games (GMFGs). First, we establish the existence of a Nash Equilibrium (NE) of any $\lambda$-regularized GMFG (for $\lambda\geq 0$). This result relies on weaker…

Computer Science and Game Theory · Computer Science 2023-10-13 Fengzhuo Zhang , Vincent Y. F. Tan , Zhaoran Wang , Zhuoran Yang

This paper addresses the problem of learning an equilibrium efficiently in general-sum Markov games through decentralized multi-agent reinforcement learning. Given the fundamental difficulty of calculating a Nash equilibrium (NE), we…

Machine Learning · Computer Science 2022-02-01 Weichao Mao , Tamer Başar

Nash equilibrium is a central concept in game theory. Several Nash solvers exist, yet none scale to normal-form games with many actions and many players, especially those with payoff tensors too big to be stored in memory. In this work, we…

Computer Science and Game Theory · Computer Science 2022-02-07 Ian Gemp , Rahul Savani , Marc Lanctot , Yoram Bachrach , Thomas Anthony , Richard Everett , Andrea Tacchetti , Tom Eccles , János Kramár

The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to be found, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for…

Neural and Evolutionary Computing · Computer Science 2023-12-14 Xin-long Luo , Hang Xiao , Sen Zhang

Many multiagent systems in the real world include multiple types of agents with different abilities and functionality. Such heterogeneous multiagent systems have significant practical advantages. However, they also come with challenges…

Machine Learning · Computer Science 2023-05-30 Qingxu Fu , Xiaolin Ai , Jianqiang Yi , Tenghai Qiu , Wanmai Yuan , Zhiqiang Pu