English
Related papers

Related papers: Forward-backward-forward dynamics for bilevel equi…

200 papers

We propose a novel dynamical framework for solving inclusion problems of the form \(0 \in F(x) + G(x)\) in Hilbert spaces, where \(F\) is a maximal set-valued operator and \(G\) is a single-valued mapping. The analysis is conducted under a…

Optimization and Control · Mathematics 2026-01-29 Nam Van Tran

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

In this work, we propose an observation system based on the available data which solution is one-be-one mapping to the forward problem(with the unknown initial function) solution. It implies their solutions share the same linear structure…

Numerical Analysis · Mathematics 2026-04-27 Dakang Cen , Zhiyuan Li , Wenlong Zhang

Saddle point problems arise in many important practical applications. In this paper we propose and analyze some algorithms for solving symmetric saddle point problems which are based upon the block Gram-Schmidt method. In particular, we…

Numerical Analysis · Mathematics 2013-12-19 Felicja Okulicka-Dłużewska , Alicja Smoktunowicz

This paper presents a model-based balance stabilization system which takes into account not only the stable part of COM dynamics but also the unstable part. In this system, the overall dynamics of a humanoid robot is approximated using a…

Robotics · Computer Science 2019-06-06 Mohammadreza Kasaei , Nuno Lau , Artur Pereira

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

In a Hilbert setting, we introduce a new dynamical system and associated algorithms for solving monotone inclusions by rapid methods. Given a maximal monotone operator $A$, the evolution is governed by the time dependent operator $I -(I +…

Optimization and Control · Mathematics 2015-04-20 Hedy Attouch , Maicon Marques Alves , Benar F. Svaiter

We study the block-coordinate forward-backward algorithm in which the blocks are updated in a random and possibly parallel manner, according to arbitrary probabilities. The algorithm allows different stepsizes along the block-coordinates to…

Optimization and Control · Mathematics 2020-11-30 Saverio Salzo , Silvia Villa

In this paper, we mainly focus on solving high-dimensional stochastic Hamiltonian systems with boundary condition, which is essentially a Forward Backward Stochastic Differential Equation (FBSDE in short), and propose a novel method from…

Optimization and Control · Mathematics 2021-12-13 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

We investigate two inertial forward-backward algorithms in connection with the minimization of the sum of a non-smooth and possibly non-convex and a non-convex differentiable function. The algorithms are formulated in the spirit of the…

Functional Analysis · Mathematics 2021-01-20 Szilárd Csaba László

Bilevel optimization and bilevel minimax optimization have recently emerged as unifying frameworks for a range of machine-learning tasks, including hyperparameter optimization and reinforcement learning. The existing literature focuses on…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Peipei Yuan

We present a forward-backward-based algorithm to minimize a sum of a differentiable function and a nonsmooth function, both being possibly nonconvex. The main contribution of this work is to consider the challenging case where the nonsmooth…

Optimization and Control · Mathematics 2021-02-02 Audrey Repetti , Yves Wiaux

We propose a new algorithm to approach weakly the solution of a McKean-Vlasov SDE. Based on the cubature method of Lyons and Victoir 2004, the algorithm is deterministic differing from the the usual methods based on interacting particles.…

Probability · Mathematics 2019-04-22 Paul-Eric Chaudru de Raynal , Camilo Garcia Trillos

This paper study the two--phase problem for the forward-backward parabolic equation with diffusion function of cubic type. Existence and uniqueness for these kind of problems were obtained in literature in the case in which the phases are…

Analysis of PDEs · Mathematics 2019-07-25 Andrea Terracina

Motivated by the training of Generative Adversarial Networks (GANs), we study methods for solving minimax problems with additional nonsmooth regularizers. We do so by employing \emph{monotone operator} theory, in particular the…

Optimization and Control · Mathematics 2020-06-17 Axel Böhm , Michael Sedlmayer , Ernö Robert Csetnek , Radu Ioan Boţ

We present several topics involving the computation of dynamical systems. The emphasis is on work in progress and the presentation is informal -- there are many technical details which are not fully discussed. The topics are chosen to…

chao-dyn · Physics 2008-02-03 John Guckenheimer , Patrick Worfolk

This paper presents a modified iterative approach to solve the variational inequality problem using the double inertial technique in the context of a real Hilbert space. Our iterative technique involves a projection onto a generalized…

Functional Analysis · Mathematics 2026-03-19 Watanjeet Singh , Sumit Chandok

In this work we present an application of modern deep learning methodologies to the numerical solution of partial differential equations in transport models. More specifically, we employ a supervised deep neural network that takes into…

Numerical Analysis · Mathematics 2021-02-10 Eduardo Abreu , Joao B. Florindo

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset