English
Related papers

Related papers: A Perturbed Value-Function-Based Interior-Point Me…

200 papers

Multi-level methods are widely used for the solution of large-scale problems, because of their computational advantages and exploitation of the complementarity between the involved sub-problems. After a re-interpretation of multi-level…

Machine Learning · Computer Science 2023-05-26 Serge Gratton , Valentin Mercier , Elisa Riccietti , Philippe L. Toint

Bilevel optimization aims to optimize an outer objective function that depends on the solution to an inner optimization problem. It is routinely used in Machine Learning, notably for hyperparameter tuning. The conventional method to compute…

Machine Learning · Computer Science 2024-02-27 Zhenzhang Ye , Gabriel Peyré , Daniel Cremers , Pierre Ablin

The authors' paper in Optimization 63 (2014), 505-533, see Ref. [5], was the first one to provide detailed optimality conditions for pessimistic bilevel optimization. The results there were based on the concept of the two-level optimal…

Optimization and Control · Mathematics 2017-12-06 Stephan Dempe , Boris S. Mordukhovich , Alain B. Zemkoho

Reconstructing unknown external source functions is an important perception capability for a large range of robotics domains including manipulation, aerial, and underwater robotics. In this work, we propose a Physics-Informed Neural Network…

Robotics · Computer Science 2024-11-05 Youngsun Wi , Jayjun Lee , Miquel Oller , Nima Fazeli

Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE…

Machine Learning · Computer Science 2023-04-12 Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Jian Song , Ze Cheng

Parameter estimation for differential equations from measured data is an inverse problem prevalent across quantitative sciences. Physics-Informed Neural Networks (PINNs) have emerged as effective tools for solving such problems, especially…

Machine Learning · Computer Science 2025-04-08 Marius Almanstötter , Roman Vetter , Dagmar Iber

Factor graphs have demonstrated remarkable efficiency for robotic perception tasks, particularly in localization and mapping applications. However, their application to optimal control problems -- especially Model Predictive Control (MPC)…

Robotics · Computer Science 2025-06-18 Anas Abdelkarim , Holger Voos , Daniel Görges

Bilevel optimization has recently attracted significant attention in machine learning due to its wide range of applications and advanced hierarchical optimization capabilities. In this paper, we propose a plug-and-play framework, named…

Optimization and Control · Mathematics 2025-05-05 Tianshu Chu , Dachuan Xu , Wei Yao , Chengming Yu , Jin Zhang

Nonlinear embedding manifold learning methods provide invaluable visual insights into the structure of high-dimensional data. However, due to a complicated nonconvex objective function, these methods can easily get stuck in local minima and…

Machine Learning · Computer Science 2019-12-30 Max Vladymyrov

Bilevel optimization is an important class of optimization problems where one optimization problem is nested within another. While various methods have emerged to address unconstrained general bilevel optimization problems, there has been a…

Optimization and Control · Mathematics 2024-03-15 Nazanin Abolfazli , Ruichen Jiang , Aryan Mokhtari , Erfan Yazdandoost Hamedani

We study a class of bilevel convex optimization problems where the goal is to find the minimizer of an objective function in the upper level, among the set of all optimal solutions of an optimization problem in the lower level. A wide range…

Optimization and Control · Mathematics 2018-09-27 Mostafa Amini , Farzad Yousefian

We propose a general alternating minimization algorithm for nonconvex optimization problems with separable structure and nonconvex coupling between blocks of variables. To fix our ideas, we apply the methodology to the problem of blind…

Optimization and Control · Mathematics 2018-02-07 Robert Hesse , D. Russell Luke , Shoham Sabach , Matthew K. Tam

This paper investigates the control barrier function (CBF) based safety-critical control for continuous nonlinear control affine systems using the more efficient online algorithms through time-varying optimization. The idea lies in that…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Shengbo Wang , Shiping Wen , Yin Yang , Yuting Cao , Kaibo Shi , Tingwen Huang

We present a physics-informed machine-learning (PIML) approach for the approximation of slow invariant manifolds (SIMs) of singularly perturbed systems, providing functionals in an explicit form that facilitate the construction and…

Dynamical Systems · Mathematics 2024-11-05 Dimitrios G. Patsatzis , Gianluca Fabiani , Lucia Russo , Constantinos Siettos

In this paper we combine an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM). The resulting algorithm (IP-PMM) is interpreted as a primal-dual regularized IPM, suitable for solving linearly constrained…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , Jacek Gondzio

This work presents a generalized implementation of the infeasible primal-dual Interior Point Method (IPM) achieved by the use of non-Archimedean values, i.e., infinite and infinitesimal numbers. The extended version, called here…

Optimization and Control · Mathematics 2024-09-26 Lorenzo Fiaschi , Marco Cococcioni

This paper proposes a new algorithm -- the \underline{S}ingle-timescale Do\underline{u}ble-momentum \underline{St}ochastic \underline{A}pprox\underline{i}matio\underline{n} (SUSTAIN) -- for tackling stochastic unconstrained bilevel…

Optimization and Control · Mathematics 2021-06-16 Prashant Khanduri , Siliang Zeng , Mingyi Hong , Hoi-To Wai , Zhaoran Wang , Zhuoran Yang

For Stefan problems, characterized by moving boundaries and discontinuous coefficients due to phase changes, the inherent nonconvexity of the objective functional frequently causes optimization difficulty in randomized neural network…

Numerical Analysis · Mathematics 2026-05-12 Wenjie Liu , Siyuan Lang , Zhiyue Zhang

We consider a bilevel learning framework for learning linear operators. In this framework, the learnable parameters are optimized via a loss function that also depends on the minimizer of a convex optimization problem (denoted lower-level…

Optimization and Control · Mathematics 2025-06-10 Lea Bogensperger , Matthias J. Ehrhardt , Thomas Pock , Mohammad Sadegh Salehi , Hok Shing Wong

In this paper, we discuss the application of the Generalized Finite Element Method (GFEM) to approximate the solutions of quasilinear elliptic equations with multiple interfaces in one dimensional space. The problem is characterized by…

Numerical Analysis · Mathematics 2021-02-02 Tilsa Aryeni , Quanling Deng , Victor Ginting