English
Related papers

Related papers: Two nonmonotone multiobjective memory gradient alg…

200 papers

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

Optimization and Control · Mathematics 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

In this paper, we present the first outer approximation algorithm for multi-objective mixed-integer linear programming problems with any number of objectives. The algorithm also works for certain classes of non-linear programming problems.…

Optimization and Control · Mathematics 2022-05-04 Fritz Bökler , Sophie N. Parragh , Markus Sinnl , Fabien Tricoire

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

In this paper, we deal with two ingredients that, as far as we know, have not been combined until now: multiobjective optimization and discrete convex analysis. First, we show that the entire Pareto optimal value set can be obtained in…

Optimization and Control · Mathematics 2026-02-20 Ellen H. Fukuda , Satoru Iwata , Itsuki Nakagawa

This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary…

Optimization and Control · Mathematics 2024-03-18 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho

In this paper, we propose a simple yet efficient strategy for improving the multi-objective steepest descent method proposed by Fliege and Svaiter (Math Methods Oper Res, 2000, 3: 479--494). The core idea behind this strategy involves…

Optimization and Control · Mathematics 2024-01-15 Wang Chen , Liping Tang , Xinmin Yang

An efficient gradient-based method to solve the volume constrained topology optimization problems is presented. Each iterate of this algorithm is obtained by the projection of a Barzilai-Borwein step onto the feasible set consisting of box…

Optimization and Control · Mathematics 2010-06-04 Ruhollah Tavakoli , Hongchao Zhang

We consider a generic min-max multi-objective bilevel optimization problem with applications in robust machine learning such as representation learning and hyperparameter optimization. We design MORBiT, a novel single-loop gradient…

Machine Learning · Computer Science 2023-03-08 Alex Gu , Songtao Lu , Parikshit Ram , Lily Weng

Real-world optimization problems often do not just involve multiple objectives but also uncertain parameters. In this case, the goal is to find Pareto-optimal solutions that are robust, i.e., reasonably good under all possible realizations…

Optimization and Control · Mathematics 2023-11-06 Fabian Chlumsky-Harttmann , Marie Schmidt , Anita Schöbel

We propose a monotone splitting algorithm for solving a class of second-order non-potential mean-field games. Following [Achdou, Capuzzo-Dolcetta, "Mean Field Games: Numerical Methods," SINUM (2010)], we introduce a finite-difference scheme…

Optimization and Control · Mathematics 2024-04-01 Levon Nurbekyan , Siting Liu , Yat Tin Chow

We consider the problem of finding a fixed point of a nonexpansive mapping, which is also a solution of a pseudo-monotone equilibrium problem, where the bifunction in the equilibrium problem is the sum of two ones. We propose a splitting…

Optimization and Control · Mathematics 2018-05-08 Le Dung Muu , Xuan Thanh Le

We study alternating first-order algorithms with no inner loops for solving nonconvex-strongly-concave min-max problems. We show the convergence of the alternating gradient descent--ascent algorithm method by proposing a substantially…

Optimization and Control · Mathematics 2026-03-31 Guido Tapia-Riera , Camille Castera , Nicolas Papadakis

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

Multi-objective combinatorial optimization seeks Pareto-optimal solutions over exponentially large discrete spaces, yet existing methods sacrifice generality, scalability, or theoretical guarantees. We reformulate it as an online learning…

Machine Learning · Computer Science 2026-02-13 Esha Singh , Dongxia Wu , Chien-Yi Yang , Tajana Rosing , Rose Yu , Yi-An Ma

We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an $\ell_0$-norm constraint. Through decomposing the feasible set of the given sparsity…

Optimization and Control · Mathematics 2026-02-13 Jan Harold Alcantara , Ching-pei Lee

In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted wide attention in machine learning, signal processing and…

Optimization and Control · Mathematics 2026-03-06 Huiling Zhang , Zi Xu , Yuhong Dai

This paper deals with approximate solutions of a nonsmooth semi-infinite programming with multiple interval-valued objective functions. We first introduce four types of approximate quasi Pareto solutions of the considered problem by…

Optimization and Control · Mathematics 2022-01-25 Nguyen Huy Hung , Hoang Ngoc Tuan , Nguyen Van Tuyen

In this paper, a new one-parameter filled function approach is developed for nonlinear multi-objective optimization. Inspired by key filled function ideas from single-objective optimization, the proposed method is adapted to the…

Optimization and Control · Mathematics 2026-04-01 Bikram Adhikary , Md Abu Talhamainuddin Ansary

Multi-Objective Bi-Level Optimization (MOBLO) addresses nested multi-objective optimization problems common in a range of applications. However, its multi-objective and hierarchical bilevel nature makes it notably complex. Gradient-based…

Optimization and Control · Mathematics 2024-06-11 Xinmin Yang , Wei Yao , Haian Yin , Shangzhi Zeng , Jin Zhang

In multiobjective optimization, the result of an optimization algorithm is a set of efficient solutions from which the decision maker selects one. It is common that not all the efficient solutions can be computed in a short time and the…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Miguel Ángel Domínguez-Ríos , Francisco Chicano , Enrique Alba