English
Related papers

Related papers: Global aspects of the continuous reformulation for…

200 papers

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung

Our recent study (Lin and Ohtsuka, 2024) proposed a new penalty method for solving mathematical programming with complementarity constraints (MPCC). This method first reformulates MPCC as a parameterized nonlinear programming called gap…

Optimization and Control · Mathematics 2025-05-16 Kangyu Lin , Toshiyuki Ohtsuka

We analyze combinatorial optimization problems with ordinal, i.e., non-additive, objective functions that assign categories (like good, medium and bad) rather than cost coefficients to the elements of feasible solutions. We review different…

Optimization and Control · Mathematics 2022-04-06 Kathrin Klamroth , Michael Stiglmayr , Julia Sudhoff

We consider the problem of maximizing an unknown function over a compact and convex set using as few observations as possible. We observe that the optimization of the function essentially relies on learning the induced bipartite ranking…

Machine Learning · Statistics 2017-03-08 Cédric Malherbe , Nicolas Vayatis

The cardinality-constrained mean-variance portfolio problem has garnered significant attention within contemporary finance due to its potential for achieving low risk while effectively managing risks and transaction costs. Instead of…

Optimization and Control · Mathematics 2024-07-15 Ahmad Mousavi , George Michailidis

Non-concave maximization has been the subject of much recent study in the optimization and machine learning communities, specifically in deep learning. Recent papers Ge et al, Lee et al (and references therein) indicate that first order…

Optimization and Control · Mathematics 2020-01-14 Ioannis Panageas , Georgios Piliouras , Xiao Wang

Real world problems always have different multiple solutions. For instance, optical engineers need to tune the recording parameters to get as many optimal solutions as possible for multiple trials in the varied-line-spacing holographic…

Neural and Evolutionary Computing · Computer Science 2015-08-04 Ka-Chun Wong

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

Recently, the problem of local minima in very high dimensional non-convex optimization has been challenged and the problem of saddle points has been introduced. This paper introduces a dynamic type of normalization that forces the system to…

Machine Learning · Computer Science 2017-02-08 Armen Aghajanyan

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou

Capacity constrained optimal transport is a variant of optimal transport, which adds extra constraints on the set of feasible couplings in the original optimal transport problem to limit the mass transported between each pair of source and…

Optimization and Control · Mathematics 2025-02-13 Tianhao Wu , Qihao Cheng , Zihao Wang , Chaorui Zhang , Bo Bai , Zhongyi Huang , Hao Wu

A new global stochastic search, guided mainly through derivative-free directional information computable from the sample statistical moments of the design variables within a Monte Carlo setup, is proposed. The search is aided by imparting…

Methodology · Statistics 2014-03-10 Saikat Sarkar , Debasish Roy , Ram Mohan Vasu

A general regularization strategy is considered for the efficient iterative solution of the lowest-order weak Galerkin approximation of singular Stokes problems. The strategy adds a rank-one regularization term to the zero (2,2) block of…

Numerical Analysis · Mathematics 2025-05-16 Weizhang Huang , Zhuoran Wang

The maximal coding rate reduction (MCR$^2$) objective for learning structured and compact deep representations is drawing increasing attention, especially after its recent usage in the derivation of fully explainable and highly effective…

Machine Learning · Computer Science 2025-11-17 Peng Wang , Huikang Liu , Druv Pai , Yaodong Yu , Zhihui Zhu , Qing Qu , Yi Ma

We give a characterization of completely regular topological spaces. Applying some recent results for supinf problems in completely regular topological spaces we establish a variational principle for saddle points. Well-posedness of saddle…

Optimization and Control · Mathematics 2024-08-05 D. Kamburova , R. Marinov , N. Zlateva

Shortened abstract: Given a constrained minimization problem, under what conditions does there exist a related, unconstrained problem having the same minimum points? This basic question in global optimization motivates this paper, which…

Statistical Mechanics · Physics 2007-05-23 M. Costeniuc , R. S. Ellis , H. Touchette , B. Turkington

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl

Switching-constrained optimization problems form a difficult class of mathematical programs since their feasible set is almost disconnected while standard constraint qualifications are likely to fail at several feasible points. That is why…

Optimization and Control · Mathematics 2018-09-10 Christian Kanzow , Patrick Mehlitz , Daniel Steck

Decentralized nonconvex optimization has received increasing attention in recent years in machine learning due to its advantages in system robustness, data privacy, and implementation simplicity. However, three fundamental challenges in…

Machine Learning · Computer Science 2021-05-20 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone