English
Related papers

Related papers: A penalty-interior point method combined with MADS…

200 papers

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

Inactive constraints do not contribute to the solution of an optimal control problem, but increase the problem size and burden the numerical computations. We present a novel strategy for handling inactive constraints efficiently by…

Systems and Control · Electrical Eng. & Systems 2021-12-16 Yuanbo Nie , Eric C. Kerrigan

We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with decoupled constraints, in which…

This paper studies bandit convex optimization with constraints, where the learner aims to generate a sequence of decisions under partial information of loss functions such that the cumulative loss is reduced as well as the cumulative…

Machine Learning · Computer Science 2023-10-18 Yasunari Hikima

Discrete black-box optimization problems are challenging for model-based optimization (MBO) algorithms, such as Bayesian optimization, due to the size of the search space and the need to satisfy combinatorial constraints. In particular,…

Optimization and Control · Mathematics 2022-06-15 Theodore Papalexopoulos , Christian Tjandraatmadja , Ross Anderson , Juan Pablo Vielma , David Belanger

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

Optimization and Control · Mathematics 2017-12-07 Ganzhao Yuan , Bernard Ghanem

Exact Maximum Inner Product Search (MIPS) is an important task that is widely pertinent to recommender systems and high-dimensional similarity search. The brute-force approach to solving exact MIPS is computationally expensive, thus…

Information Retrieval · Computer Science 2019-03-18 Firas Abuzaid , Geet Sethi , Peter Bailis , Matei Zaharia

This paper shows how a class of non-convex optimization problems constrained by discretized nonlinear partial differential equations may be solved to global optimality using an interior point continuation method. The solution procedure…

Optimization and Control · Mathematics 2020-03-13 Jorn Baayen , Teresa Piovesan , Jesse VanderWees

Lipschitz continuity of the gradient mapping of a continuously differentiable function plays a crucial role in designing various optimization algorithms. However, many functions arising in practical applications such as low rank matrix…

Optimization and Control · Mathematics 2020-12-25 Mahesh Chandra Mukkamala , Jalal Fadili , Peter Ochs

This paper explores the complex tradeoffs between various fairness metrics such as equalized odds, disparate impact, and equal opportunity and predictive accuracy within COMPAS by building neural networks trained with custom loss functions…

Machine Learning · Computer Science 2025-01-06 Gordon Lee , Simeon Sayer

This work introduces StoMADS, a stochastic variant of the mesh adaptive direct-search (MADS) algorithm originally developed for deterministic blackbox optimization. StoMADS considers the unconstrained optimization of an objective function f…

Optimization and Control · Mathematics 2019-11-05 Charles Audet , Kwassi Joseph Dzahini , Michael Kokkolaras , Sébastien Le Digabel

Resource allocation problems are usually solved with specialized methods exploiting their general sparsity and problem-specific algebraic structure. We show that the sparsity structure alone yields a closed-form Newton search direction for…

Optimization and Control · Mathematics 2014-07-25 Stephen E. Wright , James J. Rohal

We propose a primal-dual interior-point method (IPM) with convergence to second-order stationary points (SOSPs) of nonlinear semidefinite optimization problems, abbreviated as NSDPs. As far as we know, the current algorithms for NSDPs only…

Optimization and Control · Mathematics 2023-06-19 Shun Arahata , Takayuki Okuno , Akiko Takeda

This paper is concerned with a class of optimization problems with the nonnegative orthogonal constraint, in which the objective function is $L$-smooth on an open set containing the Stiefel manifold ${\rm St}(n,r)$. We derive a locally…

Optimization and Control · Mathematics 2025-02-05 Yitian Qian , Shaohua Pan , Lianghai Xiao

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

We study an important variant of the stochastic multi-armed bandit (MAB) problem, which takes penalization into consideration. Instead of directly maximizing cumulative expected reward, we need to balance between the total reward and…

Machine Learning · Statistics 2022-11-16 Guanhua Fang , Ping Li , Gennady Samorodnitsky

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Richard Heusdens , Guoqiang Zhang

We prove $hp$-optimal error estimates for interior penalty discontinuous Galerkin methods (IPDG) for the biharmonic problem with homogeneous essential boundary conditions. We consider tensor product-type meshes in two and three dimensions,…

Numerical Analysis · Mathematics 2023-05-04 Zhaonan Dong , Lorenzo Mascotto

Obeying precise constraints on top of multiple external attributes is a common computational problem underlying seemingly different domains, from controlled text generation to protein engineering. Existing language model (LM)…

Artificial Intelligence · Computer Science 2024-12-30 Ashutosh Baheti , Debanjana Chakraborty , Faeze Brahman , Ronan Le Bras , Ximing Lu , Nouha Dziri , Yejin Choi , Mark Riedl , Maarten Sap

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl