English
Related papers

Related papers: A sequential optimality condition for Mathematical…

200 papers

Motivated by the problem to approximate all feasible schedules by one schedule in a given scheduling environment, we introduce in this paper the concepts of strong simultaneous approximation ratio (SAR) and weak simultaneous approximation…

Data Structures and Algorithms · Computer Science 2013-04-16 Long Wan

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

We propose a new approach to the theory of conditioning for numerical analysis problems for which both classical and stochastic perturbation theory fail to predict the observed accuracy of computed solutions. To motivate our ideas, we…

Numerical Analysis · Mathematics 2020-02-07 Martin Lotz , Vanni Noferini

We present new constraint qualification conditions for nonlinear semidefinite programming that extend some of the constant rank-type conditions from nonlinear programming. As an application of these conditions, we provide a unified global…

Optimization and Control · Mathematics 2021-06-08 Roberto Andreani , Gabriel Haeser , Leonardo M. Mito , Héctor Ramírez C

Maximizing monotone submodular functions under cardinality constraints is a classic optimization task with several applications in data mining and machine learning. In this paper we study this problem in a dynamic environment with…

Data Structures and Algorithms · Computer Science 2024-05-31 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Optimality conditions in the form of a variational inequality are proved for a class of constrained optimal control problems of stochastic differential equations. The cost function and the inequality constraints are functions of the…

Optimization and Control · Mathematics 2018-02-13 Laurent Pfeiffer

Bandits with Knapsacks (BwK), the generalization of the Bandits problem under global budget constraints, has received a lot of attention in recent years. Previous work has focused on one of the two extremes: Stochastic BwK where the rewards…

Machine Learning · Computer Science 2023-09-06 Giannis Fikioris , Éva Tardos

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

This paper is concerned with second-order optimality conditions for the mathematical program with semidefinite cone complementarity constraints (SDCMPCC).To achieve this goal, we first provide an exact characterization on the second-order…

Optimization and Control · Mathematics 2019-11-26 Yulan Liu , Shaohua Pan

Sequential optimality conditions play an important role in constrained optimization since they provide necessary conditions without requiring constraint qualifications (CQs). This paper introduces a second-order extension of the Approximate…

Optimization and Control · Mathematics 2025-07-30 Huimin Li , Yuya Yamakawa , Ellen H. Fukuda

This paper presents an auto-optimal model predictive control (MPC) framework enhanced with active learning, designed to autonomously track optimal operational conditions in an unknown environment,where the conditions may dynamically adjust…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Yuan Tan , Jun Yang , Zhongguo Li , Wen-Hua Chen , Shihua Li

The convergence rates of iterative methods for solving a linear system $\mathbf{A} x = b$ typically depend on the condition number of the matrix $\mathbf{A}$. Preconditioning is a common way of speeding up these methods by reducing that…

Optimization and Control · Mathematics 2021-11-04 Arun Jambulapati , Jerry Li , Christopher Musco , Aaron Sidford , Kevin Tian

We propose online algorithms for sequential learning in the contextual multi-armed bandit setting. Our approach is to partition the context space and then optimally combine all of the possible mappings between the partition regions and the…

Machine Learning · Computer Science 2017-12-11 Mohammadreza Mohaghegh Neyshabouri , Kaan Gokcesu , Huseyin Ozkan , Suleyman S. Kozat

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson

This paper treats the problem of minimizing a general continuously differentiable function subject to sparsity constraints. We present and analyze several different optimality criteria which are based on the notions of stationarity and…

Information Theory · Computer Science 2012-03-22 Amir Beck , Yonina C. Eldar

In this paper, we study the difficult class of optimization problems called the mathematical programs with vanishing constraints or MPVC. Extensive research has been done for MPVC regarding stationary conditions and constraint…

Optimization and Control · Mathematics 2018-11-30 Abeka Khare , Triloki Nath

We consider a class of optimal control problems with a state constraint and investigate a trajectory with a single boundary interval (subarc). Following R.V. Gamkrelidze, we differentiate the state constraint along the boundary subarc, thus…

Optimization and Control · Mathematics 2017-05-12 Andrei Dmitruk , Ivan Samylovskiy

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

This paper focuses on stochastic methods for solving smooth non-convex strongly-concave min-max problems, which have received increasing attention due to their potential applications in deep learning (e.g., deep AUC maximization,…

Machine Learning · Computer Science 2023-04-19 Zhishuai Guo , Yan Yan , Zhuoning Yuan , Tianbao Yang

We show that, for a fixed order $\gamma\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$),…

Optimization and Control · Mathematics 2023-02-10 Matúš Benko , Patrick Mehlitz