English
Related papers

Related papers: An inexact column-and-constraint generation method…

200 papers

With rapid integration of power sources with uncertainty, robustness must be carefully considered in the transmission constrained unit commitment (TCUC) problem. The overall computational complexity of the robust TCUC methods is closely…

Optimization and Control · Mathematics 2018-10-16 Xuan Li , Qiaozhu Zhai , Xiaohong Guan

This paper considers the robust phase retrieval problem, which can be cast as a nonsmooth and nonconvex optimization problem. We propose a new inexact proximal linear algorithm with the subproblem being solved inexactly. Our contributions…

Optimization and Control · Mathematics 2024-02-12 Zhong Zheng , Shiqian Ma , Lingzhou Xue

The paper studies the solution of stochastic optimization problems in which approximations to the gradient and Hessian are obtained through subsampling. We first consider Newton-like methods that employ these approximations and discuss how…

Optimization and Control · Mathematics 2016-09-28 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

This paper explores the use of Column Generation (CG) techniques in constructing univariate binary decision trees for classification tasks. We propose a novel Integer Linear Programming (ILP) formulation, based on root-to-leaf paths in…

Machine Learning · Computer Science 2019-07-12 Murat Firat , Guillaume Crognier , Adriana F. Gabor , C. A. J. Hurkens , Yingqian Zhang

We apply column generation to approximating complex structured objects via a set of primitive structured objects under either the cross entropy or L2 loss. We use L1 regularization to encourage the use of few structured primitive objects.…

Machine Learning · Computer Science 2016-02-16 Julian Yarkony , Kamalika Chaudhuri

In this paper, we propose a new inexact version of the projected subgradient method to solve nondifferentiable constrained convex optimization problems. The method combine $\epsilon$-subgradient method with a procedure to obtain a feasible…

Optimization and Control · Mathematics 2020-06-17 Ademir Alves Aguiar , Orizon Pereira Ferreira , Leandro da Fonseca Prudente

Column generation is often used to solve multi-commodity flow problems. A program for column generation always includes a module that solves a linear equation. In this paper, we address three major issues in solving linear problem during…

Optimization and Control · Mathematics 2019-03-19 Liyun Dai , Hengjun Zhao , Zhiming Liu

In this article we introduce Graph Generation, an enhanced Column Generation (CG) algorithm for solving expanded linear programming relaxations of mixed integer linear programs. To apply Graph Generation, we must be able to map any given…

Optimization and Control · Mathematics 2021-10-05 Julian Yarkony , Naveed Haghani , Amelia Regan

It has been recently shown that numerical semiparametric bounds on the expected payoff of fi- nancial or actuarial instruments can be computed using semidefinite programming. However, this approach has practical limitations. Here we use…

Pricing of Securities · Quantitative Finance 2016-01-12 Robert Howley , Robert Storer , Juan Vera , Luis F. Zuluaga

This manuscript develops a new framework to analyze and design iterative optimization algorithms built on the notion of Integral Quadratic Constraints (IQC) from robust control theory. IQCs provide sufficient conditions for the stability of…

Optimization and Control · Mathematics 2021-05-27 Laurent Lessard , Benjamin Recht , Andrew Packard

Decision trees are highly interpretable models for solving classification problems in machine learning (ML). The standard ML algorithms for training decision trees are fast but generate suboptimal trees in terms of accuracy. Other discrete…

Machine Learning · Computer Science 2024-01-24 Krunal Kishor Patel , Guy Desaulniers , Andrea Lodi

The integration of intermittent renewable energy sources into distribution networks introduces significant uncertainties and fluctuations, challenging their operational security, stability, and efficiency. This paper considers robust…

Systems and Control · Electrical Eng. & Systems 2025-06-02 Runjie Zhang , Kaiping Qu , Changhong Zhao , Wanjun Huang

The discrete Wasserstein barycenter problem is a minimum-cost mass transport problem for a set of discrete probability measures. Although an exact barycenter is computable through linear programming, the underlying linear program can be…

Optimization and Control · Mathematics 2022-02-09 Steffen Borgwardt , Stephan Patterson

The article proposes a Caputo fractional conjugate gradient (CFCG) method for unconstrained optimization problems which is applicable to smooth as well as non-smooth problmes. The proposed method uses a non-adaptive version of the Caputo…

Optimization and Control · Mathematics 2025-12-22 Barsha Shawa , Md Abu Talhamainuddin Ansary

Two-level stochastic optimization formulations have become instrumental in a number of machine learning contexts such as continual learning, neural architecture search, adversarial learning, and hyperparameter tuning. Practical stochastic…

Optimization and Control · Mathematics 2023-11-08 Tommaso Giovannelli , Griffin Dean Kent , Luis Nunes Vicente

In a recent paper an Inexact Restoration method for solving continuous constrained optimization problems was analyzed from the point of view of worst-case functional complexity and convergence. On the other hand, the Inexact Restoration…

Optimization and Control · Mathematics 2023-09-20 L. F. Bueno , F. Larreal , J. M. Martínez

In this paper, we propose a new stochastic column-block gradient descent method for solving nonlinear systems of equations. It has a descent direction and holds an approximately optimal step size obtained through an optimization problem. We…

Numerical Analysis · Mathematics 2025-07-21 Naiyu Jiang , Wendi Bao , Lili Xing , Weiguo Li

Stochastic programming provides a natural framework for modeling sequential optimization problems under uncertainty; however, the efficient solution of large-scale multistage stochastic programs remains a challenge, especially in the…

Optimization and Control · Mathematics 2025-03-11 Tushar Rathi , Benjamin P. Riley , Angela Flores-Quiroz , Qi Zhang

We consider variants of a recently-developed Newton-CG algorithm for nonconvex problems \citep{royer2018newton} in which inexact estimates of the gradient and the Hessian information are used for various steps. Under certain conditions on…

Optimization and Control · Mathematics 2022-04-12 Zhewei Yao , Peng Xu , Fred Roosta , Stephen J. Wright , Michael W. Mahoney

In this paper, we consider a score-based Integer Programming (IP) approach for solving the Bayesian Network Structure Learning (BNSL) problem. State-of-the-art BNSL IP formulations suffer from the exponentially large number of variables and…

Machine Learning · Statistics 2025-09-10 Yiran Yang , Rui Chen