English
Related papers

Related papers: Learning to Pivot as a Smart Expert

200 papers

We propose to classify the power of algorithms by the complexity of the problems that they can be used to solve. Instead of restricting to the problem a particular algorithm was designed to solve explicitly, however, we include problems…

Discrete Mathematics · Computer Science 2014-04-03 Yann Disser , Martin Skutella

For interior-point algorithms in linear programming, it is well-known that the selection of the centering parameter is crucial for proving polynomility in theory and for efficiency in practice. However, the selection of the centering…

Optimization and Control · Mathematics 2021-10-05 Yaguang Yang

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

Online learning with expert advice is a fundamental problem of sequential prediction. In this problem, the algorithm has access to a set of $n$ "experts" who make predictions on each day. The goal on each day is to process these…

Data Structures and Algorithms · Computer Science 2022-04-22 Vaidehi Srinivas , David P. Woodruff , Ziyu Xu , Samson Zhou

A common problem of classical neural network architectures is that additional information or expert knowledge cannot be naturally integrated into the learning process. To overcome this limitation, we propose a two-step approach consisting…

Machine Learning · Computer Science 2024-06-17 Florian Seiffarth

It is known that one can solve semidefinite programs to within fixed accuracy in polynomial time using the ellipsoid method (under some assumptions). In this paper it is shown that the same holds true when one uses the short-step, primal…

Optimization and Control · Mathematics 2016-09-26 Etienne de Klerk , Frank Vallentin

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

This paper proposes a primal-dual framework to learn a stable estimator for linear constrained estimation problems leveraging the moving horizon approach. To avoid the online computational burden in most existing methods, we learn a…

Systems and Control · Electrical Eng. & Systems 2022-04-07 Wenhan Cao , Jingliang Duan , Shengbo Eben Li , Chen Chen , Chang Liu , Yu Wang

We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity…

Optimization and Control · Mathematics 2014-11-11 Tor Myklebust , Levent Tunçel

In this work, we investigate the application of deep learning methods for computed tomography in the context of having a low-data regime. As motivation, we review some of the existing approaches and obtain quantitative results after…

Image and Video Processing · Electrical Eng. & Systems 2021-04-20 Daniel Otero Baguer , Johannes Leuschner , Maximilian Schmidt

Circuit-augmentation algorithms are generalizations of the Simplex method, where in each step one is allowed to move along a fixed set of directions, called circuits, that is a superset of the edges of a polytope. We show that in the…

Combinatorics · Mathematics 2020-10-23 Jesús A. De Loera , Sean Kafer , Laura Sanità

We consider the problem of solving packing/covering LPs online, when the columns of the constraint matrix are presented in random order. This problem has received much attention and the main focus is to figure out how large the right-hand…

Data Structures and Algorithms · Computer Science 2015-11-30 Anupam Gupta , Marco Molinaro

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We prove that the classic logarithmic barrier problem is equivalent to a particular logarithmic barrier positive relaxation problem with barrier and scaling parameters. Based on the equivalence, a line-search primal-dual interior-point…

Optimization and Control · Mathematics 2018-07-10 Xin-Wei Liu , Yu-Hong Dai

Solving constrained nonlinear programs (NLPs) is of great importance in various domains such as power systems, robotics, and wireless communication networks. One widely used approach for addressing NLPs is the interior point method (IPM).…

Optimization and Control · Mathematics 2024-10-22 Xi Gao , Jinxin Xiong , Akang Wang , Qihong Duan , Jiang Xue , Qingjiang Shi

Several techniques for domain adaptation have been proposed to account for differences in the distribution of the data used for training and testing. The majority of this work focuses on a binary domain label. Similar problems occur in a…

Machine Learning · Statistics 2020-02-18 Gilles Louppe , Michael Kagan , Kyle Cranmer

Cutting planes are essential for solving mixed-integer linear problems (MILPs), because they facilitate bound improvements on the optimal solution value. For selecting cuts, modern solvers rely on manually designed heuristics that are tuned…

Machine Learning · Computer Science 2022-06-28 Max B. Paulus , Giulia Zarpellon , Andreas Krause , Laurent Charlin , Chris J. Maddison

A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We…

Optimization and Control · Mathematics 2018-10-05 Jacek Gondzio , E. Alper Yildirim

We develop a new interior-point method (IPM) for symmetric-cone optimization, a common generalization of linear, second-order-cone, and semidefinite programming. In contrast to classical IPMs, we update iterates with a geodesic of the cone…

Optimization and Control · Mathematics 2023-01-18 Frank Permenter