English
Related papers

Related papers: A Specialized Simplex Algorithm for Budget-Constra…

200 papers

We develop a machine-learning framework to learn hyperparameter sequences for accelerated first-order methods (e.g., the step size and momentum sequences in accelerated gradient descent) to quickly solve parametric convex optimization…

Optimization and Control · Mathematics 2025-10-07 Rajiv Sambharya , Jinho Bok , Nikolai Matni , George Pappas

We study the problem of structured prediction under test-time budget constraints. We propose a novel approach applicable to a wide range of structured prediction problems in computer vision and natural language processing. Our approach…

Machine Learning · Statistics 2016-06-09 Tolga Bolukbasi , Kai-Wei Chang , Joseph Wang , Venkatesh Saligrama

In this paper, we introduce a graph matching method that can account for constraints of arbitrary order, with arbitrary potential functions. Unlike previous decomposition approaches that rely on the graph structures, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 D. Khuê Lê-Huu , Nikos Paragios

We study the conditions under which one is able to efficiently apply variance-reduction and acceleration schemes on finite sum optimization problems. First, we show that, perhaps surprisingly, the finite sum structure by itself, is not…

Optimization and Control · Mathematics 2017-12-08 Yossi Arjevani

In this paper, we propose a multilevel stochastic framework for the solution of nonconvex unconstrained optimization problems. The proposed approach uses random regularized first-order models that exploit an available hierarchical…

Optimization and Control · Mathematics 2025-11-27 Filippo Marini , Margherita Porcelli , Elisa Riccietti

Many recent approximation algorithms for different variants of the traveling salesman problem (asymmetric TSP, graph TSP, s-t-path TSP) exploit the well-known fact that a solution of the natural linear programming relaxation can be written…

Discrete Mathematics · Computer Science 2016-01-06 Jens Vygen

We consider simple bilevel optimization problems where the goal is to compute among the optimal solutions of a composite convex optimization problem, one that minimizes a secondary objective function. Our main contribution is threefold. (i)…

Optimization and Control · Mathematics 2025-04-14 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Total variation regularization has proven to be a valuable tool in the context of optimal control of differential equations. This is particularly attributed to the observation that TV-penalties often favor piecewise constant minimizers with…

Optimization and Control · Mathematics 2025-10-03 Giacomo Cristinelli , José A. Iglesias , Daniel Walter

In two earlier papers, we designed a distributed deterministic asynchronous algorithm for minimizing the sum of subdifferentiable and proximable functions and a regularizing quadratic on time-varying graphs based on Dykstra's algorithm, or…

Optimization and Control · Mathematics 2018-08-23 C. H. Jeffrey Pang

Modern decision-making scenarios often involve data that is both high-dimensional and rich in higher-order contextual information, where existing bandits algorithms fail to generate effective policies. In response, we propose in this paper…

Machine Learning · Computer Science 2025-01-24 Jiannan Li , Yiyang Yang , Yao Wang , Shaojie Tang

The scenario-based optimization approach (`scenario approach') provides an intuitive way of approximating the solution to chance-constrained optimization programs, based on finding the optimal solution under a finite number of sampled…

Optimization and Control · Mathematics 2025-10-02 Georg Schildbach , Lorenzo Fagiano , Manfred Morari

We study the crossing-minimization problem in a layered graph drawing of planar-embedded rooted trees whose leaves have a given total order on the first layer, which adheres to the embedding of each individual tree. The task is then to…

Discrete Mathematics · Computer Science 2024-02-29 Julia Katheder , Stephen G. Kobourov , Axel Kuckuk , Maximilian Pfister , Johannes Zink

This work studies the parameterized complexity of finding secluded solutions to classical combinatorial optimization problems on graphs such as finding minimum s-t separators, feedback vertex sets, dominating sets, maximum independent sets,…

Computational Complexity · Computer Science 2019-11-14 René van Bevern , Till Fluschnik , George B. Mertzios , Hendrik Molter , Manuel Sorge , Ondřej Suchý

In this work, we focus on the Partial Constraint Satisfaction Problem (PCSP) over control-flow graphs (CFGs) of programs. PCSP serves as a generalization of the well-known Constraint Satisfaction Problem (CSP). In the CSP framework, we…

Computation and Language · Computer Science 2026-02-04 Xuran Cai , Amir Goharshady

We generalize the reduction mechanism for linear programming problems and semidefinite programming problems from [arXiv:1410.8816] in two ways 1) relaxing the requirement of affineness and 2) extending to fractional optimization problems.…

Computational Complexity · Computer Science 2018-10-23 Gábor Braun , Sebastian Pokutta , Aurko Roy

Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

We propose an algorithm for exploring the entire regularization path of asymmetric-cost linear support vector machines. Empirical evidence suggests the predictive power of support vector machines depends on the regularization parameters of…

Machine Learning · Computer Science 2016-10-13 Daniel Wesierski

Some metric and graphical regularity properties of generalized constraint systems are investigated. Then, these properties are applied in order to penalize (in the sense of Clarke) various scalar and vector optimization problems. This…

Optimization and Control · Mathematics 2011-11-08 Marius Durea , Radu Strugariu