English
Related papers

Related papers: Tuning as convex optimisation: a polynomial tuner …

200 papers

Chance constrained program is computationally intractable due to the existence of chance constraints, which are randomly disturbed and should be satisfied with a probability. This paper proposes a two-layer randomized algorithm to address…

Optimization and Control · Mathematics 2019-11-11 Xun Shen , Jiancang Zhuang , Xingguo Zhang

Recently, transformers have shown strong ability as visual feature extractors, surpassing traditional convolution-based models in various scenarios. However, the success of vision transformers largely owes to their capacity to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Tianxiang Hao , Hui Chen , Yuchen Guo , Guiguang Ding

In compressed sensing one uses known structures of otherwise unknown signals to recover them from as few linear observations as possible. The structure comes in form of some compressibility including different notions of sparsity and low…

Information Theory · Computer Science 2019-05-29 Martin Kliesch , Stanislaw J. Szarek , Peter Jung

We present an efficient algorithm to reduce the size of nondeterministic tree automata, while retaining their language. It is based on new transition pruning techniques, and quotienting of the state space w.r.t. suitable equivalences. It…

Formal Languages and Automata Theory · Computer Science 2016-01-07 Ricardo Almeida , Lukáš Holík , Richard Mayr

In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to…

Systems and Control · Computer Science 2013-12-02 Mathias Bürger , Giuseppe Notarstefano , Frank Allgöwer

Biological processes, including cell differentiation, organism development, and disease progression, can be interpreted as attractors (fixed points or limit cycles) of an underlying networked dynamical system. In this paper, we study the…

Systems and Control · Computer Science 2017-01-20 Andrew Clark , Phillip Lee , Basel Alomair , Linda Bushnell , Radha Poovendran

We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and…

Machine Learning · Computer Science 2012-07-02 Yuhong Guo , Dale Schuurmans

Recently, it has been proven that evolutionary algorithms produce good results for a wide range of combinatorial optimization problems. Some of the considered problems are tackled by evolutionary algorithms that use a representation which…

Neural and Evolutionary Computing · Computer Science 2013-01-18 Benjamin Doerr , Anton Eremeev , Frank Neumann , Madeleine Theile , Christian Thyssen

This paper considers unconstrained convex optimization problems with time-varying objective functions. We propose algorithms with a discrete time-sampling scheme to find and track the solution trajectory based on prediction and correction…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Aryan Mokhtari , Alec Koppel , Geert Leus , Alejandro Ribeiro

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

We introduce the convex combinatorial optimization problem, a far reaching generalization of the standard linear combinatorial optimization problem. We show that it is strongly polynomial time solvable over any edge-guaranteed family, and…

Combinatorics · Mathematics 2007-05-23 Shmuel Onn , Uriel G. Rothblum

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

Typically, the sequence of points generated by an optimization algorithm may have multiple limit points. Under convexity assumptions, however, (sub)gradient methods are known to generate a convergent sequence of points. In this paper, we…

Optimization and Control · Mathematics 2025-06-16 Andrea Cristofari

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

In this work, we propose a method for determining a non-uniform sampling scheme for multi-dimensional signals by solving a convex optimization problem reminiscent of the sensor selection problem. The resulting sampling scheme minimizes the…

Methodology · Statistics 2017-07-12 Johan Swärd , Filip Elvander , Andreas Jakobsson

In the literature, there are a few researches to design some parameters in the Proximal Point Algorithm (PPA), especially for the multi-objective convex optimizations. Introducing some parameters to PPA can make it more flexible and…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Jicheng Li , Pingfan Dai , Jiaofen Li

Mappings to structured output spaces (strings, trees, partitions, etc.) are typically learned using extensions of classification algorithms to simple graphical structures (eg., linear chains) in which search and parameter estimation can be…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

This paper presents Bundle Network, a learning-based algorithm inspired by the Bundle Method for convex non-smooth minimization problems. Unlike classical approaches that rely on heuristic tuning of a regularization parameter, our method…

Optimization and Control · Mathematics 2025-09-30 Francesca Demelas , Joseph Le Roux , Antonio Frangioni , Mathieu Lacroix , Emiliano Traversi , Roberto Wolfler Calvo

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal