English
Related papers

Related papers: Fast Perturbative Algorithm Configurators

200 papers

We consider the problem of implementing linearizable objects that support both read and read-modify-write (RMW) operations in message-passing systems with process crashes. Since in many systems read operations vastly outnumber RMW…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-05 Changyu Bi , Vassos Hadzilacos , Sam Toueg

The general applicability and ease of use of the pseudo-marginal Metropolis--Hastings (PMMH) algorithm, and particle Metropolis--Hastings in particular, makes it a popular method for inference on discretely observed Markovian stochastic…

Statistics Theory · Mathematics 2024-11-19 Chris Sherlock

Optimization in distributed networks plays a central role in almost all distributed machine learning problems. In principle, the use of distributed task allocation has reduced the computational time, allowing better response rates and…

Optimization and Control · Mathematics 2020-07-28 Elie Atallah , Nazanin Rahnavard , Chinwendu Enyioha

We introduce a new quantum optimization algorithm for dense Linear Programming problems, which can be seen as the quantization of the Interior Point Predictor-Corrector algorithm \cite{Predictor-Corrector} using a Quantum Linear System…

Quantum Physics · Physics 2020-10-15 P. A. M. Casares , M. A. Martin-Delgado

We argue that proven exponential upper bounds on runtimes, an established area in classic algorithms, are interesting also in heuristic search and we prove several such results. We show that any of the algorithms randomized local search,…

Neural and Evolutionary Computing · Computer Science 2021-10-12 Benjamin Doerr

Perturbing a deterministic $n$-dimensional matrix with small Gaussian noise is a cornerstone of smoothed analysis of algorithms [Spielman and Teng, JACM 2004], as it reduces the condition number of the input to $O(n)$, and with it the…

Data Structures and Algorithms · Computer Science 2026-04-28 Shabarish Chenakkod , Michał Dereziński , Xiaoyu Dong , Mark Rudelson

A large-scale complex system comprising many, often spatially distributed, dynamical subsystems with partial autonomy and complex interactions are called system of systems. This paper describes an efficient algorithm for model predictive…

Optimization and Control · Mathematics 2019-04-25 Branimir Novoselnik , Vedrana Spudić , Mato Baotić

Optimization in distributed networks plays a central role in almost all distributed machine learning problems. In principle, the use of distributed task allocation has reduced the computational time, allowing better response rates and…

Optimization and Control · Mathematics 2021-08-23 Elie Atallah , Nazanin Rahnavard , Chinwendu Enyioha

We consider the problem of configuring general-purpose solvers to run efficiently on problem instances drawn from an unknown distribution. The goal of the configurator is to find a configuration that runs fast on average on most instances,…

Machine Learning · Computer Science 2018-07-03 Gellért Weisz , András György , Csaba Szepesvári

In this paper, we develop a simple and fast online algorithm for solving a class of binary integer linear programs (LPs) arisen in general resource allocation problem. The algorithm requires only one single pass through the input data and…

Data Structures and Algorithms · Computer Science 2020-07-07 Xiaocheng Li , Chunlin Sun , Yinyu Ye

The performance of an algorithm often critically depends on its parameter configuration. While a variety of automated algorithm configuration methods have been proposed to relieve users from the tedious and error-prone task of manually…

Artificial Intelligence · Computer Science 2022-05-30 Steven Adriaensen , André Biedenkapp , Gresa Shala , Noor Awad , Theresa Eimer , Marius Lindauer , Frank Hutter

This paper deals with the problem of parameter estimation based on certain eigenspaces of the empirical covariance matrix of an observed multidimensional time series, in the case where the time series dimension and the observation window…

Probability · Mathematics 2012-08-22 Walid Hachem , Philippe Loubaton , X. Mestre , Jamal Najim , Pascal Vallet

Parameterized runtime analysis seeks to understand the influence of problem structure on algorithmic runtime. In this paper, we contribute to the theoretical understanding of evolutionary algorithms and carry out a parameterized analysis of…

Neural and Evolutionary Computing · Computer Science 2012-10-10 Andrew M. Sutton , Frank Neumann

We propose a unified framework to speed up the existing stochastic matrix factorization (SMF) algorithms via variance reduction. Our framework is general and it subsumes several well-known SMF formulations in the literature. We perform a…

Machine Learning · Statistics 2017-05-23 Renbo Zhao , William B. Haskell , Jiashi Feng

Machine Learning (ML) algorithms have been increasingly applied to problems from several different areas. Despite their growing popularity, their predictive performance is usually affected by the values assigned to their hyperparameters…

This paper presents an asynchronous incremental aggregated gradient algorithm and its implementation in a parameter server framework for solving regularized optimization problems. The algorithm can handle both general convex (possibly…

Optimization and Control · Mathematics 2016-10-19 Arda Aytekin , Hamid Reza Feyzmahdavian , Mikael Johansson

Metaheuristic algorithms are widely used for solving complex optimization problems, yet their effectiveness is often constrained by fixed structures and the need for extensive tuning. The Polymorphic Metaheuristic Framework (PMF) addresses…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Faramarz Safi Esfahani , Ghassan Beydoun , Morteza Saberi , Brad McCusker , Biswajeet Pradhan

Tuning parameters is an important step for the application of metaheuristics to problem classes of interest. In this work we present a tuning framework based on the sequential optimization of perturbed regression models. Besides providing…

Neural and Evolutionary Computing · Computer Science 2019-12-02 Áthila R. Trindade , Felipe Campelo

The stability analysis of model predictive control schemes without terminal constraints and/or costs has attracted considerable attention during the last years. We pursue a recently proposed approach which can be used to determine a…

Optimization and Control · Mathematics 2014-01-16 Philipp Braun , Jürgen Pannek , Karl Worthmann

Recently there has been sustained interest in modifying prediction algorithms to satisfy fairness constraints. These constraints are typically complex nonlinear functionals of the observed data distribution. Focusing on the path-specific…

Machine Learning · Statistics 2022-04-15 Razieh Nabi , Daniel Malinsky , Ilya Shpitser