English
Related papers

Related papers: Rate of metastability of an iterative algorithm fo…

200 papers

We introduce a new iterative method for computing solutions of elliptic equations with random rapidly oscillating coefficients. Similarly to a multigrid method, each step of the iteration involves different computations meant to address…

Numerical Analysis · Mathematics 2020-03-31 S. Armstrong , A. Hannukainen , T. Kuusi , J. -C. Mourrat

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

Extremal Optimization, a recently introduced meta-heuristic for hard optimization problems, is analyzed on a simple model of jamming. The model is motivated first by the problem of finding lowest energy configurations for a disordered spin…

Statistical Mechanics · Physics 2018-07-06 S. Boettcher , M. Grigni

Deep Q-learning based algorithms have been applied successfully in many decision making problems, while their theoretical foundations are not as well understood. In this paper, we study a Fitted Q-Iteration with two-layer ReLU neural…

Machine Learning · Computer Science 2023-02-01 Mudit Gaur , Vaneet Aggarwal , Mridul Agarwal

Many problems in quantum information theory can be formulated as optimizations over the sequential outcomes of dynamical systems subject to unpredictable external influences. Such problems include many-body entanglement detection through…

Quantum Physics · Physics 2024-06-07 Mirjam Weilenmann , Costantino Budroni , Miguel Navascues

Optimization algorithms are increasingly being used in applications with limited time budgets. In many real-time and embedded scenarios, only a few iterations can be performed and traditional convergence metrics cannot be used to evaluate…

Optimization and Control · Mathematics 2021-12-28 Hesameddin Mohammadi , Samantha Samuelson , Mihailo R. Jovanović

We present the results of a numerical study, with 20 qubits, of the performance of the Quantum Adiabatic Algorithm on randomly generated instances of MAX 2-SAT with a unique assignment that maximizes the number of satisfied clauses. The…

Quantum Physics · Physics 2014-01-29 Elizabeth Crosson , Edward Farhi , Cedric Yen-Yu Lin , Han-Hsuan Lin , Peter Shor

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada

We consider a misspecified optimization problem that requires minimizing a function f(x;q*) over a closed and convex set X where q* is an unknown vector of parameters that may be learnt by a parallel learning process. In this context, We…

Optimization and Control · Mathematics 2015-04-17 Hesam Ahmadi , Uday V. Shanbhag

The aim of this article is to overview the problem of mean square optimal estimation of linear functionals which depend on unknown values of periodically correlated stochastic process. Estimates are based on observations of this process and…

Statistics Theory · Mathematics 2025-11-24 Iryna Dubovets'ka , Mykhailo Moklyachuk

We apply the stabilizer formalism to the Maximum Cut problem, and obtain a new greedy construction heuristic. It turns out to be an elegant synthesis of the edge-contraction and differencing edge-contraction approaches. Utilizing the…

Quantum Physics · Physics 2023-05-30 Chuixiong Wu , Jianan Wang , Fen Zuo

We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited…

Systems and Control · Electrical Eng. & Systems 2020-07-31 James Melbourne , Govind Saraswat , Vivek Khatana , Sourav Patel , Murti V. Salapaka

We propose a model for recoverable robust optimization with commitment. Given a combinatorial optimization problem and uncertainty about elements that may fail, we ask for a robust solution that, after the failing elements are revealed, can…

Data Structures and Algorithms · Computer Science 2023-06-16 Felix Hommelsheim , Nicole Megow , Komal Muluk , Britta Peis

We analyze the bit complexity of efficient algorithms for fundamental optimization problems, such as linear regression, $p$-norm regression, and linear programming (LP). State-of-the-art algorithms are iterative, and in terms of the number…

Data Structures and Algorithms · Computer Science 2023-04-06 Mehrdad Ghadiri , Richard Peng , Santosh S. Vempala

This paper is devoted to studying the global and finite convergence of the semi-smooth Newton method for solving a piecewise linear system that arises in cone-constrained quadratic programming problems and absolute value equations. We first…

Optimization and Control · Mathematics 2023-01-24 Nicolas F. Armijo , Yunier Bello-Cruz , Gabriel Haeser

Maximum likelihood iteration is one of the most commonly used reconstruction algorithms in quantum tomography. The main appeal of the method is that it is easy to implement and that it converges reliably to a physically meaningful density…

Quantum Physics · Physics 2025-08-21 Florian Oberender

We investigate in this short report the rate of increase of positive numerical recursion with quadratic non-linearity. More exactly, we intent to calculate the logarithmic index of its increasing. We present also the possible application in…

General Mathematics · Mathematics 2014-06-25 E. Ostrovsky , L. Sirota

We present novel minibatch stochastic optimization methods for empirical risk minimization problems, the methods efficiently leverage variance reduced first-order and sub-sampled higher-order information to accelerate the convergence speed.…

Optimization and Control · Mathematics 2017-10-12 Jialei Wang , Tong Zhang

We prove absolute regularity ($\beta$-mixing) for nonstationary and multivariate versions of two popular classes of integer-valued processes. We show how this result can be used to prove asymptotic normality of a least squares estimator of…

Statistics Theory · Mathematics 2024-08-29 Zinsou Max Debaly , Michael H. Neumann , Lionel Truquet

Quantum optimization algorithms hold the promise of solving classically hard, discrete optimization problems in practice. The requirement of encoding such problems in a Hamiltonian realized with a finite -- and currently small -- number of…

Quantum Physics · Physics 2023-07-10 Yifeng Rocky Zhu , David Joseph , Cong Ling , Florian Mintert