English
Related papers

Related papers: Slide Reduction, Revisited---Filling the Gaps in S…

200 papers

We present algorithms for the $(1+\epsilon)$-approximate version of the closest vector problem for certain norms. The currently fastest algorithm (Dadush and Kun 2016) for general norms has running time of $2^{O(n)} (1/\epsilon)^n$. We…

Data Structures and Algorithms · Computer Science 2021-11-03 Márton Naszódi , Moritz Venzin

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

Machine Learning · Statistics 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

In recent years, stochastic variance reduction algorithms have attracted considerable attention for minimizing the average of a large but finite number of loss functions. This paper proposes a novel Riemannian extension of the Euclidean…

Machine Learning · Computer Science 2019-06-03 Hiroyuki Sato , Hiroyuki Kasai , Bamdev Mishra

A stationary value based algorithm (SVA) is provided to solve the nearest Kronecker product decomposition (KPD) problem of vector form hypermatrices. Using the algorithm successively, the finite sum KPD is also solved. Then the permutation…

Numerical Analysis · Mathematics 2026-03-17 Daizhan Cheng

We give a nearly optimal sublinear-time algorithm for approximating the size of a minimum vertex cover in a graph G. The algorithm may query the degree deg(v) of any vertex v of its choice, and for each 1 <= i <= deg(v), it may ask for the…

Data Structures and Algorithms · Computer Science 2011-10-06 Krzysztof Onak , Dana Ron , Michal Rosen , Ronitt Rubinfeld

In this work, we provide a fundamental unified convergence theorem used for deriving expected and almost sure convergence results for a series of stochastic optimization methods. Our unified theorem only requires to verify several…

Optimization and Control · Mathematics 2022-10-20 Xiao Li , Andre Milzarek

We show a $2^{n/2+o(n)}$-time algorithm that finds a (non-zero) vector in a lattice $\mathcal{L} \subset \mathbb{R}^n$ with norm at most $\tilde{O}(\sqrt{n})\cdot \min\{\lambda_1(\mathcal{L}), \det(\mathcal{L})^{1/n}\}$, where…

Data Structures and Algorithms · Computer Science 2020-07-21 Divesh Aggarwal , Zeyong Li , Noah Stephens-Davidowitz

In this paper, we propose a proximal stochasitc gradient algorithm (PSGA) for solving composite optimization problems by incorporating variance reduction techniques and an adaptive step-size strategy. In the PSGA method, the objective…

Optimization and Control · Mathematics 2026-04-06 Changjie Fang , Hao Yang , Shenglan Chen

We present preconditioned stochastic gradient descent (SGD) algorithms for the $\ell_1$ minimization problem $\min_{x}\|A x - b\|_1$ in the overdetermined case, where there are far more constraints than variables. Specifically, we have $A…

Data Structures and Algorithms · Computer Science 2018-06-04 David Durfee , Kevin A. Lai , Saurabh Sawlani

We study approximability of subdense instances of various covering problems on graphs, defined as instances in which the minimum or average degree is Omega(n/psi(n)) for some function psi(n)=omega(1) of the instance size. We design new…

Data Structures and Algorithms · Computer Science 2010-11-10 Jean Cardinal , Marek Karpinski , Richard Schmied , Claus Viehmann

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimize a single common…

Machine Learning · Computer Science 2022-04-19 Jarek Duda

We optimally resolve the space complexity for the problem of finding an $\alpha$-approximate minimum vertex cover ($\alpha$MVC) in dynamic graph streams. We give a randomised algorithm for $\alpha$MVC which uses $O(n^2/\alpha^2)$ bits of…

Data Structures and Algorithms · Computer Science 2022-09-14 Kheeran K. Naidu , Vihan Shah

Evaluating the expectation of a quantum circuit is a classically difficult problem known as the quantum mean value problem (QMV). It is used to optimize the quantum approximate optimization algorithm and other variational quantum…

Quantum Physics · Physics 2022-05-25 David Joseph , Antonio J. Martinez , Cong Ling , Florian Mintert

In this paper, we propose new classes of trapdoor functions to solve the closest vector problem in lattices. Specifically, we construct lattices based on properties of polynomials for which the closest vector problem is hard to solve unless…

Cryptography and Security · Computer Science 2017-10-09 Zhe Li , San Ling , Chaoping Xing , Sze Ling Yeo

We initiate the algorithmic study of retracting a graph into a cycle in the graph, which seeks a mapping of the graph vertices to the cycle vertices, so as to minimize the maximum stretch of any edge, subject to the constraint that the…

Data Structures and Algorithms · Computer Science 2019-04-29 Samuel Haney , Mehraneh Liaee , Bruce M. Maggs , Debmalya Panigrahi , Rajmohan Rajaraman , Ravi Sundaram

In the context of finite sums minimization, variance reduction techniques are widely used to improve the performance of state-of-the-art stochastic gradient methods. Their practical impact is clear, as well as their theoretical properties.…

Optimization and Control · Mathematics 2024-08-07 Cheik Traoré , Vassilis Apidopoulos , Saverio Salzo , Silvia Villa

The security of lattice-based cryptosystems such as NTRU, GGH and Ajtai-Dwork essentially relies upon the intractability of computing a shortest non-zero lattice vector and a closest lattice vector to a given target vector in high…

Cryptography and Security · Computer Science 2009-04-16 Guillaume Hanrot , Damien Stehlé

This paper investigates the approximability of the Longest Common Subsequence (LCS) problem. The fastest algorithm for solving the LCS problem exactly runs in essentially quadratic time in the length of the input, and it is known that under…

Data Structures and Algorithms · Computer Science 2021-05-10 Shyan Akmal , Virginia Vassilevska Williams

Given a graph $G=(V,E)$ with $V=\{1,\ldots,n\}$, we place on every vertex a token $T_1,\ldots,T_n$. A swap is an exchange of tokens on adjacent vertices. We consider the algorithmic question of finding a shortest sequence of swaps such that…

Computational Complexity · Computer Science 2017-07-28 Tillmann Miltzow , Lothar Narins , Yoshio Okamoto , Günter Rote , Antonis Thomas , Takeaki Uno

We study a fundamental stochastic selection problem involving $n$ independent random variables, each of which can be queried at some cost. Given a tolerance level $\delta$, the goal is to find a value that is $\delta$-approximately minimum…

Data Structures and Algorithms · Computer Science 2025-04-25 Hessa Al-Thani , Viswanath Nagarajan