English
Related papers

Related papers: Parallel Self-Avoiding Walks for a Low-Autocorrela…

200 papers

We describe an asynchronous parallel stochastic proximal coordinate descent algorithm for minimizing a composite objective function, which consists of a smooth convex function plus a separable convex function. In contrast to previous…

Optimization and Control · Mathematics 2015-12-14 Ji Liu , Stephen J. Wright

This paper presents the design and analysis of parallel approximation algorithms for facility-location problems, including $\NC$ and $\RNC$ algorithms for (metric) facility location, $k$-center, $k$-median, and $k$-means. These problems…

Data Structures and Algorithms · Computer Science 2010-06-11 Guy E. Blelloch , Kanat Tangwongsan

In [1], we proposed a graph-based formulation that links and clusters person hypotheses over time by solving a minimum cost subgraph multicut problem. In this paper, we modify and extend [1] in three ways: 1) We introduce a novel local…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Siyu Tang , Bjoern Andres , Mykhaylo Andriluka , Bernt Schiele

Stochastic Dual Coordinate Descent (SDCD) has become one of the most efficient ways to solve the family of $\ell_2$-regularized empirical risk minimization problems, including linear SVM, logistic regression, and many others. The vanilla…

Machine Learning · Computer Science 2015-04-07 Cho-Jui Hsieh , Hsiang-Fu Yu , Inderjit S. Dhillon

In the realm of big data and machine learning, data-parallel, distributed stochastic algorithms have drawn significant attention in the present days.~While the synchronous versions of these algorithms are well understood in terms of their…

Optimization and Control · Mathematics 2020-04-07 Atal Narayan Sahu , Aritra Dutta , Aashutosh Tiwari , Peter Richtárik

We present a parallel algorithm for computing the minimum s-t cut in structured 3-dimensional proper order graphs arising from image segmentation problems. Proper order graphs are multi-column structures where vertices are arranged in…

Data Structures and Algorithms · Computer Science 2026-01-27 Shridharan Chandramouli

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for parallel…

Machine Learning · Statistics 2023-02-07 Jeffrey Chan , Aldo Pacchiano , Nilesh Tripuraneni , Yun S. Song , Peter Bartlett , Michael I. Jordan

The Merit Factor (MF) measure was first introduced by Golay in 1972. Sequences possessing large values of MF are of great interest to a rich list of disciplines - from physics and chemistry to digital communications, signal processing, and…

Information Theory · Computer Science 2022-06-27 Miroslav Dimitrov

Parallel Speculative Decoding (PSD) accelerates traditional Speculative Decoding (SD) by overlapping draft generation with verification. However, it remains hampered by two fundamental challenges: (1) a theoretical speedup ceiling dictated…

Computation and Language · Computer Science 2026-04-15 Yuhao Shen , Tianyu Liu , Junyi Shen , Jinyang Wu , Quan Kong , Li Huan , Cong Wang

This paper proposes a parallel-in-time method for computing continuous-time maximum-a-posteriori (MAP) trajectory estimates of the states of partially observed stochastic differential equations (SDEs), with the goal of improving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Hassan Razavi , Ángel F. García-Fernández , Simo Särkkä

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies Comput. Optim. Appl. 72(3):609--640, 2019] to minimize the sum of a partially separable…

Optimization and Control · Mathematics 2025-08-06 Ronaldo Lopes , Sandra A. Santos , Paulo J. S. Silva

The maximum integer skew-symmetric flow problem (MSFP) generalizes both the maximum flow and maximum matching problems. It was introduced by Tutte in terms of self-conjugate flows in antisymmetrical digraphs. He showed that for these…

Combinatorics · Mathematics 2010-11-15 Andrew V. Goldberg , Alexander V. Karzanov

We describe an asynchronous parallel stochastic coordinate descent algorithm for minimizing smooth unconstrained or separably constrained functions. The method achieves a linear convergence rate on functions that satisfy an essential strong…

Optimization and Control · Mathematics 2014-11-12 Ji Liu , Stephen J. Wright , Christopher Ré , Victor Bittorf , Srikrishna Sridhar

We seek tight bounds on the viable parallelism in asynchronous implementations of coordinate descent that achieves linear speedup. We focus on asynchronous coordinate descent (ACD) algorithms on convex functions which consist of the sum of…

Optimization and Control · Mathematics 2020-08-04 Yun Kuen Cheung , Richard Cole , Yixin Tao

Parallel-across-the method time integration can provide small scale parallelism when solving initial value problems. Spectral deferred corrections (SDC) with a diagonal sweeper, which is closely related to iterated Runge-Kutta methods…

Numerical Analysis · Mathematics 2025-02-12 Gayatri Čaklović , Thibaut Lunet , Sebastian Götschel , Daniel Ruprecht

We investigate the parallel performance of Parallel Spectral Deferred corrections, a numerical approach that provides small-scale parallelism for the numerical solution of initial value problems. The scheme is applied to the shallow-water…

Computational Engineering, Finance, and Science · Computer Science 2026-03-04 Philip Freese , Sebastian Götschel , Thibaut Lunet , Daniel Ruprecht , Martin Schreiber

Matching pursuit algorithms are an important class of algorithms in signal processing and machine learning. We present a blended matching pursuit algorithm, combining coordinate descent-like steps with stronger gradient descent steps, for…

Optimization and Control · Mathematics 2019-11-21 Cyrille W. Combettes , Sebastian Pokutta

Binary sequences with minimal autocorrelations have applications in communication engineering, mathematics and computer science. In statistical physics they appear as groundstates of the Bernasconi model. Finding these sequences is a…

Statistical Mechanics · Physics 2016-03-25 Tom Packebusch , Stephan Mertens

We study a family of distributed stochastic optimization algorithms where gradients are sampled by a token traversing a network of agents in random-walk fashion. Typically, these random-walks are chosen to be Markov chains that…

Probability · Mathematics 2024-01-19 Jie Hu , Vishwaraj Doshi , Do Young Eun

A skew-symmetric graph $(D=(V,A),\sigma)$ is a directed graph $D$ with an involution $\sigma$ on the set of vertices and arcs. In this paper, we introduce a separation problem, $d$-Skew-Symmetric Multicut, where we are given a…

Data Structures and Algorithms · Computer Science 2013-04-30 M. S. Ramanujan , Saket Saurabh