English
Related papers

Related papers: On the I/O complexity of hybrid algorithms for Int…

200 papers

Matrix multiplication (hereafter we use the acronym MM) is among the most fundamental operations of modern computations. The efficiency of its performance depends on various factors, in particular vectorization, data movement and arithmetic…

Data Structures and Algorithms · Computer Science 2015-02-09 Victor Y. Pan

We deal with a problem of finding maximum of a function from the Holder class on a quantum computer. We show matching lower and upper bounds on the complexity of this problem. We prove upper bounds by constructing an algorithm that uses the…

Quantum Physics · Physics 2007-05-23 Maciej Gocwin

It is known that the multiplication of an $N \times M$ matrix with an $M \times P$ matrix can be performed using fewer multiplications than what the naive $NMP$ approach suggests. The most famous instance of this is Strassen's algorithm for…

Artificial Intelligence · Computer Science 2023-07-18 Arnaud Deza , Chang Liu , Pashootan Vaezipoor , Elias B. Khalil

We give a new proof of F\"urer's bound for the cost of multiplying n-bit integers in the bit complexity model. Unlike F\"urer, our method does not require constructing special coefficient rings with "fast" roots of unity. Moreover, we prove…

Computational Complexity · Computer Science 2014-07-15 David Harvey , Joris van der Hoeven , Grégoire Lecerf

We study the bit complexity of two related fundamental computational problems in linear algebra and control theory. Our results are: (1) An $\tilde{O}(n^{\omega+3}a+n^4a^2+n^\omega\log(1/\epsilon))$ time algorithm for finding an…

Data Structures and Algorithms · Computer Science 2022-11-29 Papri Dey , Ravi Kannan , Nick Ryder , Nikhil Srivastava

Reducing communication - either between levels of a memory hierarchy or between processors over a network - is a key component of performance optimization (in both time and energy) for many problems, including dense linear algebra, particle…

Data Structures and Algorithms · Computer Science 2020-03-03 Grace Dinh , James Demmel

We describe a model that enables us to analyze the running time of an algorithm in a computer with a memory hierarchy with limited associativity, in terms of various cache parameters. Our model, an extension of Aggarwal and Vitter's I/O…

Hardware Architecture · Computer Science 2007-05-23 Sandeep Sen , Siddhartha Chatterjee , Neeraj Dumir

In a sequence of recent results (PODC 2015 and PODC 2016), the running time of the fastest algorithm for the \emph{minimum spanning tree (MST)} problem in the \emph{Congested Clique} model was first improved to $O(\log \log \log n)$ from…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-19 Sriram V. Pemmaraju , Vivek B. Sardeshmukh

We study the maximum $k$-set coverage problem in the following distributed setting. A collection of sets $S_1,\ldots,S_m$ over a universe $[n]$ is partitioned across $p$ machines and the goal is to find $k$ sets whose union covers the most…

Data Structures and Algorithms · Computer Science 2018-08-24 Sepehr Assadi , Sanjeev Khanna

Recent advances in randomized incremental methods for minimizing $L$-smooth $\mu$-strongly convex finite sums have culminated in tight complexity of $\tilde{O}((n+\sqrt{n L/\mu})\log(1/\epsilon))$ and $O(n+\sqrt{nL/\epsilon})$, where…

Machine Learning · Computer Science 2020-02-11 Yossi Arjevani , Amit Daniely , Stefanie Jegelka , Hongzhou Lin

Submodular maximization is a classic algorithmic problem with multiple applications in data mining and machine learning; there, the growing need to deal with massive instances motivates the design of algorithms balancing the quality of the…

Data Structures and Algorithms · Computer Science 2024-02-20 Georgios Amanatidis , Federico Fusco , Philip Lazos , Stefano Leonardi , Alberto Marchetti Spaccamela , Rebecca Reiffenhäuser

Mixed-integer mathematical programs are among the most commonly used models for a wide set of problems in Operations Research and related fields. However, there is still very little known about what can be expressed by small mixed-integer…

Discrete Mathematics · Computer Science 2017-12-07 Alfonso Cevallos , Stefan Weltge , Rico Zenklusen

The CONGEST and CONGEST-CLIQUE models have been carefully studied to represent situations where the communication bandwidth between processors in a network is severely limited. Messages of only $O(log(n))$ bits of information each may be…

Many recent studies on first-order methods (FOMs) focus on \emph{composite non-convex non-smooth} optimization with linear and/or nonlinear function constraints. Upper (or worst-case) complexity bounds have been established for these…

Optimization and Control · Mathematics 2023-07-18 Wei Liu , Qihang Lin , Yangyang Xu

We present new randomized algorithms that improve the complexity of the classic $(\Delta+1)$-coloring problem, and its generalization $(\Delta+1)$-list-coloring, in three well-studied models of distributed, parallel, and centralized…

Data Structures and Algorithms · Computer Science 2018-11-06 Yi-Jun Chang , Manuela Fischer , Mohsen Ghaffari , Jara Uitto , Yufan Zheng

Krylov methods rely on iterated matrix-vector products $A^k u_j$ for an $n\times n$ matrix $A$ and vectors $u_1,\ldots,u_m$. The space spanned by all iterates $A^k u_j$ admits a particular basis -- the \emph{maximal Krylov basis} -- which…

Symbolic Computation · Computer Science 2024-08-21 Vincent Neiger , Clément Pernet , Gilles Villard

It has been widely observed that there exists a fundamental trade-off between the minimum (Hamming) distance properties and the iterative decoding convergence behavior of turbo-like codes. While capacity achieving code ensembles typically…

This paper studies the iteration-complexity of a new primal-dual algorithm based on Rockafellar's proximal method of multipliers (PMM) for solving smooth convex programming problems with inequality constraints. In each step, either a step…

Optimization and Control · Mathematics 2016-02-23 M. Marques Alves , R. D. C. Monteiro , Benar F. Svaiter

Roughgarden, Vassilvitskii, and Wang (JACM 18) recently introduced a novel framework for proving lower bounds for Massively Parallel Computation using techniques from boolean function complexity. We extend their framework in two different…

Data Structures and Algorithms · Computer Science 2020-01-07 Moses Charikar , Weiyun Ma , Li-Yang Tan

We consider the algorithm by Ferson et al. (Reliable computing 11(3), p. 207-233, 2005) designed for solving the NP-hard problem of computing the maximal sample variance over interval data, motivated by robust statistics (in fact, the…

Optimization and Control · Mathematics 2022-07-28 Miroslav Rada , Michal Černý , Ondřej Sokol