English
Related papers

Related papers: A linear lower bound for incrementing a space-opti…

200 papers

The paper presents a systematic study and implementation of a reconfigurable combinatorial multi-operand adder for use in Deep Learning systems. The size of carry changes with the number of operands and hence a reliable algorithm to…

Hardware Architecture · Computer Science 2020-08-10 Shilpa Mayannavar , Uday Wali

We prove optimal bounds for the convergence rate of ordinal embedding (also known as non-metric multidimensional scaling) in the 1-dimensional case. The examples witnessing optimality of our bounds arise from a result in additive number…

Statistics Theory · Mathematics 2019-05-01 Jordan S. Ellenberg , Lalit Jain

Iterative deepening search is used in applications where the best cost bound for state-space search is unknown. The iterative deepening process is used to avoid overshooting the appropriate cost bound and doing too much work as a result.…

Artificial Intelligence · Computer Science 2019-06-10 Nathan Sturtevant , Malte Helmert

We deal with a problem of finding maximum of a function from the Holder class on a quantum computer. We show matching lower and upper bounds on the complexity of this problem. We prove upper bounds by constructing an algorithm that uses the…

Quantum Physics · Physics 2007-05-23 Maciej Gocwin

A method for bounding the rate of bit-stuffing encoders for 2-D constraints is presented. Instead of considering the original encoder, we consider a related one which is quasi-stationary. We use the quasi-stationary property in order to…

Information Theory · Computer Science 2009-06-15 Ido Tal , Ron M. Roth

A tight lower bound for required I/O when computing an ordinary matrix-matrix multiplication on a processor with two layers of memory is established. Prior work obtained weaker lower bounds by reasoning about the number of segments needed…

Computational Complexity · Computer Science 2019-02-07 Tyler Michael Smith , Bradley Lowery , Julien Langou , Robert A. van de Geijn

The problem of storing permutations in a distributed manner arises in several common scenarios, such as efficient updates of a large, encrypted, or compressed data set. This problem may be addressed in either a combinatorial or a coding…

Information Theory · Computer Science 2016-05-05 Netanel Raviv , Eitan Yaakobi , Muriel Medard

We consider set covering problems where the underlying set system satisfies a particular replacement property w.r.t. a given partial order on the elements: Whenever a set is in the set system then a set stemming from it via the replacement…

Discrete Mathematics · Computer Science 2015-03-17 Friedrich Eisenbrand , Naonori Kakimura , Thomas Rothvoß , Laura Sanità

Minimum distance is an important parameter of a linear error correcting code. For improved performance of binary Low Density Parity Check (LDPC) codes, we need to have the minimum distance grow fast with n, the codelength. However, the best…

Information Theory · Computer Science 2009-06-12 Rethnakaran Pulikkoonattu

In the numerical linear algebra community, it was suggested that to obtain nearly optimal bounds for various problems such as rank computation, finding a maximal linearly independent subset of columns (a basis), regression, or low-rank…

Data Structures and Algorithms · Computer Science 2021-11-04 Nadiia Chepurko , Kenneth L. Clarkson , Praneeth Kacham , David P. Woodruff

Linear fixed point equations in Hilbert spaces arise in a variety of settings, including reinforcement learning, and computational methods for solving differential and integral equations. We study methods that use a collection of random…

Machine Learning · Computer Science 2020-12-11 Wenlong Mou , Ashwin Pananjady , Martin J. Wainwright

Given matrices A and B and vectors a, b, c and d, all with non-negative entries, we consider the problem of computing min {c.x: x in Z^n_+, Ax > a, Bx < b, x < d}. We give a bicriteria-approximation algorithm that, given epsilon in (0, 1],…

Data Structures and Algorithms · Computer Science 2015-06-02 Stavros G. Kolliopoulos , Neal E. Young

In this paper, we study the problem of relaying a single bit over a tandem of binary-input channels, with the goal of attaining the highest possible error exponent in the exponentially decaying error probability. Our previous work gave an…

Information Theory · Computer Science 2024-06-07 Yan Hao Ling , Jonathan Scarlett

We present an algorithm for computing upper bounds for the Online Bin Stretching Problem with a small number of bins and the resulting upper bounds for 4, 5 and 6 bins. This both demonstrates the possibility of using computer search for…

Data Structures and Algorithms · Computer Science 2022-02-01 Matej Lieskovský

The Bandwidth Problem seeks for a simultaneous permutation of the rows and columns of the adjacency matrix of a graph such that all nonzero entries are as close as possible to the main diagonal. This work focuses on investigating novel…

Optimization and Control · Mathematics 2021-07-07 Franz Rendl , Renata Sotirov , Christian Truden

Effective caching is crucial for the performance of modern-day computing systems. A key optimization problem arising in caching -- which item to evict to make room for a new item -- cannot be optimally solved without knowing the future.…

Machine Learning · Computer Science 2021-06-29 Jakub Chłędowski , Adam Polak , Bartosz Szabucki , Konrad Zolna

Inference-time computation offers a powerful axis for scaling the performance of language models. However, naively increasing computation in techniques like Best-of-N sampling can lead to performance degradation due to reward hacking.…

Artificial Intelligence · Computer Science 2025-04-09 Audrey Huang , Adam Block , Qinghua Liu , Nan Jiang , Akshay Krishnamurthy , Dylan J. Foster

Motivated by Bland's linear-programming generalization of the renowned Edmonds-Karp efficient refinement of the Ford-Fulkerson maximum-flow algorithm, we discuss three closely-related natural augmentation rules for linear and integer-linear…

Optimization and Control · Mathematics 2016-05-18 Jesus A. De Loera , Raymond Hemmecke , Jon Lee

We design a heuristic method, a genetic algorithm, for the computation of an upper bound of the minimum distance of a linear code over a finite field. By the use of the row reduced echelon form, we obtain a permutation encoding of the…

Information Theory · Computer Science 2018-07-20 José Gómez-Torrecillas , F. J. Lobillo , Gabriel Navarro

High-dimensional models often have a large memory footprint and must be quantized after training before being deployed on resource-constrained edge devices for inference tasks. In this work, we develop an information-theoretic framework for…

Information Theory · Computer Science 2022-09-01 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith