English
Related papers

Related papers: (Learned) Frequency Estimation Algorithms under Zi…

200 papers

Randomized algorithms can be used to speed up the analysis of large datasets. In this paper, we develop a unified methodology for statistical inference via randomized sketching or projections in two of the most fundamental problems in…

Statistics Theory · Mathematics 2024-04-02 Leda Wang , Zhixiang Zhang , Edgar Dobriban

Fueled by applications in sensor networks, these years have witnessed a surge of interest in distributed estimation and filtering. A new approach is hereby proposed for the Distributed Kalman Filter (DKF) by integrating a local covariance…

Systems and Control · Computer Science 2017-03-17 Ye Yuan , Ling Shi , Jun Liu , Zhiyong Chen , Hai-Tao Zhang , Jorge Goncalves

We consider statistical and algorithmic aspects of solving large-scale least-squares (LS) problems using randomized sketching algorithms. Prior results show that, from an \emph{algorithmic perspective}, when using sketching matrices…

Machine Learning · Statistics 2015-05-26 Garvesh Raskutti , Michael Mahoney

Many streaming algorithms provide only a high-probability relative approximation. These two relaxations, of allowing approximation and randomization, seem necessary -- for many streaming problems, both relaxations must be employed…

Data Structures and Algorithms · Computer Science 2023-05-16 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Shay Sapir

We introduce a framework for proving lower bounds on computational problems over distributions against algorithms that can be implemented using access to a statistical query oracle. For such algorithms, access to the input distribution is…

Computational Complexity · Computer Science 2016-08-16 Vitaly Feldman , Elena Grigorescu , Lev Reyzin , Santosh Vempala , Ying Xiao

Researchers may perform regressions using a sketch of data of size $m$ instead of the full sample of size $n$ for a variety of reasons. This paper considers the case when the regression errors do not have constant variance and…

Machine Learning · Statistics 2022-06-23 Sokbae Lee , Serena Ng

The estimation of the frequencies of multiple superimposed exponentials in noise is an important research problem due to its various applications from engineering to chemistry. In this paper, we propose an efficient and accurate algorithm…

Numerical Analysis · Mathematics 2016-05-05 Shanglin Ye , Elias Aboutanios

The Min-Hashing approach to sketching has become an important tool in data analysis, information retrial, and classification. To apply it to real-valued datasets, the ICWS algorithm has become a seminal approach that is widely used, and…

Machine Learning · Statistics 2018-10-24 Edward Raff , Jared Sylvester , Charles Nicholas

Low Rank Approximation is among most fundamental subjects of numerical linear algebra having important applications to various areas of modern computing and %they range from machine learning theory and %neural networks to data mining and…

Numerical Analysis · Mathematics 2018-09-25 Victor Y. Pan , Qi Luan , John Svadlenka , Liang Zhao

Unaggregated data, in streamed or distributed form, is prevalent and come from diverse application domains which include interactions of users with web services and IP traffic. Data elements have {\em keys} (cookies, users, queries) and…

Information Retrieval · Computer Science 2015-06-30 Edith Cohen

In this work, we investigate Batch Normalization technique and propose its probabilistic interpretation. We propose a probabilistic model and show that Batch Normalization maximazes the lower bound of its marginalized log-likelihood. Then,…

Machine Learning · Statistics 2018-03-22 Andrei Atanov , Arsenii Ashukha , Dmitry Molchanov , Kirill Neklyudov , Dmitry Vetrov

In a typical multi-standard military communication receiver, fast and reliable spectrum sensing unit is required to extract the information of multiple channels (frequency bands) present in a wideband input signal. In this paper, an energy…

Information Theory · Computer Science 2016-08-16 S. J. Darak , A. P. Vinod , E. M-K. Lai

Sketching uses randomized Hash functions for dimensionality reduction and acceleration. The existing sketching methods, such as count sketch (CS), tensor sketch (TS), and higher-order count sketch (HCS), either suffer from low accuracy or…

Machine Learning · Computer Science 2021-06-25 Xingyu Cao , Jiani Liu

The estimation of coverage probabilities, and in particular of the missing mass, is a classical statistical problem with applications in numerous scientific fields. In this paper, we study this problem in relation to randomized data…

Methodology · Statistics 2022-09-07 Stefano Favaro , Matteo Sesia

A technique introduced by Indyk and Woodruff [STOC 2005] has inspired several recent advances in data-stream algorithms. We show that a number of these results follow easily from the application of a single probabilistic method called…

Data Structures and Algorithms · Computer Science 2011-04-26 Alexandr Andoni , Robert Krauthgamer , Krzysztof Onak

Typical analysis of content caching algorithms using the metric of steady state hit probability under a stationary request process does not account for performance loss under a variable request arrival process. In this work, we consider…

Networking and Internet Architecture · Computer Science 2018-04-10 Jian Li , Srinivas Shakkottai , John C. S. Lui , Vijay Subramanian

There is a need for fast adaptation in spike sorting algorithms to implement brain-machine interface (BMIs) in different applications. Learning and adapting the functionality of the sorting process in real-time can significantly improve the…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Tao Fang , Majid Zamani

We adapt a well known streaming algorithm for approximating item frequencies to the matrix sketching setting. The algorithm receives the rows of a large matrix $A \in \R^{n \times m}$ one after the other in a streaming fashion. It maintains…

Data Structures and Algorithms · Computer Science 2012-07-12 Edo Liberty

In this paper we consider large-scale smooth optimization problems with multiple linear coupled constraints. Due to the non-separability of the constraints, arbitrary random sketching would not be guaranteed to work. Thus, we first…

Optimization and Control · Mathematics 2018-08-09 Ion Necoara , Martin Takac

Accounting for the uncertainty in the predictions of modern neural networks is a challenging and important task in many domains. Existing algorithms for uncertainty estimation require modifying the model architecture and training procedure…

Machine Learning · Statistics 2022-05-09 Alexander Fishkov , Maxim Panov