English
Related papers

Related papers: An Online Algorithm for Nonparametric Correlations

200 papers

Multivariate correlation analysis plays a key role in various fields such as statistics and big data analytics. In this paper, it is presented a new non-parametric association measure between more than two variables based on the concept of…

Methodology · Statistics 2024-02-13 Eloi Martinez-Rabert

We present a new fast online clustering algorithm that reliably recovers arbitrary-shaped data clusters in high throughout data streams. Unlike the existing state-of-the-art online clustering methods based on k-means or k-medoid, it does…

Artificial Intelligence · Computer Science 2015-06-11 Krzysztof Choromanski , Sanjiv Kumar , Xiaofeng Liu

We propose an efficient online approximate Bayesian inference algorithm for estimating the parameters of a nonlinear function from a potentially non-stationary data stream. The method is based on the extended Kalman filter (EKF), but uses a…

Machine Learning · Statistics 2023-06-29 Peter G. Chang , Gerardo Durán-Martín , Alexander Y Shestopaloff , Matt Jones , Kevin Murphy

The problem of counting collisions or interactions is common in areas as computer graphics and scientific simulations. Since it is a major bottleneck in applications of these areas, a lot of research has been carried out on such subject,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Matheus Henrique Junqueira Saldanha , Paulo Sérgio Lopes de Souza

Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the…

Networking and Internet Architecture · Computer Science 2019-03-15 Reuven Cohen , Yuval Nezri

In this paper we propose a recursive online algorithm for estimating the parameters of a time-varying ARCH process. The estimation is done by updating the estimator at time point $t-1$ with observations about the time point $t$ to yield an…

Statistics Theory · Mathematics 2009-09-29 Rainer Dahlhaus , Suhasini Subba Rao

We introduce fast algorithms for correlation clustering with respect to the Min Max objective that provide constant factor approximations on complete graphs. Our algorithms are the first purely combinatorial approximation algorithms for…

Data Structures and Algorithms · Computer Science 2023-01-31 Sami Davies , Benjamin Moseley , Heather Newman

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

A major technique in learning-augmented online algorithms is combining multiple algorithms or predictors. Since the performance of each predictor may vary over time, it is desirable to use not the single best predictor as a benchmark, but…

Machine Learning · Computer Science 2023-12-19 Antonios Antoniadis , Christian Coester , Marek Eliáš , Adam Polak , Bertrand Simon

The problem of merging databases arises in many government and commercial applications. Schema matching, a common first step, identifies equivalent fields between databases. We introduce a schema matching framework that builds nonparametric…

Information Retrieval · Computer Science 2015-07-07 Erik M. Ferragut , Jason Laska

This paper gives a k-means approximation algorithm that is efficient in the relational algorithms model. This is an algorithm that operates directly on a relational database without performing a join to convert it to a matrix whose rows…

Data Structures and Algorithms · Computer Science 2021-05-24 Benjamin Moseley , Kirk Pruhs , Alireza Samadian , Yuyan Wang

We consider the problem of sampling $n$ numbers from the range $\{1,\ldots,N\}$ without replacement on modern architectures. The main result is a simple divide-and-conquer scheme that makes sequential algorithms more cache efficient and…

Data Structures and Algorithms · Computer Science 2019-11-18 Peter Sanders , Sebastian Lamm , Lorenz Hübschle-Schneider , Emanuel Schrade , Carsten Dachsbacher

This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of…

Statistics Theory · Mathematics 2008-12-18 Joel L. Horowitz , Enno Mammen

We propose a semiparametric approach, named nonparanormal skeptic, for estimating high dimensional undirected graphical models. In terms of modeling, we consider the nonparanormal family proposed by Liu et al (2009). In terms of estimation,…

Methodology · Statistics 2012-07-03 Han Liu , Fang Han , Ming Yuan , John Lafferty , Larry Wasserman

Recently, considerable efforts have been devoted to approximately computing the global and local (i.e., incident to each node) triangle counts of a large graph stream represented as a sequence of edges. Existing approximate triangle…

Data Structures and Algorithms · Computer Science 2018-11-27 Pinghui Wang , Peng Jia , Yiyan Qi , Yu Sun , Jing Tao , Xiaohong Guan

Change point analysis has applications in a wide variety of fields. The general problem concerns the inference of a change in distribution for a set of time-ordered observations. Sequential detection is an online version in which new data…

Methodology · Statistics 2013-10-16 David S. Matteson , Nicholas A. James

Estimating the correlation coefficient has been a daunting work with the increasing complexity of dataset's pattern. One of the problems in manufacturing applications consists of the estimation of a critical process variable during a…

Methodology · Statistics 2024-06-12 Ming Luo , Srinivasan Radhakrishnan , Sagar Kamarthi

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen

We consider applying stochastic approximation (SA) methods to solve nonsmooth variational inclusion problems. Existing studies have shown that the averaged iterates of SA methods exhibit asymptotic normality, with an optimal limiting…

Machine Learning · Statistics 2025-08-13 Liwei Jiang , Abhishek Roy , Krishna Balasubramanian , Damek Davis , Dmitriy Drusvyatskiy , Sen Na

Many machine learning problems can be framed in the context of estimating functions, and often these are time-dependent functions that are estimated in real-time as observations arrive. Gaussian processes (GPs) are an attractive choice for…

Machine Learning · Statistics 2023-05-09 Michael Minyi Zhang , Bianca Dumitrascu , Sinead A. Williamson , Barbara E. Engelhardt