English
Related papers

Related papers: Large-scale entity resolution via microclustering …

200 papers

The degree of entanglement of random pure states in bipartite quantum systems can be estimated from the distribution of the extreme Schmidt eigenvalues. For a bipartition of size M\geq N, these are distributed according to a…

Mathematical Physics · Physics 2011-06-07 Gernot Akemann , Pierpaolo Vivo

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

In the modal approach to clustering, clusters are defined as the local maxima of the underlying probability density function, where the latter can be estimated either non-parametrically or using finite mixture models. Thus, clusters are…

Methodology · Statistics 2021-11-30 Luca Scrucca

We consider mean-field models for data--clustering problems starting from a generalization of the bounded confidence model for opinion dynamics. The microscopic model includes information on the position as well as on additional features of…

Numerical Analysis · Mathematics 2020-03-16 Michael Herty , Lorenzo Pareschi , Giuseppe Visconti

In big data analysis, a simple task such as linear regression can become very challenging as the variable dimension $p$ grows. As a result, variable screening is inevitable in many scientific studies. In recent years, randomized algorithms…

Methodology · Statistics 2019-02-13 Yu-Hsiang Cheng , Tzee-Ming Huang , Su-Yun Huang

A weighted likelihood technique for robust estimation of a multivariate Wrapped Normal distribution for data points scattered on a p-dimensional torus is proposed. The occurrence of outliers in the sample at hand can badly compromise…

Methodology · Statistics 2021-07-01 Giovanni Saraceno , Claudio Agostinelli , Luca Greco

In Bayesian nonparametrics there exists a rich variety of discrete priors, including the Dirichlet process and its generalizations, which are nowadays well-established tools. Despite the remarkable advances, few proposals are tailored for…

Methodology · Statistics 2022-02-28 Tommaso Rigon , Bruno Scarpa , Sonia Petrone

Until recently obtaining data on populations of networks was typically rare. However, with the advancement of automatic monitoring devices and the growing social and scientific interest in networks, such data has become more widely…

Methodology · Statistics 2020-01-22 Mirko Signorelli , Ernst Wit

A Bayesian approach to the classification problem is proposed in which random partitions play a central role. It is argued that the partitioning approach has the capacity to take advantage of a variety of large-scale spatial structures, if…

Statistics Theory · Mathematics 2007-06-13 Marc A. Coram

In this paper we study a problem within Dempster-Shafer theory where 2**n - 1 pieces of evidence are clustered by a neural structure into n clusters. The clustering is done by minimizing a metaconflict function. Previously we developed a…

Artificial Intelligence · Computer Science 2007-05-23 Johan Schubert

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

Coresets are compact representations of data sets such that models trained on a coreset are provably competitive with models trained on the full data set. As such, they have been successfully used to scale up clustering models to massive…

Machine Learning · Statistics 2018-06-08 Olivier Bachem , Mario Lucic , Andreas Krause

Blocking is a mechanism to improve the efficiency of Entity Resolution (ER) which aims to quickly prune out all non-matching record pairs. However, depending on the distributions of entity cluster sizes, existing techniques can be either…

Databases · Computer Science 2021-03-17 Sainyam Galhotra , Donatella Firmani , Barna Saha , Divesh Srivastava

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

The use of brain images as markers for diseases or behavioral differences is challenged by the small effects size and the ensuing lack of power, an issue that has incited researchers to rely more systematically on large cohorts. Coupled…

Machine Learning · Statistics 2015-11-17 Bertrand Thirion , Andrés Hoyos-Idrobo , Jonas Kahn , Gael Varoquaux

Exchangeable random partition processes are the basis for Bayesian approaches to statistical inference in large alphabet settings. On the other hand, the notion of the pattern of a sequence provides an information-theoretic framework for…

Information Theory · Computer Science 2014-10-22 Narayana P. Santhanam , Anand D. Sarwate , Jae Oh Woo

It is often of interest to perform clustering on longitudinal data, yet it is difficult to formulate an intuitive model for which estimation is computationally feasible. We propose a model-based clustering method for clustering objects that…

Methodology · Statistics 2020-05-19 Daniel K. Sewell , Yuguo Chen , William Bernhard , Tracy Sulkin

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

We develop a coagulation-fragmentation model to study a system composed of a small number of stochastic objects moving in a confined domain, that can aggregate upon binding to form local clusters of arbitrary sizes. A cluster can also…

Subcellular Processes · Quantitative Biology 2012-01-19 Nathanael Hoze , David Holcman