English
Related papers

Related papers: On estimation and order selection for multivariate…

200 papers

We propose a new threshold selection method for the nonparametric estimation of the extremal index of stochastic processes. The so-called discrepancy method was proposed as a data-driven smoothing tool for estimation of a probability…

Statistics Theory · Mathematics 2020-09-07 Natalia M. Markovich , Igor V. Rodionov

The stable-regenerative multiple-stable model has been shown recently to have distinct candidate extremal index and extremal index. To understand further this rare phenomenon, two more results are established here for the double-stable…

Probability · Mathematics 2024-10-10 Shuyang Bai , Rafał Kulik , Yizao Wang

While clustering is ubiquitously used across science and industry, uncertainty in cluster assignments is rarely quantified with rigorous guarantees. We propose a novel conformal inference framework for clustering that returns confidence…

Methodology · Statistics 2026-04-13 YoonHaeng Hur , Anirban Nath , Genevera Allen

Manifold clustering, with its exceptional ability to capture complex data structures, holds a pivotal position in cluster analysis. However, existing methods often focus only on finding the optimal combination between K-means and manifold…

Machine Learning · Computer Science 2025-04-30 Fangfang Li , Quanxue Gao

The filtering-clustering models, including trend filtering and convex clustering, have become an important source of ideas and modeling tools in machine learning and related fields. The statistical guarantee of optimal solutions in these…

Machine Learning · Statistics 2022-01-26 Nhat Ho , Tianyi Lin , Michael I. Jordan

In model-based clustering using finite mixture models, it is a significant challenge to determine the number of clusters (cluster size). It used to be equal to the number of mixture components (mixture size); however, this may not be valid…

Machine Learning · Computer Science 2020-07-16 Shunki Kyoya , Kenji Yamanishi

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

We propose a construction for joint feature learning and clustering of multichannel extracellular electrophysiological data across multiple recording periods for action potential detection and discrimination ("spike sorting"). Our…

Deep clustering has the potential to learn a strong representation and hence better clustering performance compared to traditional clustering methods such as $k$-means and spectral clustering. However, this strong representation learning…

Machine Learning · Computer Science 2021-06-01 Hongjing Zhang , Ian Davidson

Capturing the dependence structure of multivariate extreme events is a major concern in many fields involving the management of risks stemming from multiple sources, e.g. portfolio monitoring, insurance, environmental risk management and…

Machine Learning · Statistics 2016-03-15 Nicolas Goix , Anne Sabourin , Stéphan Clémençon

In longitudinal data analysis, observation points of repeated measurements over time often vary among subjects except in well-designed experimental studies. Additionally, measurements for each subject are typically obtained at only a few…

Methodology · Statistics 2024-11-14 Michio Yamamoto , Yoshikazu Terada

Extreme classification seeks to assign each data point, the most relevant labels from a universe of a million or more labels. This task is faced with the dual challenge of high precision and scalability, with millisecond level prediction…

Machine Learning · Computer Science 2019-05-29 Ankit Jalan , Purushottam Kar

Clustering is one of the most common unsupervised learning tasks in machine learning and data mining. Clustering algorithms have been used in a plethora of applications across several scientific fields. However, there has been limited…

Machine Learning · Computer Science 2017-02-09 Quang N. Tran , Ba-Ngu Vo , Dinh Phung , Ba-Tuong Vo

A common approach to statistical learning with big-data is to randomly split it among $m$ machines and learn the parameter of interest by averaging the $m$ individual estimates. In this paper, focusing on empirical risk minimization, or…

Machine Learning · Statistics 2016-06-14 Jonathan Rosenblatt , Boaz Nadler

We propose a deep learning approach for discovering kernels tailored to identifying clusters over sample data. Our neural network produces sample embeddings that are motivated by--and are at least as expressive as--spectral clustering. Our…

Machine Learning · Computer Science 2020-01-03 Chieh Wu , Zulqarnain Khan , Yale Chang , Stratis Ioannidis , Jennifer Dy

Spherical data is distributed on the sphere. The data appears in various fields such as meteorology, biology, and natural language processing. However, a method for analysis of spherical data does not develop enough yet. One of the…

Machine Learning · Computer Science 2021-05-14 Kazuhisa Fujita

Discrete mixture models provide a well-known basis for effective clustering algorithms, although technical challenges have limited their scope. In the context of gene-expression data analysis, a model is presented that mixes over a finite…

Methodology · Statistics 2012-11-12 Michael A. Newton , Lisa M. Chung

A novel formulation of the clustering problem is introduced in which the task is expressed as an estimation problem, where the object to be estimated is a function which maps a point to its distribution of cluster membership. Unlike…

Machine Learning · Computer Science 2025-10-14 David P. Hofmeyr

Clustering stands as one of the most prominent challenges in unsupervised machine learning. Among centroid-based methods, the classic $k$-means algorithm, based on Lloyd's heuristic, is widely used. Nonetheless, it is a well-known fact that…

Machine Learning · Statistics 2025-01-30 Supratik Basu , Jyotishka Ray Choudhury , Debolina Paul , Swagatam Das