English
Related papers

Related papers: Bi-cross validation for estimating spectral cluste…

200 papers

We consider an extension of model-based clustering to the semi-supervised case, where some of the data are pre-labeled. We provide a derivation of the Bayesian Information Criterion (BIC) approximation to the Bayes factor in this setting.…

Methodology · Statistics 2016-04-28 Jordan Yoder , Carey E. Priebe

Gravitational waves (GWs) from stellar-mass compact binary coalescences (CBCs) are expected to be strongly lensed when encountering large agglomerations of matter, such as galaxies or clusters. Searches for strongly lensed GWs have been…

General Relativity and Quantum Cosmology · Physics 2023-06-08 Srashti Goyal , Shasvath Kapadia , Jean-Rene Cudell , Alvin K. Y. Li , Juno C. L. Chan

Cross-validation is a standard tool for obtaining a honest assessment of the performance of a prediction model. The commonly used version repeatedly splits data, trains the prediction model on the training set, evaluates the model…

Machine Learning · Statistics 2025-10-10 Tianyu Pan , Vincent Z. Yu , Viswanath Devanarayan , Lu Tian

We report the analysis of the first resolved caustic-crossing binary-source microlensing event OGLE-2016-BLG-1003. The event is densely covered by the round-the-clock observations of three surveys. The light curve is characterized by two…

Weak lensing provides an important route toward collecting samples of clusters of galaxies selected by mass. Subtle systematic errors in image reduction can compromise the power of this technique. We use the B-mode signal to quantify this…

Instrumentation and Methods for Astrophysics · Physics 2015-06-15 Yousuke Utsumi , Satoshi Miyazaki , Margaret J. Geller , Ian P. Dell'Antonio , Masamune Oguri , Michael J. Kurtz , Takashi Hamana , Daniel G. Fabricant

Measuring dataset similarity is fundamental in machine learning, particularly for transfer learning and domain adaptation. In the context of supervised learning, most existing approaches quantify similarity of two data sets based on their…

Machine Learning · Statistics 2026-04-22 Shudong Sun , Hao Helen Zhang , Joseph C Watkins

Biclustering is the task of simultaneously clustering the rows and columns of the data matrix into different subgroups such that the rows and columns within a subgroup exhibit similar patterns. In this paper, we consider the case of…

Machine Learning · Computer Science 2022-01-31 Nicolas Fraiman , Zichao Li

A first step in exploring population structure in crop plants and other organisms is to define the number of subpopulations that exist for a given data set. The genetic marker data sets being generated have become increasingly large over…

Applications · Statistics 2014-01-09 Mark A. Newell , Dianne Cook , Heike Hofmann , Jean-Luc Jannink

Consistency is a key property of all statistical procedures analyzing randomly sampled data. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of…

Statistics Theory · Mathematics 2008-12-18 Ulrike von Luxburg , Mikhail Belkin , Olivier Bousquet

We propose two spectral algorithms for partitioning nodes in directed graphs respectively with a cyclic and an acyclic pattern of connection between groups of nodes. Our methods are based on the computation of extremal eigenvalues of the…

Data Structures and Algorithms · Computer Science 2018-05-09 H. Van Lierde , T. W. S. Chow , J. -C. Delvenne

Cross-validation (CV) is one of the main tools for performance estimation and parameter tuning in machine learning. The general recipe for computing CV estimate is to run a learning algorithm separately for each CV fold, a computationally…

Machine Learning · Statistics 2015-07-02 Pooria Joulani , András György , Csaba Szepesvári

Tracking is one of the most time consuming aspects of event reconstruction at the Large Hadron Collider (LHC) and its high-luminosity upgrade (HL-LHC). Innovative detector technologies extend tracking to four-dimensions by including timing…

Instrumentation and Detectors · Physics 2021-11-12 Patrick J. Fox , Shangqing Huang , Joshua Isaacson , Xiangyang Ju , Benjamin Nachman

The decision to incorporate cross-validation into validation processes of mathematical models raises an immediate question - how should one partition the data into calibration and validation sets? We answer this question systematically: we…

Data Analysis, Statistics and Probability · Physics 2011-08-31 Rebecca Morrison , Corey Bryant , Gabriel Terejanu , Kenji Miki , Serge Prudhomme

Multi-view clustering has shown to be an effective method for analyzing underlying patterns in multi-view data. The performance of clustering can be improved by learning the consistency and complementarity between multi-view features,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shihao Dong , Yuhui Zheng , Huiying Xu , Xinzhong Zhu

Cross-validation (CV) is a common method to tune machine learning methods and can be used for model selection in regression as well. Because of the structured nature of small, traditional experimental designs, the literature has warned…

Applications · Statistics 2025-06-18 Maria L. Weese , Byran J. Smucker , David J. Edwards

We introduce a charge coupled device (CCD) camera based detection scheme in dynamic light scattering that provides information on the single-scattered auto-correlation function even for fairly turbid samples. It is based on the single…

Soft Condensed Matter · Physics 2009-11-11 Pavel Zakharov , Suresh Bhat , Peter Schurtenberger , Frank Scheffold

The problem of clustering fingerprint vectors is an interesting problem in Computational Biology that has been proposed in (Figureroa et al. 2004). In this paper we show some improvements in closing the gaps between the known lower bounds…

Data Structures and Algorithms · Computer Science 2011-08-02 Paola Bonizzoni , Gianluca Della Vedova , Riccardo Dondi

To understand complex biological systems, the research community has produced huge corpus of gene expression data. A large number of clustering approaches have been proposed for the analysis of gene expression data. However, extracting…

Computational Engineering, Finance, and Science · Computer Science 2010-03-28 Swathi. H

Unsupervised feature selection (UFS) is an important task in data engineering. However, most UFS methods construct models from a single perspective and often fail to simultaneously evaluate feature importance and preserve their inherent…

Machine Learning · Computer Science 2025-05-28 Jingjing Liu , Xiansen Ju , Xianchao Xiu , Wanquan Liu

Unsupervised clustering of feature matrix data is an indispensible technique for exploratory data analysis and quality control of experimental data. However, clusters are difficult to assess for statistical significance in an objective way.…

Statistics Theory · Mathematics 2021-10-01 James Mathews , Cameron Crowe , Rami Vanguri , Margaret Callahan , Travis Hollmann , Saad Nadeem