English
Related papers

Related papers: Optimizing large-scale structure data analysis wit…

200 papers

Estimating graphical model structure from high-dimensional and undersampled data is a fundamental problem in many scientific fields. Existing approaches, such as GLASSO, latent variable GLASSO, and latent tree models, suffer from high…

Machine Learning · Statistics 2019-09-18 Greg Ver Steeg , Hrayr Harutyunyan , Daniel Moyer , Aram Galstyan

Physics-based covariance models provide a systematic way to construct covariance models that are consistent with the underlying physical laws in Gaussian process analysis. The unknown parameters in the covariance models can be estimated…

Computation · Statistics 2023-03-20 Yian Chen , Mihai Anitescu

We prove risk bounds for binary classification in high-dimensional settings when the sample size is allowed to be smaller than the dimensionality of the training set observations. In particular, we prove upper bounds for both 'compressive…

Statistics Theory · Mathematics 2017-09-29 Ata Kaban , Robert J. Durrant

Model uncertainty quantification is an essential component of effective data assimilation. Model errors associated with sub-grid scale processes are often represented through stochastic parameterizations of the unresolved process. Many…

Methodology · Statistics 2021-04-13 Sahani Pathiraja , Peter Jan van Leeuwen

The surface code, one of the leading candidates for quantum error correction, is known to protect encoded quantum information against stochastic, i.e., incoherent errors. The protection against coherent errors, such as from unwanted gate…

Quantum Physics · Physics 2025-10-28 Jan Behrends , Benjamin Béri

We estimate how clustering in large-scale redshift surveys can constrain various cosmological parameters. Depth and sky coverage of modern redshift surveys are greater than ever, opening new possibilities for statistical analysis. We have…

Astrophysics · Physics 2009-11-07 Takahiko Matsubara , Alexander S. Szalay

Computer experiments have become ubiquitous in science and engineering. Commonly, runs of these simulations demand considerable time and computing, making experimental design extremely important in gaining high quality information with…

Statistics Theory · Mathematics 2017-05-15 Benjamin Haaland , Wenjia Wang , Vaibhav Maheshwari

We provide constraints on the accuracy with which the neutrino mass fraction, $f_{\nu}$, can be estimated when exploiting measurements of redshift-space distortions, describing in particular how the error on neutrino mass depends on three…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-17 Fernanda Petracca , Federico Marulli , Lauro Moscardini , Andrea Cimatti , Carmelita Carbone , Raul E. Angulo

The choice of free parameters in network models is subjective, since it depends on what topological properties are being monitored. However, we show that the Maximum Likelihood (ML) principle indicates a unique, statistically rigorous…

Disordered Systems and Neural Networks · Physics 2008-08-07 Diego Garlaschelli , Maria I. Loffredo

The great success of deep learning poses urgent challenges for understanding its working mechanism and rationality. The depth, structure, and massive size of the data are recognized to be three key ingredients for deep learning. Most of the…

Machine Learning · Computer Science 2019-12-17 Charles K. Chui , Shao-Bo Lin , Bo Zhang , Ding-Xuan Zhou

In dealing with high-dimensional data, factor models are often used for reducing dimensions and extracting relevant information. The spectrum of covariance matrices from power data exhibits two aspects: 1) bulk, which arises from random…

Applications · Statistics 2019-10-22 Xin Shi , Robert Qiu

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

This paper studies the covariance matrix estimation for high-dimensional time series within a new framework that combines low-rank factor and latent variable-specific cluster structures. The popular methods based on assuming the sparse…

Methodology · Statistics 2025-02-25 Dong Li , Xinghao Qiao , Cheng Yu

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Spectroscopic redshift errors, including redshift uncertainty and catastrophic failures, can bias cosmological measurements from galaxy redshift surveys at sub-percent level. In this work, we investigate their impact on the full-shape…

Cosmology and Nongalactic Astrophysics · Physics 2025-12-17 Shengyu He , Jiaxi Yu , Antoine Rocher , Daniel Forero-Sánchez , Jean-Paul Kneib , Cheng Zhao , Etienne Burtin , Jiamin Hou

We expand the scope of the statistical notion of error probability, i.e., how often large deviations are observed in an experiment, in order to make it directly applicable to quantum tomography. We verify that the error probability can…

Quantum Physics · Physics 2011-01-24 Takanori Sugiyama , Peter S. Turner , Mio Murao

In particle physics, as in many areas of science, parameter inference relies on simulations to bridge the gap between theory and experiment. Recent developments in simulation-based inference have boosted the sensitivity of analyses;…

High Energy Physics - Phenomenology · Physics 2026-04-23 Ezequiel Alvarez , Sean Benevedes , Manuel Szewc , Jesse Thaler

To facilitate the design and optimization of nanomaterials for a given application it is necessary to understand the relationship between structure and physical properties. For large nanomaterials, there is imprecise structural information…

Mesoscale and Nanoscale Physics · Physics 2015-02-10 Vladan Mlinar

In this paper we derive information theoretic performance bounds to sensing and reconstruction of sparse phenomena from noisy projections. We consider two settings: output noise models where the noise enters after the projection and input…

Information Theory · Computer Science 2011-12-22 Shuchin Aeron , Venkatesh Saligrama , Manqi Zhao

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski
‹ Prev 1 8 9 10 Next ›