English
Related papers

Related papers: Computing Extremely Accurate Quantiles Using t-Dig…

200 papers

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Effective and efficient forecasting relies on identification of the relevant information contained in past observations -- the predictive features -- and isolating it from the rest. When the future of a process bears a strong dependence on…

This paper describes a class of probabilistic approximation algorithms based on bucket elimination which offer adjustable levels of accuracy and efficiency. We analyze the approximation for several tasks: finding the most probable…

Artificial Intelligence · Computer Science 2013-02-08 Rina Dechter , Irina Rish

In this paper we study the problem of computing max-entropy distributions over a discrete set of objects subject to observed marginals. Interest in such distributions arises due to their applicability in areas such as statistical physics,…

Data Structures and Algorithms · Computer Science 2013-05-02 Mohit Singh , Nisheeth K. Vishnoi

We give an algorithm for prediction on a quantum computer which is based on a linear regression model with least squares optimisation. Opposed to related previous contributions suffering from the problem of reading out the optimal…

Quantum Physics · Physics 2016-09-07 Maria Schuld , Ilya Sinayskiy , Francesco Petruccione

We build a quantum algorithm which uses the Grover quantum search procedure in order to sample the exact equilibrium distribution of a wide range of classical statistical mechanics systems. The algorithm is based on recently developed exact…

Quantum Physics · Physics 2014-11-20 Nicolas Destainville , Bertrand Georgeot , Olivier Giraud

We introduce new quantile estimators with adaptive importance sampling. The adaptive estimators are based on weighted samples that are neither independent nor identically distributed. Using a new law of iterated logarithm for martingales,…

Statistics Theory · Mathematics 2010-03-01 Daniel Egloff , Markus Leippold

The maximum entropy principle is a powerful tool for solving underdetermined inverse problems. This paper considers the problem of discretizing a continuous distribution, which arises in various applied fields. We obtain the approximating…

Numerical Analysis · Mathematics 2020-08-05 Ken'ichiro Tanaka , Alexis Akira Toda

Quantum machine learning promises great speedups over classical algorithms, but it often requires repeated computations to achieve a desired level of accuracy for its point estimates. Bayesian learning focuses more on sampling from…

Quantum Physics · Physics 2021-07-21 Noah Berner , Vincent Fortuin , Jonas Landman

It is desirable to have accurate uncertainty estimation from a single deterministic forward-pass model, as traditional methods for uncertainty quantification are computationally expensive. However, this is difficult because single…

Machine Learning · Computer Science 2023-08-22 Frederik Boe Hüttel , Filipe Rodrigues , Francisco Câmara Pereira

The manuscript discusses how to incorporate random effects for quantile regression models for clustered data with focus on settings with many but small clusters. The paper has three contributions: (i) documenting that existing methods may…

Methodology · Statistics 2022-02-24 Maria Laura Battagliola , Helle Sørensen , Anders Tolver , Ana-Maria Staicu

Quantile regression is a powerful tool for learning the relationship between a response variable and a multivariate predictor while exploring heterogeneous effects. In this paper, we consider statistical inference for quantile regression…

Statistics Theory · Mathematics 2021-05-19 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

Graphlets are induced subgraphs of a large network and are important for understanding and modeling complex networks. Despite their practical importance, graphlets have been severely limited to applications and domains with relatively small…

Social and Information Networks · Computer Science 2017-03-01 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

We propose a new embedding method, named Quantile-Quantile Embedding (QQE), for distribution transformation and manifold embedding with the ability to choose the embedding distribution. QQE, which uses the concept of quantile-quantile plot…

Machine Learning · Statistics 2021-07-12 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

This paper addresses a fundamental problem in random variate generation: given access to a random source that emits a stream of independent fair bits, what is the most accurate and entropy-efficient algorithm for sampling from a discrete…

Data Structures and Algorithms · Computer Science 2020-03-10 Feras A. Saad , Cameron E. Freer , Martin C. Rinard , Vikash K. Mansinghka

We investigate an empirical quantile estimation approach to solve chance-constrained nonlinear optimization problems. Our approach is based on the reformulation of the chance constraint as an equivalent quantile constraint to provide…

Optimization and Control · Mathematics 2024-10-16 Fengqiao Luo , Jeffrey Larson

The shrinking rank method is a variation of slice sampling that is efficient at sampling from multivariate distributions with highly correlated parameters. It requires that the gradient of the log-density be computable. At each individual…

Computation · Statistics 2010-11-23 Madeleine B. Thompson , Radford M. Neal

This paper addresses the limitations of conventional vector quantization algorithms, particularly K-Means and its variant K-Means++, and investigates the Stochastic Quantization (SQ) algorithm as a scalable alternative for high-dimensional…

Machine Learning · Computer Science 2025-03-11 Anton Kozyriev , Vladimir Norkin

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui