English
Related papers

Related papers: A Computationally Efficient Method for Learning Ex…

200 papers

We give a general unified method that can be used for $L_1$ {\em closeness testing} of a wide range of univariate structured distribution families. More specifically, we design a sample optimal and computationally efficient algorithm for…

Data Structures and Algorithms · Computer Science 2015-08-25 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

We study the problem of estimating a distribution over a finite alphabet from an i.i.d. sample, with accuracy measured in relative entropy (Kullback-Leibler divergence). While optimal bounds on the expected risk are known, high-probability…

Statistics Theory · Mathematics 2026-02-27 Jaouad Mourtada

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

We study the parameter estimation method for linear regression models with possibly skewed stable distributed errors. Our estimation procedure consists of two stages: first, for the regression coefficients, the Cauchy quasi-maximum…

Statistics Theory · Mathematics 2025-06-25 Eitaro Kawamo , Hiroki Masuda

We consider the problem of computing the maximum likelihood multivariate log-concave distribution for a set of points. Specifically, we present an algorithm which, given $n$ points in $\mathbb{R}^d$ and an accuracy parameter $\epsilon>0$,…

Data Structures and Algorithms · Computer Science 2019-07-22 Brian Axelrod , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart , Gregory Valiant

We provide a general condition under which e-variables in the form of a simple-vs.-simple likelihood ratio exist when the null hypothesis is a composite, multivariate exponential family. Such `simple' e-variables are easy to compute and…

Methodology · Statistics 2025-04-02 Peter Grünwald , Tyron Lardy , Yunda Hao , Shaul K. Bar-Lev , Martijn de Jong

The k Nearest Neighbors (kNN) method has received much attention in the past decades, where some theoretical bounds on its performance were identified and where practical optimizations were proposed for making it work fairly well in high…

Machine Learning · Computer Science 2016-06-14 Aleksander Lodwich , Faisal Shafait , Thomas Breuel

We observe $n$ independent pairs of random variables $(W_{i}, Y_{i})$, where the conditional distribution of $Y_{i}$ given $W_{i}=w_{i}$ follows a one-parameter exponential family with parameter $\bsg^{*}(w_{i})\in\R$. Our goal is to…

Methodology · Statistics 2025-02-12 Juntong Chen

We investigate the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution in a sequential setup. The aim is to jointly infer the true hypothesis and the true parameter while using on…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

We construct a semiparametric estimator in case-control studies where the gene and the environment are assumed to be independent. A discrete or continuous parametric distribution of the genes is assumed in the model. A discrete distribution…

Statistics Theory · Mathematics 2010-10-12 Yanyuan Ma

In this paper we present an optimization-based view of distributed parameter estimation and observational social learning in networks. Agents receive a sequence of random, independent and identically distributed (i.i.d.) signals, each of…

Machine Learning · Computer Science 2013-09-11 Shahin Shahrampour , Ali Jadbabaie

We study mixed models with a single grouping factor, where inference about unknown parameters requires optimizing a marginal likelihood defined by an intractable integral. Low-dimensional numerical integration techniques are regularly used…

Methodology · Statistics 2025-01-22 Alex Stringer , Blair Bilodeau , Yanbo Tang

We study the problem of estimating the covariance parameters of a one-dimensional Gaussian process with exponential covariance function under fixed-domain asymptotics. We show that the weighted pairwise maximum likelihood estimator of the…

Statistics Theory · Mathematics 2019-07-15 François Bachoc , Moreno Bevilacqua , Daira Velandia

We study the empirical spectral distribution (ESD) for complex n x n matrix polynomials of degree k. We obtain exact formulae for the almost sure limit of the ESD in two distinct scenarios: (1) n -> \infty with k constant and (2) k ->…

Probability · Mathematics 2022-02-22 Giovanni Barbarino , Vanni Noferini

Approximate Bayesian computation (ABC) is a popular technique for approximating likelihoods and is often used in parameter estimation when the likelihood functions are analytically intractable. Although the use of ABC is widespread in many…

Statistics Theory · Mathematics 2011-03-29 Thomas A. Dean , Sumeetpal S. Singh , Ajay Jasra , Gareth W. Peters

While standard estimation assumes that all datapoints are from probability distribution of the same fixed parameters $\theta$, we will focus on maximum likelihood (ML) adaptive estimation for nonstationary time series: separately estimating…

Machine Learning · Statistics 2020-03-24 Jarek Duda

Subsampling is a computationally effective approach to extract information from massive data sets when computing resources are limited. After a subsample is taken from the full data, most available methods use an inverse probability…

Statistics Theory · Mathematics 2022-10-11 HaiYing Wang , Jae Kwang Kim

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

This paper studies a class of exponential family models whose canonical parameters are specified as linear functionals of an unknown infinite-dimensional slope function. The optimal minimax rates of convergence for slope function estimation…

Statistics Theory · Mathematics 2011-12-25 Winston Wei Dou , David Pollard , Harrison H. Zhou