English
Related papers

Related papers: Generalizing the Generalized Likelihood Ratio Meth…

200 papers

We propose a posterior for Bayesian Likelihood-Free Inference (LFI) based on generalized Bayesian inference. To define the posterior, we use Scoring Rules (SRs), which evaluate probabilistic models given an observation. In LFI, we can…

Methodology · Statistics 2024-09-24 Lorenzo Pacchiardi , Sherman Khoo , Ritabrata Dutta

I show how a renormalization group (RG) method can be used to incrementally integrate the information in cosmological large-scale structure data sets (including CMB, galaxy redshift surveys, etc.). I show numerical tests for Gaussian…

Cosmology and Nongalactic Astrophysics · Physics 2019-03-06 Patrick McDonald

Measuring the growth rate of large-scale structures (f) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of…

We study estimation and inference using data collected by reinforcement learning (RL) algorithms. These algorithms adaptively experiment by interacting with individual units over multiple stages, updating their strategies based on past…

Machine Learning · Statistics 2025-10-06 Vasilis Syrgkanis , Ruohan Zhan

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtain robust estimates. The weight, attached to each score contribution, is evaluated by comparing the statistical data depth at the model…

Methodology · Statistics 2018-02-16 Claudio Agostinelli

Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However,…

Methodology · Statistics 2025-05-15 Luca Maestrini , Francis K. C. Hui , Alan H. Welsh

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

Machine Learning · Computer Science 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a…

Machine Learning · Statistics 2020-12-21 Conor Durkan , Iain Murray , George Papamakarios

In this study, we propose shrinkage methods based on {\it generalized ridge regression} (GRR) estimation which is suitable for both multicollinearity and high dimensional problems with small number of samples (large $p$, small $n$). Also,…

Statistics Theory · Mathematics 2020-03-04 Bahadır Yüzbaşı , Mohammad Arashi , S. Ejaz Ahmed

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

Statistics Theory · Mathematics 2023-01-18 Martin Genzel , Christian Kipp

Latent variable models represent a useful tool for the analysis of complex data when the constructs of interest are not observable. A problem related to these models is that the integrals involved in the likelihood function cannot be solved…

Methodology · Statistics 2015-03-05 Silvia Bianconcini , Silvia Cagnone , Dimitris Rizopoulos

A profile likelihood ratio test is proposed for inferences on the index coefficients in generalized single-index models. Key features include its simplicity in implementation, invariance against parametrization, and exhibiting substantially…

Methodology · Statistics 2017-06-27 Nanxi Zhang , Alan Huang

Generalising well in supervised learning tasks relies on correctly extrapolating the training data to a large region of the input space. One way to achieve this is to constrain the predictions to be invariant to transformations on the input…

Machine Learning · Computer Science 2018-08-17 Mark van der Wilk , Matthias Bauer , ST John , James Hensman

Generalized linear models and the quasi-likelihood method extend the ordinary regression models to accommodate more general conditional distributions of the response. Nonparametric methods need no explicit parametric specification, and the…

Statistics Theory · Mathematics 2009-11-23 Jianqing Fan , Yichao Wu , Yang Feng

Generalized linear mixed models (GLMMs) are used to model responses from exponential families with a combination of fixed and random effects. For variance components in GLMMs, we propose an approximate restricted likelihood ratio test that…

Methodology · Statistics 2019-06-11 Stephanie T. Chen , Luo Xiao , Ana-Maria Staicu

The notion of belief likelihood function of repeated trials is introduced, whenever the uncertainty for individual trials is encoded by a belief measure (a finite random set). This generalises the traditional likelihood function, and…

Statistics Theory · Mathematics 2018-08-21 Fabio Cuzzolin

Many common loss functions such as mean-squared-error, cross-entropy, and reconstruction loss are unnecessarily rigid. Under a probabilistic interpretation, these common losses correspond to distributions with fixed shapes and scales. We…

Machine Learning · Computer Science 2020-10-05 Mark Hamilton , Evan Shelhamer , William T. Freeman

We propose new model selection criteria based on generalized ridge estimators dominating the maximum likelihood estimator under the squared risk and the Kullback-Leibler risk in multivariate linear regression. Our model selection criteria…

Statistics Theory · Mathematics 2016-04-08 Yuichi Mori , Taiji Suzuki

The Lorenz curve portrays the inequality of income distribution. In this article, we develop three modified empirical likelihood (EL) approaches including adjusted empirical likelihood, transformed empirical likelihood, and transformed…

Methodology · Statistics 2023-11-27 Suthakaran Ratnasingam , Spencer Wallace , Imran Amani , Jade Romero

Traditional likelihood based methods for parameter estimation get highly affected when the given data is contaminated by outliers even in a small proportion. In this paper, we consider a robust parameter estimation method, namely the…

Statistics Theory · Mathematics 2025-10-16 Himanshi Singh , Abhik Ghosh , Nil Kamal Hazra