English
Related papers

Related papers: Beyond likelihood ratio bias: Nested multi-time-sc…

200 papers

We provide a semi-parametric analysis for the proportional likelihood ratio model, proposed by Luo & Tsai (2012). We study the tangent spaces for both the parameter of interest and the nuisance parameter, and obtain an explicit expression…

Statistics Theory · Mathematics 2019-07-15 Yair Goldberg , Malka Gorfine

The Boolean Satisfiability problem (SAT) is important on artificial intelligence community and the impact of its solving on complex problems. Recently, great breakthroughs have been made respectively on stochastic local search (SLS)…

Artificial Intelligence · Computer Science 2020-08-05 Huimin Fu , Yang Xu , Jun Liu , Guanfeng Wu , Sutcliffe Geoff

Stochastic approximation (SA) is a powerful class of iterative algorithms for nonlinear root-finding that can be used for minimizing a loss function, $L(\boldsymbol{\theta})$, with respect to a parameter vector $\boldsymbol{\theta}$, when…

Optimization and Control · Mathematics 2017-07-24 Karla Hernández Cuevas

Frailty models are often the model of choice for heterogeneous survival data. A frailty model contains both random effects and fixed effects, with the random effects accommodating for the correlation in the data. Different estimation…

Methodology · Statistics 2019-09-17 Oodally Ajmal , Luc Duchateau , Estelle Kuhn

We introduce a new approach for comparing the predictive accuracy of two nested models that bypasses the difficulties caused by the degeneracy of the asymptotic variance of forecast error loss differentials used in the construction of…

Econometrics · Economics 2023-10-17 Jean-Yves Pitarakis

This paper is a study on solutions of the Sample Average Approximation Method to solve compound stochastic programs. We derive nonasymptotic upper estimates for probabilities of the approximation errors. The results depend on the sample…

Optimization and Control · Mathematics 2025-08-29 Volker Kratschmer

Stochastic approximation (SA) is a method for finding the root of an operator perturbed by noise. There is a rich literature establishing the asymptotic normality of rescaled SA iterates under fairly mild conditions. However, these…

Machine Learning · Statistics 2026-02-17 Shaan Ul Haque , Zedong Wang , Zixuan Zhang , Siva Theja Maguluri

We present algorithms (a) for nested neural likelihood-to-evidence ratio estimation, and (b) for simulation reuse via an inhomogeneous Poisson point process cache of parameters and corresponding simulations. Together, these algorithms…

Instrumentation and Methods for Astrophysics · Physics 2020-12-01 Benjamin Kurt Miller , Alex Cole , Gilles Louppe , Christoph Weniger

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

Real-world measurements often comprise a dominant signal contaminated by a noisy background. Robustly estimating the dominant signal in practice has been a fundamental statistical problem. Classically, mixture models have been used to…

Computation · Statistics 2026-05-20 Ananyabrata Barua , Ayanendranath Basu

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. This problem is magnified in high-dimensional settings where the number of variables $p$ diverges with the sample size $n$, as well…

Statistics Theory · Mathematics 2020-02-21 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur…

Methodology · Statistics 2022-09-19 Yu Gu , Donglin Zeng , Gerardo Heiss , D. Y. Lin

We introduce a new amortized likelihood ratio estimator for likelihood-free simulation-based inference (SBI). Our estimator is simple to train and estimates the likelihood ratio using a single forward pass of the neural estimator. Our…

Machine Learning · Statistics 2023-11-20 Adam D. Cobb , Brian Matejek , Daniel Elenius , Anirban Roy , Susmit Jha

Surprise Adequacy (SA) is one of the emerging and most promising adequacy criteria for Deep Learning (DL) testing. As an adequacy criterion, it has been used to assess the strength of DL test suites. In addition, it has also been used to…

Machine Learning · Computer Science 2021-03-11 Michael Weiss , Rwiddhi Chakraborty , Paolo Tonella

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

The first aim of this paper is to establish the weak convergence rate of nonlinear two-time-scale stochastic approximation algorithms. Its second aim is to introduce the averaging principle in the context of two-time-scale stochastic…

Probability · Mathematics 2007-05-23 Abdelkader Mokkadem , Mariane Pelletier

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

This paper considers the problem of variable selection allowing for parameter instability. It distinguishes between signal and pseudo-signal variables that are correlated with the target variable, and noise variables that are not, and…

Econometrics · Economics 2024-07-17 Alexander Chudik , M. Hashem Pesaran , Mahrad Sharifvaghefi

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

In this paper we show how nuisance parameter marginalized posteriors can be inferred directly from simulations in a likelihood-free setting, without having to jointly infer the higher-dimensional interesting and nuisance parameter posterior…

Cosmology and Nongalactic Astrophysics · Physics 2019-07-17 Justin Alsing , Benjamin Wandelt