English
Related papers

Related papers: Profile Likelihood via Optimisation and Differenti…

200 papers

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

The design of optimal test statistics is a key task in frequentist statistics and for a number of scenarios optimal test statistics such as the profile-likelihood ratio are known. By turning this argument around we can find the profile…

Methodology · Statistics 2022-03-25 Lukas Heinrich

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to be numerically…

Machine Learning · Statistics 2020-07-01 Hans Kersting , Nicholas Krämer , Martin Schiegg , Christian Daniel , Michael Tiemann , Philipp Hennig

Probabilistic solvers for ordinary differential equations (ODEs) have emerged as an efficient framework for uncertainty quantification and inference on dynamical systems. In this work, we explain the mathematical assumptions and detailed…

Machine Learning · Statistics 2021-10-25 Nicholas Krämer , Nathanael Bosch , Jonathan Schmidt , Philipp Hennig

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

We present a new approach for estimating parameters in rational ODE models from given (measured) time series data. In typical existing approaches, an initial guess for the parameter values is made from a given search interval. Then, in a…

Mathematical Software · Computer Science 2023-12-19 Oren Bassik , Yosef Berman , Soo Go , Hoon Hong , Ilia Ilmer , Alexey Ovchinnikov , Chris Rackauckas , Pedro Soto , Chee Yap

The Birnbaum-Saunders distribution, also known as the fatigue-life distribution, is frequently used in reliability studies. We obtain adjustments to the Birnbaum--Saunders profile likelihood function. The modified versions of the likelihood…

Methodology · Statistics 2008-04-06 Audrey H. M. A. Cysneiros , Francisco Cribari-Neto , Carlos A. G. Araujo

Confidence intervals are an established means of portraying uncertainty about an inferred parameter and can be generated through the use of confidence distributions. For a confidence distribution to be ideal, it must maintain frequentist…

Methodology · Statistics 2022-06-16 Alexander Wimbush , Nicholas Gray , Scott Ferson

Fisher's Method of Maximum Likelihood is shown to be a procedure for the construction of likelihood intervals or regions, instead of a procedure of point estimation. Based on Fisher's articles and books it is justified that by estimation…

Statistics Theory · Mathematics 2008-07-23 Esa Uusipaikka

Accurate simulation of complex physical systems enables the development, testing, and certification of control strategies before they are deployed into the real systems. As simulators become more advanced, the analytical tractability of the…

Robotics · Computer Science 2020-05-27 Lucas Barcelos , Rafael Oliveira , Rafael Possas , Lionel Ott , Fabio Ramos

Complex computer simulations are commonly required for accurate data modelling in many scientific disciplines, making statistical inference challenging due to the intractability of the likelihood evaluation for the observed data.…

Machine Learning · Statistics 2019-10-02 Pablo de Castro , Tommaso Dorigo

Complex systems are characterized by a huge number of degrees of freedom often interacting in a non-linear manner. In many cases macroscopic states, however, can be characterized by a small number of order parameters that obey stochastic…

Data Analysis, Statistics and Probability · Physics 2012-02-20 David Kleinhans

The hazard function represents one of the main quantities of interest in the analysis of survival data. We propose a general approach for parametrically modelling the dynamics of the hazard function using systems of autonomous ordinary…

Methodology · Statistics 2024-07-19 J. A. Christen , F. J. Rubio

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

Probabilistic Logic Programs (PLPs) generalize traditional logic programs and allow the encoding of models combining logical structure and uncertainty. In PLP, inference is performed by summarizing the possible worlds which entail the query…

Logic in Computer Science · Computer Science 2018-04-30 Arun Nampally , Timothy Zhang , C. R. Ramakrishnan

Adaptive confidence intervals for regression functions are constructed under shape constraints of monotonicity and convexity. A natural benchmark is established for the minimum expected length of confidence intervals at a given function in…

Statistics Theory · Mathematics 2013-05-27 T. Tony Cai , Mark G. Low , Yin Xia

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to…

Methodology · Statistics 2022-07-15 Christopher Drovandi , David J Nott , David T Frazier

We develop a general framework for conducting inference on the mean of dependent random variables given constraints on their dependency graph. We establish the consistency of an oracle variance estimator of the mean when the dependency…

Statistics Theory · Mathematics 2016-02-02 Peter M. Aronow , Forrest W. Crawford , José R. Zubizarreta

Differential Privacy (DP) is a mathematical framework for releasing information with formal privacy guarantees. While numerous DP procedures have been developed for statistical analysis and machine learning, valid statistical inference…

Methodology · Statistics 2025-06-27 Ruyu Zhou , Fang Liu

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…