English
Related papers

Related papers: Profile Likelihood via Optimisation and Differenti…

200 papers

Parameter estimation in ordinary differential equations, although applied and refined in various fields of the quantitative sciences, is still confronted with a variety of difficulties. One major challenge is finding the global optimum of a…

Quantitative Methods · Quantitative Biology 2013-02-11 Daniel Kaschek , Jens Timmer

Parameter inference and uncertainty quantification are important steps when relating mathematical models to real-world observations, and when estimating uncertainty in model predictions. However, methods for doing this can be…

Quantitative Methods · Quantitative Biology 2025-08-27 Michael J. Plank , Matthew J. Simpson

Biclustering, the process of simultaneously clustering the rows and columns of a data matrix, is a popular and effective tool for finding structure in a high-dimensional dataset. Many biclustering procedures appear to work well in practice,…

Methodology · Statistics 2020-06-04 Cheryl J. Flynn , Patrick O. Perry

In this work, we study optimization specified only through a comparison oracle: given two points, it reports which one is preferred. We call it function-free optimization because we do not assume access to, nor the existence of, a canonical…

Optimization and Control · Mathematics 2026-05-20 Katya Scheinberg , Zikai Xiong

Likelihood-free inference involves inferring parameter values given observed data and a simulator model. The simulator is computer code which takes parameters, performs stochastic calculations, and outputs simulated data. In this work, we…

Computation · Statistics 2023-01-30 Dennis Prangle , Cecilia Viscardi

Cosmological parameter inference has been dominated by the Bayesian approach for the past two decades, primarily due to its computational efficiency. However, the Bayesian approach involves integration of the posterior probability and…

Cosmology and Nongalactic Astrophysics · Physics 2024-12-10 Emil Brinch Holm , Andreas Nygaard , Jeppe Dakin , Steen Hannestad , Thomas Tram

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

We explore a novel methodology for constructing confidence regions for parameters of linear models, using predictions from any arbitrary predictor. Our framework requires minimal assumptions on the noise and can be extended to functions…

Machine Learning · Statistics 2024-01-30 Charles Guille-Escuret , Eugene Ndiaye

Consider a problem where a set of feasible observations are provided by an expert and a cost function is defined that characterizes which of the observations dominate the others and are hence, preferred. Our goal is to find a set of linear…

Optimization and Control · Mathematics 2020-09-14 Kimia Ghobadi , Houra Mahmoudzadeh

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

We study a likelihood ratio test for the location of the mode of a log-concave density. Our test is based on comparison of the log-likelihoods corresponding to the unconstrained maximum likelihood estimator of a log-concave density and the…

Statistics Theory · Mathematics 2018-06-05 Charles R. Doss , Jon A. Wellner

This paper deals with the scenario approach to robust optimization. This relies on a random sampling of the possibly infinite number of constraints induced by uncertainties in the parameters of an optimization problem. Solving the resulting…

Optimization and Control · Mathematics 2023-03-08 Fabien Lauer

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

Statistics Theory · Mathematics 2023-01-03 Lang Liu , Zaid Harchaoui

This paper introduces an Ordinary Differential Equation (ODE) notion for survival analysis. The ODE notion not only provides a unified modeling framework, but more importantly, also enables the development of a widely applicable, scalable,…

Methodology · Statistics 2021-12-07 Weijing Tang , Kevin He , Gongjun Xu , Ji Zhu

Ordinary differential equations (ODEs) are commonly used to model dynamic behavior of a system. Because many parameters are unknown and have to be estimated from the observed data, there is growing interest in statistics to develop…

Statistics Theory · Mathematics 2010-01-13 Xin Qi , Hongyu Zhao

Standard confidence intervals employed in applied statistical analysis are usually based on asymptotic approximations. Such approximations can be considerably inaccurate in small and moderate sized samples. We derive accurate confidence…

Statistics Theory · Mathematics 2020-12-14 Eliane C. Pinheiro , Silvia L. P. Ferrari , Francisco M. C. Medeiros

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

We propose a likelihood ratio statistic for forming hypothesis tests and confidence intervals for a nonparametrically estimated univariate regression function, based on the shape restriction of concavity (alternatively, convexity). Dealing…

Statistics Theory · Mathematics 2018-09-11 Charles R. Doss

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos