English
Related papers

Related papers: On a unified framework for linear nuisance paramet…

200 papers

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

In differential equation discovery algorithms, numerical differentiation is usually a fixed preliminary step. Current methods improve robustness with data subsampling and sparsity but often ignore the variability from the differentiation…

Symbolic Computation · Computer Science 2025-12-16 Maria Khilchuk , Ilya Markov , Alexander Hvatov

This is a writeup, with some elaboration, of the talks by the two authors (a physicist and a statistician) at the first PHYSTAT Informal review on January 24, 2024. We discuss Bayesian and frequentist approaches to dealing with nuisance…

Data Analysis, Statistics and Probability · Physics 2024-04-29 Robert D. Cousins , Larry Wasserman

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

For many algorithms, parameter tuning remains a challenging and critical task, which becomes tedious and infeasible in a multi-parameter setting. Multi-penalty regularization, successfully used for solving undetermined sparse regression of…

Machine Learning · Statistics 2017-10-12 Markus Grasmair , Timo Klock , Valeriya Naumova

This paper proposes a hierarchical, multi-resolution framework for the identification of model parameters and their spatially variability from noisy measurements of the response or output. Such parameters are frequently encountered in…

Mathematical Physics · Physics 2015-05-13 P. S. Koutsourelakis

The selection of features that are relevant for a prediction or classification problem is an important problem in many domains involving high-dimensional data. Selecting features helps fighting the curse of dimensionality, improving the…

Machine Learning · Computer Science 2009-09-04 Michel Verleysen , Fabrice Rossi , Damien François

This paper presents two schemes to jointly estimate parameters and states of discrete-time nonlinear systems in the presence of bounded disturbances and noise and where the parameters belong to a known compact set. The schemes are based on…

Optimization and Control · Mathematics 2022-03-23 T. J. Meijer , V. S. Dolk , M. S. Chong , R. Postoyan , B. de Jager , D. Nešić , W. P. M. H. Heemels

Interpreting data with mathematical models is an important aspect of real-world industrial and applied mathematical modeling. Often we are interested to understand the extent to which a particular set of data informs and constrains model…

Methodology · Statistics 2025-03-06 Matthew J Simpson , Ruth E Baker

We use location model methodology to guide the least squares analysis of the Lasso problem of variable selection and inference. The nuisance parameter is taken to be an indicator for the selection of explanatory variables and the interest…

Methodology · Statistics 2020-09-23 D. A. S. Fraser , Mylène Bédard

The determination of the fundamental parameters of the Standard Model (and its extensions) is often limited by the presence of statistical and theoretical uncertainties. We present several models for the latter uncertainties (random,…

High Energy Physics - Phenomenology · Physics 2017-04-26 Jérôme Charles , Sébastien Descotes-Genon , Valentin Niess , Luiz Vale Silva

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

Methodology · Statistics 2022-11-14 Heather S. Battey , Nancy Reid

Recent algebraic parametric estimation techniques led to point-wise derivative estimates by using only the iterated integral of a noisy observation signal. In this paper, we extend such differentiation methods by providing a larger choice…

Numerical Analysis · Mathematics 2011-03-04 Da-Yan Liu , Olivier Gibaru , Wilfrid Perruquetti

Source separation is one of the signal processing's main emerging domain. Many techniques such as maximum likelihood (ML), Infomax, cumulant matching, estimating function, etc. have been used to address this difficult problem.…

Mathematical Physics · Physics 2009-10-31 Ali Mohammad-Djafari

A perturbative approach is used to quantify the effect of noise in data points on fitted parameters in a general homogeneous linear model, and the results applied to the case of conic sections. There is an optimal choice of normalisation…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Matthew Collett

Differential equations and numerical methods are extensively used to model various real-world phenomena in science and engineering. With modern developments, we aim to find the underlying differential equation from a single observation of…

Numerical Analysis · Mathematics 2025-06-10 Roy Y. He , Hao Liu , Wenjing Liao , Sung Ha Kang

This paper presents a general framework for estimating high-dimensional conditional latent factor models via constrained nuclear norm regularization. We establish large sample properties of the estimators and provide efficient algorithms…

Econometrics · Economics 2025-12-09 Qihui Chen