English
Related papers

Related papers: Analytic perturbations and systematic bias in stat…

200 papers

Biological systems (among others) may respond to a large variety of distinct external stimuli, or signals. These perturbations will generally be presented to the system not singly, but in various combinations, so that a proper understanding…

Quantitative Methods · Quantitative Biology 2011-06-24 Dennis Wylie

There has been a lot of work fitting Ising models to multivariate binary data in order to understand the conditional dependency relationships between the variables. However, additional covariates are frequently recorded together with the…

Machine Learning · Statistics 2012-09-28 Jie Cheng , Elizaveta Levina , Pei Wang , Ji Zhu

Classical regression has a simple geometric description in terms of a projection of the training labels onto the column space of the design matrix. However, for over-parameterized models -- where the number of fit parameters is large enough…

Machine Learning · Statistics 2021-04-28 Jason W. Rocks , Pankaj Mehta

Randomized experiments in which the treatment of a unit can affect the outcomes of other units are becoming increasingly common in healthcare, economics, and in the social and information sciences. From a causal inference perspective, the…

Methodology · Statistics 2017-02-14 Daniel L. Sussman , Edoardo M. Airoldi

A basic requirement for a mathematical model is often that its solution (output) shouldn't change much if the model's parameters (input) are perturbed. This is important because the exact values of parameters may not be known and one would…

Optimization and Control · Mathematics 2021-08-09 Johannes O. Royset

This paper studies the problem of perturbed convex and smooth optimization. The main results describe how the solution and the value of the problem change if the objective function is perturbed. Examples include linear, quadratic, and…

Optimization and Control · Mathematics 2025-06-08 Vladimir Spokoiny

Singular perturbation theory plays a central role in the approximate solution of nonlinear differential equations. However, applying these methods is a subtle art owing to the lack of globally applicable algorithms. Inspired by the fact…

Mathematical Physics · Physics 2025-09-16 Alexander J. Dear , L. Mahadevan

In this work we consider the problem of extracting a set of interaction parameters from an high-dimensional dataset describing T independent configurations of a complex system composed of N binary units. This problem is formulated in the…

Statistical Mechanics · Physics 2013-11-04 Iacopo Mastromatteo

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society. Much…

Machine Learning · Computer Science 2022-06-28 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Classical matrix perturbation results, such as Weyl's theorem for eigenvalues and the Davis-Kahan theorem for eigenvectors, are general purpose. These classical bounds are tight in the worst case, but in many settings sub-optimal in the…

Machine Learning · Statistics 2017-06-21 Justin Eldridge , Mikhail Belkin , Yusu Wang

The topic of statistical inference for dynamical systems has been studied extensively across several fields. In this survey we focus on the problem of parameter estimation for non-linear dynamical systems. Our objective is to place results…

Statistics Theory · Mathematics 2012-06-19 Kevin McGoff , Sayan Mukherjee , Natesh S. Pillai

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

In this article, we consider the linear operator equation in a Banach space. The relative perturbation of the solution x corresponding to the perturbation of y, the perturbation of A and the perturbation of both A, y are characterized from…

Spectral Theory · Mathematics 2020-01-14 Krishna Kumar. G

In a previous paper (J. Phys. A 36, 11807 (2003)), we introduced the `asymptotic iteration method' for solving second-order homogeneous linear differential equations. In this paper, we study perturbed problems in quantum mechanics and we…

Mathematical Physics · Physics 2009-11-11 Hakan Ciftci , Richard L. Hall , Nasser Saad

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

Turing patterns formed by activator-inhibitor systems on networks are considered. The linear stability analysis shows that the Turing instability generally occurs when the inhibitor diffuses sufficiently faster than the activator. Numerical…

Pattern Formation and Solitons · Physics 2010-04-29 Hiroya Nakao , Alexander S. Mikhailov

We explore how violations of the often-overlooked standard assumption that the random effects model matrix in a linear mixed model is fixed (and thus independent of the random effects vector) can lead to bias in estimators of estimable…

Statistics Theory · Mathematics 2020-06-23 Andrew T. Karl , Dale L. Zimmerman

Many real-world problems in machine learning, signal processing, and communications assume that an unknown vector $x$ is measured by a matrix A, resulting in a vector $y=Ax+z$, where $z$ denotes the noise; we call this a single measurement…

Information Theory · Computer Science 2017-07-13 Junan Zhu

This paper deals with the problem of parameter estimation based on certain eigenspaces of the empirical covariance matrix of an observed multidimensional time series, in the case where the time series dimension and the observation window…

Probability · Mathematics 2012-08-22 Walid Hachem , Philippe Loubaton , X. Mestre , Jamal Najim , Pascal Vallet