English
Related papers

Related papers: Parameter estimation in linear regression driven b…

200 papers

This work leverages recent advances in probabilistic machine learning to discover conservation laws expressed by parametric linear equations. Such equations involve, but are not limited to, ordinary and partial differential,…

Machine Learning · Computer Science 2017-09-13 Maziar Raissi , George Em. Karniadakis

This paper studies the partial estimation of Gaussian graphical models from high-dimensional empirical observations. We derive a convex formulation for this problem using $\ell_1$-regularized maximum-likelihood estimation, which can be…

Machine Learning · Computer Science 2012-10-01 Xiao-Tong Yuan , Tong Zhang

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

The estimation of linear causal models (also known as structural equation models) from data is a well-known problem which has received much attention in the past. Most previous work has, however, made an explicit or implicit assumption of…

Artificial Intelligence · Computer Science 2007-05-23 Patrik O. Hoyer , Shohei Shimizu , Antti J. Kerminen

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using $\ell_1$-penalization methods. We propose and study the following method. We combine a multiple…

Machine Learning · Statistics 2012-01-11 Shuheng Zhou , Philipp Rutimann , Min Xu , Peter Buhlmann

Spatio-temporal modelling is an increasingly popular topic in Statistics. Our paper contributes to this line of research by developing the theory, simulation and inference for a spatio-temporal Ornstein-Uhlenbeck process. We conduct…

Methodology · Statistics 2019-05-20 Michele Nguyen , Almut E. D. Veraart

Estimating the parameters of max-stable parametric models poses significant challenges, particularly when some parameters lie on the boundary of the parameter space. This situation arises when a subset of variables exhibits extreme values…

Methodology · Statistics 2026-04-08 Anas Mourahib , Anna Kiriliouk , Johan Segers

Extreme value theory for univariate and low-dimensional observations has been explored in considerable detail, but the field is still in an early stage regarding high-dimensional settings. This paper focuses on H\"usler-Reiss models, a…

Methodology · Statistics 2024-12-17 Johannes Lederer , Marco Oesting

Generalized Linear Models (GLMs) have been used extensively in statistical models of spike train data. However, the maximum likelihood estimates of the model parameters and their uncertainty, can be challenging to compute in situations…

Applications · Statistics 2021-09-07 Sahand Farhoodi , Uri Eden

We consider the class of all stationary Gaussian process with explicit parametric spectral density. Under some conditions on the autocovariance function, we defined a GMM estimator that satisfies consistency and asymptotic normality, using…

Statistics Theory · Mathematics 2017-01-18 Luis A. Barboza , Frederi G. Viens

The paper deals with the regression model $X_t = \theta t + B_t$, $t\in[0, T ]$, where $B=\{B_t, t\geq 0\}$ is a centered Gaussian process with stationary increments. We study the estimation of the unknown parameter $\theta$ and establish…

Probability · Mathematics 2017-04-18 Yuliya Mishura , Kostiantyn Ralchenko , Sergiy Shklyar

We consider the problem of predicting values of a random process or field satisfying a linear model $y(x)=\theta^\top f(x) + \varepsilon(x)$, where errors $\varepsilon(x)$ are correlated. This is a common problem in kriging, where the case…

Statistics Theory · Mathematics 2019-08-13 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

This paper studies robust regression for data on Riemannian manifolds. Geodesic regression is the generalization of linear regression to a setting with a manifold-valued dependent variable and one or more real-valued independent variables.…

Machine Learning · Statistics 2022-01-26 Ha-Young Shin , Hee-Seok Oh

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

In this note, we give a short information-theoretic proof of the consistency of the Gaussian maximum likelihood estimator in linear auto-regressive models. Our proof yields nearly optimal non-asymptotic rates for parameter recovery and…

Machine Learning · Computer Science 2024-09-11 Ingvar Ziemann

Gaussian Processes face two primary challenges: constructing models for large datasets and selecting the optimal model. This master's thesis tackles these challenges in the low-dimensional case. We examine recent convergence results to…

Machine Learning · Statistics 2024-11-13 Marcel Neugebauer

This paper is concerned with a semiparametric partially linear regression model with unknown regression coefficients, an unknown nonparametric function for the non-linear component, and unobservable Gaussian distributed random errors. We…

Statistics Theory · Mathematics 2016-08-16 Irène Gannaz

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

Profile likelihoods are rarely used in geostatistical models due to the computational burden imposed by repeated decompositions of large variance matrices. Accounting for uncertainty in covariance parameters can be highly consequential in…

Methodology · Statistics 2023-07-04 Ruoyong Xu , Patrick Brown