English
Related papers

Related papers: Stochastic Search for Semiparametric Linear Regres…

200 papers

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

Parameter estimation in linear errors-in-variables models typically requires that the measurement error distribution be known (or estimable from replicate data). A generalized method of moments approach can be used to estimate model…

Methodology · Statistics 2018-12-04 Linh Nghiem , Michael Byrd , Cornelis Potgieter

A new sparse semiparametric model is proposed, which incorporates the influence of two functional random variables in a scalar response in a flexible and interpretable manner. One of the functional covariates is included through a…

Methodology · Statistics 2024-01-29 Silvia Novo , Philippe Vieu , Germán Aneiros

Linear regression is a fundamental and popular statistical method. There are various kinds of linear regression, such as mean regression and quantile regression. In this paper, we propose a new one called distribution regression, which…

Methodology · Statistics 2017-12-27 Xin Chen , Xuejun Ma , Wang Zhou

This paper presents a model selection technique of estimation in semiparametric regression models of the type Y_i=\beta^{\prime}\underbarX_i+f(T_i)+W_i, i=1,...,n. The parametric and nonparametric components are estimated simultaneously by…

Statistics Theory · Mathematics 2007-06-13 Florentina Bunea

Stochastic processes have found numerous applications in science, as they are broadly used to model a variety of natural phenomena. Due to their intrinsic randomness and uncertainty, they are, however, difficult to characterize. Here, we…

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

Machine Learning · Statistics 2015-03-31 Ravi Ganti , Rebecca M. Willett

Nonlinear expectation, including sublinear expectation as its special case, is a new and original framework of probability theory and has potential applications in some scientific fields, especially in finance risk measure and management.…

Statistics Theory · Mathematics 2013-04-15 Lu Lin , Yufeng Shi , Xin Wang , Shuzhen Yang

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

For deterministic optimization, line-search methods augment algorithms by providing stability and improved efficiency. We adapt a classical backtracking Armijo line-search to the stochastic optimization setting. While traditional…

Optimization and Control · Mathematics 2018-07-24 Courtney Paquette , Katya Scheinberg

We study a linear observation model with an unknown permutation called \textit{permuted/shuffled linear regression}, where responses and covariates are mismatched and the permutation forms a discrete, factorial-size parameter. The…

Statistics Theory · Mathematics 2026-01-23 Hirofumi Ota , Masaaki Imaizumi

We study the problem of parameter-free stochastic optimization, inquiring whether, and under what conditions, do fully parameter-free methods exist: these are methods that achieve convergence rates competitive with optimally tuned methods,…

Machine Learning · Computer Science 2024-10-22 Amit Attia , Tomer Koren

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

Statistics Theory · Mathematics 2009-09-11 Ikhlef Bechar

Regression models that ignore measurement error in predictors may produce highly biased estimates leading to erroneous inferences. It is well known that it is extremely difficult to take measurement error into account in Gaussian…

Methodology · Statistics 2023-02-03 Mohammad W. Hattab , David Ruppert

In applications of imprecise probability, analysts must compute lower (or upper) expectations, defined as the infimum of an expectation over a set of parameter values. Monte Carlo methods consistently approximate expectations at fixed…

Computation · Statistics 2021-03-05 Nicholas Syring , Ryan Martin

Estimating probabilistic deformable template models is a new approach in the fields of computer vision and probabilistic atlases in computational anatomy. A first coherent statistical framework modelling the variability as a hidden random…

Computation · Statistics 2009-01-16 Stéphanie Allassonnière , Estelle Kuhn

Local search methods can quickly find good quality solutions in cases where systematic search methods might take a large amount of time. Moreover, in the context of pattern set mining, exhaustive search methods are not applicable due to the…

Artificial Intelligence · Computer Science 2014-12-19 Muktadir Hossain , Tajkia Tasnim , Swakkhar Shatabda , Dewan M. Farid

In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for…

Machine Learning · Computer Science 2017-07-03 Maren Mahsereci , Philipp Hennig

In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for…

Machine Learning · Computer Science 2016-01-19 Maren Mahsereci , Philipp Hennig

The complexity of semiparametric models poses new challenges to statistical inference and model selection that frequently arise from real applications. In this work, we propose new estimation and variable selection procedures for the…

Statistics Theory · Mathematics 2011-03-09 Bo Kai , Runze Li , Hui Zou