English
Related papers

Related papers: Monotonous Parameter Estimation of One Class of No…

200 papers

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different…

Machine Learning · Computer Science 2021-03-31 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

We propose a new method for parameter learning in Bayesian networks with qualitative influences. This method extends our previous work from networks of binary variables to networks of discrete variables with ordered values. The specified…

Artificial Intelligence · Computer Science 2012-06-26 Ad Feelders

We introduce an algorithm which, in the context of nonlinear regression on vector-valued explanatory variables, chooses those combinations of vector components that provide best prediction. The algorithm devotes particular attention to…

Methodology · Statistics 2014-02-03 Frédéric Ferraty , Peter Hall

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

The problem of state reconstruction is considered for uncertain linear time-invariant systems with overparameterization, arbitrary state-space matrices and unknown additive perturbation described by an exosystem. A novel adaptive observer…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Anton Glushchenko , Konstantin Lastochkin

A novel approach to the problem of partial state estimation of nonlinear systems is proposed. The main idea is to translate the state estimation problem into one of estimation of constant, unknown parameters related to the systems initial…

Systems and Control · Computer Science 2016-04-08 Ortega Romeo , Bobtsov Alexey , Pyrkin Anton , Aranovskiy Stanislav

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

The scope of this research is the identification of unknown piecewise constant parameters of linear regression equation under the finite excitation condition. Compared to the known methods, to make the computational burden lower, only one…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Anton Glushchenko , Konstantin Lastochkin

The paper introduces a new estimation method for the standard linear regression model. The procedure is not driven by the optimisation of any objective function rather, it is a simple weighted average of slopes from observation pairs. The…

Econometrics · Economics 2024-02-27 Felix Chan , Laszlo Matyas

Estimating the parameters of max-stable parametric models poses significant challenges, particularly when some parameters lie on the boundary of the parameter space. This situation arises when a subset of variables exhibits extreme values…

Methodology · Statistics 2026-04-08 Anas Mourahib , Anna Kiriliouk , Johan Segers

We propose a new modeling and estimation approach to select the optimal treatment regime from different options through constructing a robust estimating equation. The method is protected against misspecification of the propensity score…

Methodology · Statistics 2022-11-15 Trinetri Ghosh , Yanyuan Ma , Wensheng Zhu , Yuanjia Wang

Parameter estimation in linear errors-in-variables models typically requires that the measurement error distribution be known (or estimable from replicate data). A generalized method of moments approach can be used to estimate model…

Methodology · Statistics 2018-12-04 Linh Nghiem , Michael Byrd , Cornelis Potgieter

The problem of parameter estimation from a standard vector linear regression equation in the absence of sufficient excitation in the regressor is addressed. The first step to solve the problem consists in transforming this equation into a…

Methodology · Statistics 2022-03-14 Alexey Bobtsov , Bowen Yi , Romeo Ortega , Alessandro Astolfi

We establish some new non-asymptotical lower bounds for deviation of regular unbiased estimation of unknown parameter from its true value in different norms, alike the classical Rao-Kramer's inequality. We show that if the new norm is…

Statistics Theory · Mathematics 2014-07-17 E. Ostrovsky , L. Sirota

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

Machine Learning · Statistics 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

Monotonicity is a key qualitative prediction of a wide array of economic models derived via robust comparative statics. It is therefore important to design effective and practical econometric methods for testing this prediction in empirical…

Statistics Theory · Mathematics 2019-07-10 Denis Chetverikov