English
Related papers

Related papers: Convex Programming for Estimation in Nonlinear Rec…

200 papers

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

This paper is concerned with general nonlinear regression models where the predictor variables are subject to Berkson-type measurement errors. The measurement errors are assumed to have a general parametric distribution, which is not…

Statistics Theory · Mathematics 2009-08-21 Liqun Wang

We consider estimating a compact set from finite data by approximating the support function of that set via sublinear regression. Support functions uniquely characterize a compact set up to closure of convexification, and are sublinear…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Shadi Haddad , Abhishek Halder

Recurrent neural networks are a powerful tool, but they are very sensitive to their hyper-parameter configuration. Moreover, training properly a recurrent neural network is a tough task, therefore selecting an appropriate configuration is…

Machine Learning · Computer Science 2019-03-12 Andrés Camero , Jamal Toutouh , Enrique Alba

This paper is concerned with the estimating problem of response quantile with high dimensional covariates when response is missing at random. Some existing methods define root-n consistent estimators for the response quantile. But these…

Methodology · Statistics 2021-06-24 Miaomiao Su , Qihua Wang

A new approach to design of nonlinear observers (state estimators) is proposed. The main idea is to (i) construct a convex set of dynamical systems which are contracting observers for a particular system, and (ii) optimize over this set for…

Systems and Control · Computer Science 2017-11-23 Ian R. Manchester

We study the problem of estimating multiple predictive functions from a dictionary of basis functions in the nonparametric regression setting. Our estimation scheme assumes that each predictive function can be estimated in the form of a…

Machine Learning · Computer Science 2012-06-05 Jianhui Chen , Jieping Ye

The increasing popularity of regression discontinuity methods for causal inference in observational studies has led to a proliferation of different estimating strategies, most of which involve first fitting non-parametric regression models…

Methodology · Statistics 2018-06-11 Guido Imbens , Stefan Wager

We study policy evaluation of offline contextual bandits subject to unobserved confounders. Sensitivity analysis methods are commonly used to estimate the policy value under the worst-case confounding over a given uncertainty set. However,…

Machine Learning · Statistics 2026-01-13 Kei Ishikawa , Niao He , Takafumi Kanamori

Our objective is to estimate the unknown compositional input from its output response through an unknown system after estimating the inverse of the original system with a training set. The proposed methods using artificial neural networks…

Machine Learning · Computer Science 2020-01-27 Se Un Park

We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a…

Methodology · Statistics 2025-11-27 Xiaozhu Zhang , Nir Keret , Ali Shojaie , Armeen Taeb

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. We propose a wide class of recursive estimation procedures for the general…

Statistics Theory · Mathematics 2007-05-23 Teo Sharia

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

In recent years, several convex programming relaxations have been proposed to estimate the permanent of a non-negative matrix, notably in the works of Gurvits and Samorodnitsky. However, the origins of these relaxations and their…

Data Structures and Algorithms · Computer Science 2017-01-06 Damian Straszak , Nisheeth K. Vishnoi

We study the problem of high-dimensional robust mean estimation in the presence of a constant fraction of adversarial outliers. A recent line of work has provided sophisticated polynomial-time algorithms for this problem with…

Machine Learning · Computer Science 2020-05-05 Yu Cheng , Ilias Diakonikolas , Rong Ge , Mahdi Soltanolkotabi

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

Statistics Theory · Mathematics 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao

We consider a nonparametric regression model with continuous endogenous independent variables when only discrete instruments are available that are independent of the error term. Although this framework is very relevant for applied…

Econometrics · Economics 2024-10-18 Samuele Centorrino , Frédérique Fève , Jean-Pierre Florens