English
Related papers

Related papers: On polynomial explicit partial estimator design fo…

200 papers

We study parameter estimation in Nonlinear Factor Analysis (NFA) where the generative model is parameterized by a deep neural network. Recent work has focused on learning such models using inference (or recognition) networks; we identify a…

Machine Learning · Statistics 2017-10-18 Rahul G. Krishnan , Dawen Liang , Matthew Hoffman

In a recent paper we have shown that data collected from linear systems excited by persistently exciting inputs during low-complexity experiments, can be used to design state- and output-feedback controllers, including optimal Linear…

Systems and Control · Electrical Eng. & Systems 2021-03-31 Claudio De Persis , Pietro Tesi

The methodology discussed in this paper aims to enhance choice models' comprehensiveness and explanatory power for forecasting choice outcomes. To achieve these, we have developed a data-driven method that leverages machine learning…

Methodology · Statistics 2023-05-02 Amir Ghorbani , Neema Nassir , Patricia Sauri Lavieri , Prithvi Bhat Beeramoole

This paper compares and evaluates a set of non-parametric mutual information estimators with the goal of providing a novel toolset to progress in the analysis of the capacity of the nonlinear optical channel, which is currently an open…

Information Theory · Computer Science 2018-01-25 Tommaso Catuogno , Menelaos Ralli Camara , Marco Secondini

Generalization theory has been established for sparse deep neural networks under high-dimensional regime. Beyond generalization, parameter estimation is also important since it is crucial for variable selection and interpretability of deep…

Machine Learning · Statistics 2024-06-27 Dongya Wu , Xin Li

Researchers develop models to explain the unknowns. These models typically involve parameters that capture tangible quantities, the estimation of which is desired. Parameter identifiability investigates the recoverability of the unknown…

Optimization and Control · Mathematics 2024-07-01 Anuththara Sarathchandra , Azadeh Aghaeeyan , Pouria Ramazi

Discovering the unknown governing equations of grid-connected inverters from external measurements holds significant attraction for analyzing modern inverter-intensive power systems. However, existing methods struggle to balance the…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Jialin Zheng , Ruhaan Batta , Zhong Liu , Xiaonan Lu

There have been growing interests in leveraging experimental measurements to discover the underlying partial differential equations (PDEs) that govern complex physical phenomena. Although past research attempts have achieved great success…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Yang Liu , Hao Sun

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For…

Numerical Analysis · Mathematics 2020-08-26 Han Gao , Jian-Xun Wang , Matthew J. Zahr

In this paper we revisit random linear under-determined systems with sparse solutions. We consider $\ell_1$ optimization heuristic known to work very well when used to solve these systems. A collection of fundamental results that relate to…

Optimization and Control · Mathematics 2016-12-20 Mihailo Stojnic

The thresholding covariance estimator has nice asymptotic properties for estimating sparse large covariance matrices, but it often has negative eigenvalues when used in real data analysis. To simultaneously achieve sparsity and positive…

Methodology · Statistics 2012-08-29 Lingzhou Xue , Shiqian Ma , Hui Zou

In partially linear additive models the response variable is modelled with a linear component on a subset of covariates and an additive component in which the rest of the covariates enter to the model as a sum of univariate unknown…

Methodology · Statistics 2025-02-19 Alejandra Mercedes Martínez

We consider a class of misspecified dynamical models where the governing term is only approximately known. Under the assumption that observations of the system's evolution are accessible for various initial conditions, our goal is to infer…

Machine Learning · Statistics 2017-06-06 Gal Shulkind , Lior Horesh , Haim Avron

In this document, some general results in approximation theory and matrix analysis with applications to sparse identification of time series models and nonlinear discrete-time dynamical systems are presented. The aforementioned theoretical…

Numerical Analysis · Mathematics 2021-08-04 Fredy Vides

We address the problem of prediction of multivariate data process using an underlying graph model. We develop a method that learns a sparse partial correlation graph in a tuning-free and computationally efficient manner. Specifically, the…

Machine Learning · Statistics 2018-11-19 Arun Venkitaraman , Dave Zachariah

Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction…

Machine Learning · Statistics 2023-03-07 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis , Petros Koumoutsakos

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a…

Statistics Theory · Mathematics 2020-07-20 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng

Estimating population quantities such as mean outcomes from user feedback is fundamental to platform evaluation and social science, yet feedback is often missing not at random (MNAR): users with stronger opinions are more likely to respond,…

Machine Learning · Statistics 2026-02-19 Hongyu Chen , David Simchi-Levi , Ruoxuan Xiong

We construct an unbiased estimator for function value evaluated at the solution of a partial differential equation with random coefficients. We show that the variance and expected computational cost of our estimator are finite and our…

Probability · Mathematics 2019-04-23 Jose Blanchet , Fengpei Li , Xiaoou Li