English
Related papers

Related papers: Bias and Coverage Properties of the WENDy-IRLS Alg…

200 papers

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

Machine Learning · Statistics 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

In this paper, we develop convergence analysis of a modified line search method for objective functions whose value is computed with noise and whose gradient estimates are inexact and possibly random. The noise is assumed to be bounded in…

Optimization and Control · Mathematics 2021-03-05 Albert S. Berahas , Liyuan Cao , Katya Scheinberg

We provide adaptive inference methods, based on $\ell_1$ regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include…

Machine Learning · Statistics 2022-10-25 Victor Chernozhukov , Whitney Newey , Rahul Singh

Our study proposes a novel embedding method, Wide-Value-Embeddings (WVEmbs), for processing Pulse Descriptor Words (PDWs) as normalized inputs to neural networks. This method adapts to the distribution of interleaved radar signals, ranking…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Xianan Hu , Fu Li , Kairui Niu , Peihan Qi , Zhiyong Liang

We introduce a new approach for estimating the invariant density of a multidimensional diffusion when dealing with high-frequency observations blurred by independent noises. We consider the intermediate regime, where observations occur at…

Statistics Theory · Mathematics 2024-04-19 Raphaël Maillet , Grégoire Szymanski

Non-Gaussian impulsive noise (IN) with memory exists in many practical applications. When it is mixed with white Gaussian noise (WGN), the resultant mixed noise will be bursty. The performance of communication systems will degrade…

Signal Processing · Electrical Eng. & Systems 2024-02-12 Tianfu Qi , Jun Wang

RaNNDy is a randomized neural network architecture for the data-driven approximation of transfer operators associated with complex dynamical systems. The weights and biases of the hidden layers of the network are randomly initialized and…

Machine Learning · Computer Science 2026-05-25 Mohammad Tabish , Stefan Klus

Both classification and regression tasks are susceptible to the biased distribution of training data. However, existing approaches are focused on the class-imbalanced learning and cannot be applied to the problems of numerical regression…

Machine Learning · Computer Science 2021-09-15 Wentai Wu , Ligang He , Weiwei Lin

Learning in neural networks critically hinges on the intricate geometry of the loss landscape associated with a given task. Traditionally, most research has focused on finding specific weight configurations that minimize the loss. In this…

Statistical Mechanics · Physics 2024-09-30 Margherita Mele , Roberto Menichetti , Alessandro Ingrosso , Raffaello Potestio

SINDy is a method for learning system of differential equations from data by solving a sparse linear regression optimization problem [Brunton et al., 2016]. In this article, we propose an extension of the SINDy method that learns systems of…

This work proposes an iterative sparse-regularized regression method to recover governing equations of nonlinear dynamical systems from noisy state measurements. The method is inspired by the Sparse Identification of Nonlinear Dynamics…

Machine Learning · Statistics 2021-02-24 Alexandre Cortiella , Kwang-Chun Park , Alireza Doostan

Weak signal learning (WSL) is a common challenge in many fields like fault diagnosis, medical imaging, and autonomous driving, where critical information is often masked by noise and interference, making feature identification difficult.…

Machine Learning · Computer Science 2025-12-30 Xianqi Liu , Xiangru Li , Lefeng He , Ziyu Fang

Standard system identification methods often provide inconsistent estimates with closed-loop data. With the prediction error method (PEM), this issue is solved by using a noise model that is flexible enough to capture the noise spectrum.…

Systems and Control · Computer Science 2018-09-07 Miguel Galrinho , Cristian R. Rojas , Hakan Hjalmarsson

We study the identification and estimation of treatment effect parameters in weakly separable models. In their seminal work, Vytlacil and Yildiz (2007) showed how to identify and estimate the average treatment effect of a dummy endogenous…

Econometrics · Economics 2020-04-06 Songnian Chen , Shakeeb Khan , Xun Tang

Optimization problems constrained by high-dimensional, time-dependent partial differential equations require repeated forward and sensitivity solves, making high-fidelity optimization computationally prohibitive in many-query design and…

Optimization and Control · Mathematics 2026-05-21 April Tran , Terry Haut , David Bortz , Youngsoo Choi

Sparse Identification of Nonlinear Dynamics (SINDy) is a powerful method for discovering parsimonious governing equations from data, but it often requires expert tuning of candidate libraries. We propose an LLM-aided SINDy pipeline that…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Linyu Lin

In this manuscript we propose and analyze weighted reduced order methods for stochastic Stokes and Navier-Stokes problems depending on random input data (such as forcing terms, physical or geometrical coefficients, boundary conditions). We…

Numerical Analysis · Mathematics 2023-03-28 Julien Genovese , Francesco Ballarin , Gianluigi Rozza , Claudio Canuto

Deep neural networks are extremely successful in various applications, however they exhibit high computational demands and energy consumption. This is exacerbated by stuttering technology scaling, prompting the need for novel approaches to…

Machine Learning · Computer Science 2024-06-17 Hendrik Borras , Bernhard Klein , Holger Fröning

We derive a maximum a posteriori estimator for the linear observation model, where the signal and noise covariance matrices are both uncertain. The uncertainties are treated probabilistically by modeling the covariance matrices with prior…

Statistics Theory · Mathematics 2014-03-12 Dave Zachariah , Nafiseh Shariati , Mats Bengtsson , Magnus Jansson , Saikat Chatterjee

Optimization of sensor selection has been studied to monitor complex and large-scale systems with data-driven linear reduced-order modeling. An algorithm for greedy sensor selection is presented under the assumption of correlated noise in…

Signal Processing · Electrical Eng. & Systems 2022-07-14 Keigo Yamada , Yuji Saito , Taku Nonomura , Keisuke Asai