English
Related papers

Related papers: Robust and optimal sparse regression for nonlinear…

200 papers

In this paper, we study the problem of sparse mean estimation under adversarial corruptions, where the goal is to estimate the $k$-sparse mean of a heavy-tailed distribution from samples contaminated by adversarial noise. Existing methods…

Machine Learning · Computer Science 2025-08-26 Jianhao Ma , Rui Ray Chen , Yinghui He , Salar Fattahi , Wei Hu

This study investigates the use of continuous-time dynamical systems for sparse signal recovery. The proposed dynamical system is in the form of a nonlinear ordinary differential equation (ODE) derived from the gradient flow of the Lasso…

Information Theory · Computer Science 2023-03-30 Tadashi Wadayama , Ayano Nakai-Kasai

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Macroscopic models for spatially extended systems under random influences are often described by stochastic partial differential equations (SPDEs). Some techniques for understanding solutions of such equations, such as estimating…

Dynamical Systems · Mathematics 2009-03-27 Jinqiao Duan

A significant challenge in many fields of science and engineering is making sense of time-dependent measurement data by recovering governing equations in the form of differential equations. We focus on finding parsimonious ordinary…

Machine Learning · Computer Science 2024-10-04 Doris Voina , Steven Brunton , J. Nathan Kutz

Identifying nonlinear dynamics and characterizing noise from data is critical across science and engineering for understanding and modeling the behavior of the systems accurately. The modified sparse identification of nonlinear dynamics…

Dynamical Systems · Mathematics 2024-10-24 Cristian López , Ángel Naranjo , Diego Salazar , Keegan J. Moore

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

The observations in many applications consist of counts of discrete events, such as photons hitting a dector, which cannot be effectively modeled using an additive bounded or Gaussian noise model, and instead require a Poisson noise model.…

Optimization and Control · Mathematics 2016-11-17 Zachary T. Harmany , Roummel F. Marcia , Rebecca M. Willett

Data-driven discovery of partial differential equations (PDEs) offers a promising paradigm for uncovering governing physical laws from observational data. However, in practical scenarios, measurements are often contaminated by noise and…

Machine Learning · Computer Science 2026-03-25 Xingyu Chen , Junxiu An , Jun Guo , Yuqian Zhou

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse…

Statistics Theory · Mathematics 2019-07-04 David Gamarnik , Julia Gaudio

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

We present a novel extension of the SINDy framework to delay differential equations with {\it distributed delays} and {\it renewal equations}, where typically the dependence from the past manifests via integrals in which the history is…

Dynamical Systems · Mathematics 2025-12-25 Dimitri Breda , Muhammad Tanveer , Jianhong Wu

Robust physics discovery is of great interest for many scientific and engineering fields. Inspired by the principle that a representative model is the one simplest possible, a new model selection criteria considering both model's Parsimony…

Machine Learning · Computer Science 2022-03-02 Zhiming Zhang , Yongming Liu

Models of many engineering and natural systems are imperfect. The discrepancy between the mathematical representations of a true physical system and its imperfect model is called the model error. These model errors can lead to substantial…

Computational Physics · Physics 2022-06-28 Rambod Mojgani , Ashesh Chattopadhyay , Pedram Hassanzadeh

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

The computation of time dynamics arising in nonlinear time-dependent partial differential equations is an ongoing challenge in numerical analysis, especially once roughness comes into play. Classical numerical schemes in general fail to…

Numerical Analysis · Mathematics 2025-04-29 Yvain Bruned , Frédéric Rousset , Katharina Schratz

This work proposes an iterative sparse-regularized regression method to recover governing equations of nonlinear dynamical systems from noisy state measurements. The method is inspired by the Sparse Identification of Nonlinear Dynamics…

Machine Learning · Statistics 2021-02-24 Alexandre Cortiella , Kwang-Chun Park , Alireza Doostan

Many data-driven approaches exist to extract neural representations of functional magnetic resonance imaging (fMRI) data, but most of them lack a proper probabilistic formulation. We propose a group level scalable probabilistic sparse…

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

Machine Learning · Statistics 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang