English
Related papers

Related papers: Basis Pursuit Denoise with Nonsmooth Constraints

200 papers

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Accurately estimating data density is crucial for making informed decisions and modeling in various fields. This paper presents a novel nonparametric density estimation procedure that utilizes bivariate penalized spline smoothing over…

Methodology · Statistics 2024-10-29 Kunal Das , Shan Yu , Guannan Wang , Li Wang

Learning-based denoising algorithms achieve state-of-the-art performance across various denoising tasks. However, training such models relies on access to large training datasets consisting of clean and noisy image pairs. On the other hand,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Ali Zafari , Xi Chen , Shirin Jalali

Non-convex gradient descent is a common approach for estimating a low-rank $n\times n$ ground truth matrix from noisy measurements, because it has per-iteration costs as low as $O(n)$ time, and is in theory capable of converging to a…

Optimization and Control · Mathematics 2024-02-29 Gavin Zhang , Hong-Ming Chiu , Richard Y. Zhang

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

It is well known that the minimax rates of convergence of nonparametric density and regression function estimation of a random variable measured with error is much slower than the rate in the error free case. Surprisingly, we show that if…

Statistics Theory · Mathematics 2019-08-21 Fei Jiang , Yanyuan Ma , Raymond J. Carroll

We develop a unified framework for automatic debiased machine learning (autoDML) for inference on a broad class of statistical parameters. The framework applies to any smooth functional of a nonparametric M-estimand, defined as the…

Methodology · Statistics 2026-03-23 Lars van der Laan , Aurelien Bibaut , Nathan Kallus , Alex Luedtke

While implicit feedback is foundational to modern recommender systems, factors such as human error, uncertainty, and ambiguity in user behavior inevitably introduce significant noise into this feedback, adversely affecting the accuracy and…

Information Retrieval · Computer Science 2025-02-04 Kaike Zhang , Qi Cao , Yunfan Wu , Fei Sun , Huawei Shen , Xueqi Cheng

The recovery of sparse data is at the core of many applications in machine learning and signal processing. While such problems can be tackled using $\ell_1$-regularization as in the LASSO estimator and in the Basis Pursuit approach,…

Optimization and Control · Mathematics 2021-11-15 Christian Kümmerle , Claudio Mayrink Verdun , Dominik Stöger

Finding parameters in a deep neural network (NN) that fit training data is a nonconvex optimization problem, but a basic first-order optimization method (gradient descent) finds a global optimizer with perfect fit (zero-loss) in many…

Machine Learning · Computer Science 2025-03-07 Zhiyan Ding , Shi Chen , Qin Li , Stephen Wright

Automated material model discovery disrupts the tedious and time-consuming cycle of iteratively calibrating and modifying manually designed models. Non-smooth L1-norm regularization is the backbone of automated model discovery; however, the…

Computational Engineering, Finance, and Science · Computer Science 2025-07-15 Moritz Flaschel , Trevor Hastie , Ellen Kuhl

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina

Data analysis and interpretation often relies on an approximation of an empirical dataset by some analytic functions or models. Actual implementations usually rely on a non-linear multi-dimensional optimization algorithm, typically…

Instrumentation and Methods for Astrophysics · Physics 2025-01-29 Igor Chilingarian , Kirill Grishin

Phaseless diffraction measurements recorded by a CCD detector are often affected by Poisson noise. In this paper, we propose a dictionary learning model by employing patches based sparsity to denoise Poisson phaseless measurement. The model…

Optimization and Control · Mathematics 2019-06-10 Huibin Chang , Stefano Marchesini

Motion planning under uncertainty is essential for reliable robot operation. Despite substantial advances over the past decade, the problem remains difficult for systems with complex dynamics. Most state-of-the-art methods perform search…

Robotics · Computer Science 2020-06-01 Marcus Hoerger , Hanna Kurniawati , Alberto Elfes

Quadratically-constrained basis pursuit has become a popular device in sparse regularization; in particular, in the context of compressed sensing. However, the majority of theoretical error estimates for this regularizer assume an a priori…

Information Theory · Computer Science 2017-11-23 Simone Brugiapaglia , Ben Adcock

We introduce a novel method for solving density-based topology optimization problems: Sigmoidal Mirror descent with a Projected Latent variable (SiMPL). The SiMPL method (pronounced as ``the simple method'') optimizes a design using only…

Optimization and Control · Mathematics 2025-02-25 Dohyun Kim , Boyan Stefanov Lazarov , Thomas M. Surowiec , Brendan Keith

Learning dynamics from dissipative chaotic systems is notoriously difficult due to their inherent instability, as formalized by their positive Lyapunov exponents, which exponentially amplify errors in the learned dynamics. However, many of…

Machine Learning · Computer Science 2024-06-07 Yair Schiff , Zhong Yi Wan , Jeffrey B. Parker , Stephan Hoyer , Volodymyr Kuleshov , Fei Sha , Leonardo Zepeda-Núñez

We explore a new way to handle flux boundary conditions imposed on level sets. The proposed approach is a diffuse interface version of the shifted boundary method (SBM) for continuous Galerkin discretizations of conservation laws in…

Numerical Analysis · Mathematics 2022-05-11 Dmitri Kuzmin , Jan-Phillip Bäcker