English
Related papers

Related papers: Implicit vs. explicit regularization for high-dime…

200 papers

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the convergence of GD and…

Machine Learning · Computer Science 2023-10-26 Mathieu Even , Scott Pesme , Suriya Gunasekar , Nicolas Flammarion

Regularization is a popular technique in machine learning for model estimation and avoiding overfitting. Prior studies have found that modern ordered regularization can be more effective in handling highly correlated, high-dimensional data…

Machine Learning · Computer Science 2019-11-01 Mahammad Humayoo , Xueqi Cheng

The generalization mystery of overparametrized deep nets has motivated efforts to understand how gradient descent (GD) converges to low-loss solutions that generalize well. Real-life neural networks are initialized from small random values…

Machine Learning · Computer Science 2021-11-10 Kaifeng Lyu , Zhiyuan Li , Runzhe Wang , Sanjeev Arora

We consider a commonly studied supervised classification of a synthetic dataset whose labels are generated by feeding a one-layer neural network with random iid inputs. We study the generalization performances of standard classifiers in the…

Machine Learning · Statistics 2021-02-18 Benjamin Aubin , Florent Krzakala , Yue M. Lu , Lenka Zdeborová

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learning algorithm. Nonetheless, various forms of regularization,…

Machine Learning · Computer Science 2022-02-23 Navid Azizan , Sahin Lale , Babak Hassibi

We provide sharp path-dependent generalization and excess risk guarantees for the full-batch Gradient Descent (GD) algorithm on smooth losses (possibly non-Lipschitz, possibly nonconvex). At the heart of our analysis is an upper bound on…

Machine Learning · Statistics 2023-02-13 Konstantinos E. Nikolakakis , Farzin Haddadpour , Amin Karbasi , Dionysios S. Kalogerias

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

Black-box algorithms are designed to optimize functions without relying on their underlying analytical structure or gradient information, making them essential when gradients are inaccessible or difficult to compute. Traditional methods for…

Machine Learning · Computer Science 2026-01-21 Yedidya Kfir , Elad Sarafian , Sarit Kraus , Yoram Louzoun

Recent work across many machine learning disciplines has highlighted that standard descent methods, even without explicit regularization, do not merely minimize the training error, but also exhibit an implicit bias. This bias is typically…

Machine Learning · Computer Science 2020-06-22 Ziwei Ji , Miroslav Dudík , Robert E. Schapire , Matus Telgarsky

Stochastic gradient descent (SGD) is a promising method for solving large-scale inverse problems, due to its excellent scalability with respect to data size. In this work, we analyze a new data-driven regularized stochastic gradient descent…

Numerical Analysis · Mathematics 2024-09-30 Zehui Zhou

It is believed that Gradient Descent (GD) induces an implicit bias towards good generalization in training machine learning models. This paper provides a fine-grained analysis of the dynamics of GD for the matrix sensing problem, whose goal…

Machine Learning · Computer Science 2023-01-30 Jikai Jin , Zhiyuan Li , Kaifeng Lyu , Simon S. Du , Jason D. Lee

Ordinal regression is a classification task where classes have an order and prediction error increases the further the predicted class is from the true class. The standard approach for modeling ordinal data involves fitting parallel…

Machine Learning · Computer Science 2022-02-16 Fred Lu , Francis Ferraro , Edward Raff

Classical statistical learning theory predicts that overparameterized models should exhibit severe overfitting, yet modern deep neural networks with far more parameters than training samples consistently generalize well. This contradiction…

Machine Learning · Computer Science 2026-04-10 Zeran Johannsen

Implicit deep learning has recently become popular in the machine learning community since these implicit models can achieve competitive performance with state-of-the-art deep networks while using significantly less memory and computational…

Machine Learning · Computer Science 2022-05-17 Tianxiang Gao , Hongyang Gao

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

Many machine learning tasks can be formulated as Regularized Empirical Risk Minimization (R-ERM), and solved by optimization algorithms such as gradient descent (GD), stochastic gradient descent (SGD), and stochastic variance reduction…

Machine Learning · Statistics 2016-09-28 Qi Meng , Yue Wang , Wei Chen , Taifeng Wang , Zhi-Ming Ma , Tie-Yan Liu

In machine learning, stochastic gradient descent (SGD) is widely deployed to train models using highly non-convex objectives with equally complex noise models. Unfortunately, SGD theory often makes restrictive assumptions that fail to…

Machine Learning · Computer Science 2022-10-11 Vivak Patel , Shushu Zhang , Bowen Tian

We consider networks, trained via stochastic gradient descent to minimize $\ell_2$ loss, with the training labels perturbed by independent noise at each iteration. We characterize the behavior of the training dynamics near any parameter…

Machine Learning · Computer Science 2020-07-23 Guy Blanc , Neha Gupta , Gregory Valiant , Paul Valiant

Empirical studies show that gradient-based methods can learn deep neural networks (DNNs) with very good generalization performance in the over-parameterization regime, where DNNs can easily fit a random labeling of the training data. Very…

Machine Learning · Computer Science 2019-11-28 Yuan Cao , Quanquan Gu

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin
‹ Prev 1 3 4 5 6 7 10 Next ›