English
Related papers

Related papers: Implicit regularisation in stochastic gradient des…

200 papers

Many important machine learning applications involve regularized nonconvex bi-level optimization. However, the existing gradient-based bi-level optimization algorithms cannot handle nonconvex or nonsmooth regularizers, and they suffer from…

Machine Learning · Computer Science 2022-06-06 Ziyi Chen , Bhavya Kailkhura , Yi Zhou

We consider simple bilevel optimization problems where the goal is to compute among the optimal solutions of a composite convex optimization problem, one that minimizes a secondary objective function. Our main contribution is threefold. (i)…

Optimization and Control · Mathematics 2025-04-14 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We study settings where gradient penalties are used alongside risk minimization with the goal of obtaining predictors satisfying different notions of monotonicity. Specifically, we present two sets of contributions. In the first part of the…

Machine Learning · Computer Science 2022-05-18 Joao Monteiro , Mohamed Osama Ahmed , Hossein Hajimirsadeghi , Greg Mori

The graduated optimization approach is a method for finding global optimal solutions for nonconvex functions by using a function smoothing operation with stochastic noise. This paper makes three contributions regarding graduated…

Machine Learning · Computer Science 2026-01-27 Naoki Sato , Hideaki Iiduka

Deep features extracted from certain layers of a pre-trained deep model show superior performance over the conventional hand-crafted features. Compared with fine-tuning or linear probing that can explore diverse augmentations, \eg, random…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qi Qian , Yuanhong Xu , Juhua Hu

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as…

Machine Learning · Computer Science 2021-02-23 Viktor Reshniak , Clayton Webster

Several applications of Reinforcement Learning suffer from instability due to high variance. This is especially prevalent in high dimensional domains. Regularization is a commonly used technique in machine learning to reduce variance, at…

Machine Learning · Computer Science 2019-04-12 Pierre Thodoroff , Audrey Durand , Joelle Pineau , Doina Precup

Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…

Optimization and Control · Mathematics 2024-01-17 Danilo Riccio , Matthias J. Ehrhardt , Martin Benning

Deep learning regularization techniques, such as dropout, layer normalization, or weight decay, are widely adopted in the construction of modern artificial neural networks, often resulting in more robust training processes and improved…

Machine Learning · Computer Science 2024-11-22 Denis Tarasov , Anja Surina , Caglar Gulcehre

Feedback Alignment (FA) methods are biologically inspired local learning rules for training neural networks with reduced communication between layers. While FA has potential applications in distributed and privacy-aware ML, limitations in…

Machine Learning · Computer Science 2024-06-05 Zachary Robertson , Oluwasanmi Koyejo

Regularization for optimization is a crucial technique to avoid overfitting in machine learning. In order to obtain the best performance, we usually train a model by tuning the regularization parameters. It becomes costly, however, when a…

Machine Learning · Computer Science 2020-08-18 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

Direct policy optimization in reinforcement learning is usually solved with policy-gradient algorithms, which optimize policy parameters via stochastic gradient ascent. This paper provides a new theoretical interpretation and justification…

Machine Learning · Computer Science 2023-10-24 Adrien Bolland , Gilles Louppe , Damien Ernst

In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks. It was shown that these models exhibit an implicit…

Machine Learning · Computer Science 2022-09-20 Noam Razin , Asaf Maman , Nadav Cohen

Averaging scheme has attracted extensive attention in deep learning as well as traditional machine learning. It achieves theoretically optimal convergence and also improves the empirical model performance. However, there is still a lack of…

Machine Learning · Computer Science 2021-01-19 Wei Tao , Wei Li , Zhisong Pan , Qing Tao

In this work, we establish a frequency-domain framework for analyzing gradient-based algorithms in linear minimax optimization problems; specifically, our approach is based on the Z-transform, a powerful tool applied in Control Theory and…

Optimization and Control · Mathematics 2020-10-08 Ioannis Anagnostides , Paolo Penna

Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in learning and vision fields. The validity of existing works heavily relies on solving a series of approximation subproblems with extraordinarily high…

Optimization and Control · Mathematics 2022-05-23 Risheng Liu , Xuan Liu , Wei Yao , Shangzhi Zeng , Jin Zhang

We focus on the task of approximating the optimal value function in deep reinforcement learning. This iterative process is comprised of solving a sequence of optimization problems where the loss function changes per iteration. The common…

Machine Learning · Computer Science 2023-11-16 Kavosh Asadi , Rasool Fakoor , Shoham Sabach

Converting a parametric curve into the implicit form, which is called implicitization, has always been a popular but challenging problem in geometric modeling and related applications. However, the existing methods mostly suffer from the…

Graphics · Computer Science 2023-02-24 Minghao Guo , Yan Gao , Zheng Pan

Gradient descent and coordinate descent are well understood in terms of their asymptotic behavior, but less so in a transient regime often used for approximations in machine learning. We investigate how proper initialization can have a…

Machine Learning · Computer Science 2017-06-14 Hadi Daneshmand , Hamed Hassani , Thomas Hofmann

Implicit layer deep learning techniques, like Neural Differential Equations, have become an important modeling framework due to their ability to adapt to new problems automatically. Training a neural differential equation is effectively a…

Machine Learning · Computer Science 2023-06-05 Avik Pal , Alan Edelman , Chris Rackauckas