English
Related papers

Related papers: Modality-Aware SAM: Sharpness-Aware-Minimization D…

200 papers

Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima. In this work, we establish connections between SAM and Mean-Field Variational Inference (MFVI) of neural network…

Machine Learning · Statistics 2022-10-20 Szilvia Ujváry , Zsigmond Telek , Anna Kerekes , Anna Mészáros , Ferenc Huszár

Sharpness-Aware Minimization (SAM) has been proven to be an effective optimization technique for improving generalization in overparameterized models. While prior works have explored the implicit regularization of SAM in simple two-core…

Machine Learning · Computer Science 2025-08-15 Tianxiao Cao , Kyohei Atarashi , Hisashi Kashima

Sharpness-aware minimization (SAM) was proposed to reduce sharpness of minima and has been shown to enhance generalization performance in various settings. In this work we show that perturbing only the affine normalization parameters…

Machine Learning · Computer Science 2023-11-20 Maximilian Mueller , Tiffany Vlaar , David Rolnick , Matthias Hein

Sharpness-Aware Minimization (SAM) has emerged as a powerful method for improving generalization in machine learning models by minimizing the sharpness of the loss landscape. However, despite its success, several important questions…

Optimization and Control · Mathematics 2025-03-05 Dimitris Oikonomou , Nicolas Loizou

Network quantization is a dominant paradigm of model compression. However, the abrupt changes in quantized weights during training often lead to severe loss fluctuations and result in a sharp loss landscape, making the gradients unstable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jing Liu , Jianfei Cai , Bohan Zhuang

Sharpness aware minimization (SAM) optimizer has been extensively explored as it can generalize better for training deep neural networks via introducing extra perturbation steps to flatten the landscape of deep learning models. Integrating…

Machine Learning · Computer Science 2023-03-02 Hao Sun , Li Shen , Qihuang Zhong , Liang Ding , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Sharpness-Aware Minimization (SAM) was introduced to improve generalization by seeking flat minima, yet it also exhibits robustness to label noise, a phenomenon that remains only partially understood. Prior work has mainly attributed this…

Machine Learning · Computer Science 2026-03-31 Hoang-Chau Luong , Quang-Thuc Nguyen , Dat Ba Tran , Minh-Triet Tran

Recently, Sharpness-Aware Minimization (SAM), which connects the geometry of the loss landscape and generalization, has demonstrated significant performance boosts on training large-scale models such as vision transformers. However, the…

Machine Learning · Computer Science 2022-03-08 Yong Liu , Siqi Mai , Xiangning Chen , Cho-Jui Hsieh , Yang You

Sharpness-Aware Minimization (SAM) enhances generalization by reducing a Max-Sharpness (MaxS). Despite the practical success, we empirically found that the MAxS behind SAM's generalization enhancements face the "Flatness Indicator Problem"…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Jiaxin Deng , Junbiao Pang , Baochang Zhang , Qingming Huang

Sharpness-aware minimization (SAM), which searches for flat minima by min-max optimization, has been shown to be useful in improving model generalization. However, since each SAM update requires computing two gradients, its computational…

Machine Learning · Computer Science 2023-05-01 Weisen Jiang , Hansi Yang , Yu Zhang , James Kwok

Sharpness-aware minimization (SAM) is a recently proposed method that minimizes the sharpness of the training loss of a neural network. While its generalization improvement is well-known and is the primary motivation, we uncover an…

Machine Learning · Computer Science 2023-10-31 Maksym Andriushchenko , Dara Bahri , Hossein Mobahi , Nicolas Flammarion

Sharpness-Aware Minimization (SAM) is a recent optimization framework aiming to improve the deep neural network generalization, through obtaining flatter (i.e. less sharp) solutions. As SAM has been numerically successful, recent papers…

Machine Learning · Statistics 2023-05-22 Kayhan Behdin , Rahul Mazumder

Model-agnostic meta learning (MAML) is currently one of the dominating approaches for few-shot meta-learning. Albeit its effectiveness, the optimization of MAML can be challenging due to the innate bilevel problem structure. Specifically,…

Machine Learning · Computer Science 2022-08-16 Momin Abbas , Quan Xiao , Lisha Chen , Pin-Yu Chen , Tianyi Chen

Sharpness-aware minimization (SAM) has been shown to improve the generalization of neural networks. However, each SAM update requires \emph{sequentially} computing two gradients, effectively doubling the per-iteration cost compared to base…

Machine Learning · Computer Science 2024-10-15 Wanyun Xie , Thomas Pethick , Volkan Cevher

Sharpness-aware minimization (SAM) is known to improve the generalization performance of neural networks. However, it is not widely used in real-world applications yet due to its expensive model perturbation cost. A few variants of SAM have…

Machine Learning · Computer Science 2025-03-19 Sunwoo Lee

Sharpness-aware Minimization (SAM) has been proposed recently to improve model generalization ability. However, SAM calculates the gradient twice in each optimization step, thereby doubling the computation costs compared to stochastic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jiaxin Deng , Junbiao Pang , Baochang Zhang , Tian Wang

Recently, there has been a surge in interest in developing optimization algorithms for overparameterized models as achieving generalization is believed to require algorithms with suitable biases. This interest centers on minimizing…

Machine Learning · Computer Science 2026-02-05 Behrooz Tahmasebi , Ashkan Soleymani , Dara Bahri , Stefanie Jegelka , Patrick Jaillet

Multimodal fusion is susceptible to modality imbalance, where dominant modalities overshadow weak ones, easily leading to biased learning and suboptimal fusion, especially for incomplete modality conditions. To address this problem, we…

Machine Learning · Computer Science 2026-03-20 Xiang Shi , Rui Zhang , Jiawei Liu , Yinpeng Liu , Qikai Cheng , Wei Lu

Sharpness-aware minimization (SAM) has well documented merits in enhancing generalization of deep neural networks, even without sizable data augmentation. Embracing the geometry of the loss function, where neighborhoods of 'flat minima'…

Machine Learning · Computer Science 2023-12-25 Bingcong Li , Georgios B. Giannakis

Pretraining optimizers are tuned to produce the strongest possible base model, on the assumption that a stronger starting point yields a stronger model after subsequent changes like post-training and quantization. This overlooks the…

Machine Learning · Computer Science 2026-05-05 Ishaan Watts , Catherine Li , Sachin Goyal , Jacob Mitchell Springer , Aditi Raghunathan