English
Related papers

Related papers: Pruning's Effect on Generalization Through the Len…

200 papers

Background: Deep learning models are typically trained using stochastic gradient descent or one of its variants. These methods update the weights using their gradient, estimated from a small fraction of the training data. It has been…

Machine Learning · Statistics 2018-01-03 Elad Hoffer , Itay Hubara , Daniel Soudry

Large Language Models (LLMs) trained with self-supervision on vast corpora of web text fit to the social biases of that text. Without intervention, these social biases persist in the model's predictions in downstream tasks, leading to…

Computation and Language · Computer Science 2023-12-13 Gustavo Gonçalves , Emma Strubell

Large neural networks are heavily over-parameterized. This is done because it improves training to optimality. However once the network is trained, this means many parameters can be zeroed, or pruned, leaving an equivalent sparse neural…

Machine Learning · Computer Science 2022-07-12 Michael G. Rawson

We surely enjoy the larger the better models for their superior performance in the last couple of years when both the hardware and software support the birth of such extremely huge models. The applied fields include text mining and others.…

Computation and Language · Computer Science 2024-06-04 Hanjuan Huang , Hao-Jia Song , Hsing-Kuo Pao

How does scaling the number of parameters in large language models (LLMs) affect their core capabilities? We study two natural scaling techniques -- weight pruning and simply training a smaller or larger model, which we refer to as dense…

Computation and Language · Computer Science 2023-10-10 Tian Jin , Nolan Clement , Xin Dong , Vaishnavh Nagarajan , Michael Carbin , Jonathan Ragan-Kelley , Gintare Karolina Dziugaite

Despite the remarkable capabilities of modern large language models (LLMs), the mechanisms behind their problem-solving abilities remain elusive. In this work, we aim to better understand how the learning dynamics of LLM finetuning shapes…

Machine Learning · Computer Science 2024-11-19 Katie Kang , Amrith Setlur , Dibya Ghosh , Jacob Steinhardt , Claire Tomlin , Sergey Levine , Aviral Kumar

Machine learning is predicated on the concept of generalization: a model achieving low error on a sufficiently large training set should also perform well on novel samples from the same distribution. We show that both data whitening and…

Machine Learning · Computer Science 2021-07-20 Neha S. Wadia , Daniel Duckworth , Samuel S. Schoenholz , Ethan Dyer , Jascha Sohl-Dickstein

Diffusion models generalize well in practice. However, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what induces generalization in a real diffusion model. We show…

Machine Learning · Computer Science 2026-05-21 Tim Kaiser , Markus Kollmann

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

We study why overparameterization -- increasing model size well beyond the point of zero training error -- can hurt test error on minority groups despite improving average test error when there are spurious correlations in the data. Through…

Machine Learning · Computer Science 2020-08-28 Shiori Sagawa , Aditi Raghunathan , Pang Wei Koh , Percy Liang

Structured pruning has been extensively studied on monolingual pre-trained language models and is yet to be fully evaluated on their multilingual counterparts. This work investigates three aspects of structured pruning on multilingual…

Computation and Language · Computer Science 2022-04-07 Yanyang Li , Fuli Luo , Runxin Xu , Songfang Huang , Fei Huang , Liwei Wang

Calibration can reduce overconfident predictions of deep neural networks, but can calibration also accelerate training? In this paper, we show that it can when used to prioritize some examples for performing subset selection. We study the…

Machine Learning · Computer Science 2022-11-17 Ganesh Tata , Gautham Krishna Gudur , Gopinath Chennupati , Mohammad Emtiyaz Khan

Data augmentation is a cornerstone technique in deep learning, widely used to improve model generalization. Traditional methods like random cropping and color jittering, as well as advanced techniques such as CutOut, Mixup, and CutMix, have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Jingyang Li , Jiachun Pan , Kim-Chuan Toh , Pan Zhou

Mitigating shortcuts, where models exploit spurious correlations in training data, remains a significant challenge for improving generalization. Regularization methods have been proposed to address this issue by enhancing model…

Machine Learning · Computer Science 2025-03-24 Haoyang Hong , Ioanna Papanikolaou , Sonali Parbhoo

Federated training of large deep neural networks can often be restrictive due to the increasing costs of communicating the updates with increasing model sizes. Various model pruning techniques have been designed in centralized settings to…

Machine Learning · Computer Science 2022-08-25 Dimitris Stripelis , Umang Gupta , Nikhil Dhinagar , Greg Ver Steeg , Paul Thompson , José Luis Ambite

To improve federated training of neural networks, we develop FedSparsify, a sparsification strategy based on progressive weight magnitude pruning. Our method has several benefits. First, since the size of the network becomes increasingly…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Umang Gupta , Greg Ver Steeg , Jose Luis Ambite

Deep learning approaches have provided state-of-the-art performance in many applications by relying on large and overparameterized neural networks. However, such networks have been shown to be very brittle and are difficult to deploy on…

Human-Computer Interaction · Computer Science 2023-10-26 Zhimin Li , Shusen Liu , Xin Yu , Kailkhura Bhavya , Jie Cao , Diffenderfer James Daniel , Peer-Timo Bremer , Valerio Pascucci

Convolutional Neural Networks (CNNs) suffer from different issues, such as computational complexity and the number of parameters. In recent years pruning techniques are employed to reduce the number of operations and model size in CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Morteza Mousa Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

This study investigates the trade-offs between fairness, privacy, and utility in image classification using machine learning (ML). Recent research suggests that generalization techniques can improve the balance between privacy and utility.…

Machine Learning · Computer Science 2024-12-17 Ahmad Hassanpour , Amir Zarei , Khawla Mallat , Anderson Santana de Oliveira , Bian Yang

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang