English
Related papers

Related papers: ColBERT-Zero: To Pre-train Or Not To Pre-train Col…

200 papers

This paper reveals a new appeal of the recently emerged large-kernel Convolutional Neural Networks (ConvNets): as the teacher in Knowledge Distillation (KD) for small-kernel ConvNets. While Transformers have led state-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Tianjin Huang , Lu Yin , Zhenyu Zhang , Li Shen , Meng Fang , Mykola Pechenizkiy , Zhangyang Wang , Shiwei Liu

Recently, large-scale pre-trained models have shown their advantages in many tasks. However, due to the huge computational complexity and storage requirements, it is challenging to apply the large-scale model to real scenes. A common…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Deng Li , Aming Wu , Yahong Han , Qi Tian

For most natural language processing tasks, the dominant practice is to finetune large pretrained transformer models (e.g., BERT) using smaller downstream datasets. Despite the success of this approach, it remains unclear to what extent…

Computation and Language · Computer Science 2023-05-29 Kundan Krishna , Saurabh Garg , Jeffrey P. Bigham , Zachary C. Lipton

Pre-trained language models have demonstrated superior performance in various natural language processing tasks. However, these models usually contain hundreds of millions of parameters, which limits their practicality because of latency…

Computation and Language · Computer Science 2022-05-02 Simiao Zuo , Qingru Zhang , Chen Liang , Pengcheng He , Tuo Zhao , Weizhu Chen

Multimodal pre-training models, such as LXMERT, have achieved excellent results in downstream tasks. However, current pre-trained models require large amounts of training data and have huge model sizes, which make them difficult to apply in…

Computation and Language · Computer Science 2021-08-02 Tongtong Liu , Fangxiang Feng , Xiaojie Wang

In many practical scenarios -- like hyperparameter search or continual retraining with new data -- related training runs are performed many times in sequence. Current practice is to train each of these models independently from scratch. We…

Machine Learning · Computer Science 2023-03-14 Xingyu Liu , Alex Leonardi , Lu Yu , Chris Gilmer-Hill , Matthew Leavitt , Jonathan Frankle

In the past few years, transformer-based pre-trained language models have achieved astounding success in both industry and academia. However, the large model size and high run-time latency are serious impediments to applying them in…

Computation and Language · Computer Science 2022-07-13 Chengqiang Lu , Jianwei Zhang , Yunfei Chu , Zhengyu Chen , Jingren Zhou , Fei Wu , Haiqing Chen , Hongxia Yang

We demonstrate that co-training (Blum & Mitchell, 1998) can improve the performance of prompt-based learning by using unlabeled data. While prompting has emerged as a promising paradigm for few-shot and zero-shot learning, it is often…

Computation and Language · Computer Science 2022-02-03 Hunter Lang , Monica Agrawal , Yoon Kim , David Sontag

With the great success of pre-trained models, the pretrain-then-finetune paradigm has been widely adopted on downstream tasks for source code understanding. However, compared to costly training a large-scale model from scratch, how to…

Software Engineering · Computer Science 2022-03-16 Deze Wang , Zhouyang Jia , Shanshan Li , Yue Yu , Yun Xiong , Wei Dong , Xiangke Liao

When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that have been pre-trained on other large data sets, pre-training…

Machine Learning · Computer Science 2022-05-24 Laura von Rueden , Sebastian Houben , Kostadin Cvejoski , Christian Bauckhage , Nico Piatkowski

The Transformer architecture deeply changed the natural language processing, outperforming all previous state-of-the-art models. However, well-known Transformer models like BERT, RoBERTa, and GPT-2 require a huge compute budget to create a…

Computation and Language · Computer Science 2021-04-21 Luca Di Liello , Matteo Gabburo , Alessandro Moschitti

Pre-trained language models (PLMs) achieve great success in NLP. However, their huge model sizes hinder their applications in many practical systems. Knowledge distillation is a popular technique to compress PLMs, which learns a small…

Computation and Language · Computer Science 2021-06-03 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

Large-scale pre-trained models such as CodeBERT, GraphCodeBERT have earned widespread attention from both academia and industry. Attributed to the superior ability in code representation, they have been further applied in multiple…

Software Engineering · Computer Science 2023-01-24 Shangqing Liu , Bozhi Wu , Xiaofei Xie , Guozhu Meng , Yang Liu

In this paper, we question if well pre-trained vision transformer (ViT) models could be used as teachers that exhibit scalable properties to advance cross architecture knowledge distillation (KD) research, in the context of using…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jiawei Fan , Chao Li , Xiaolong Liu , Anbang Yao

Deep neural models in recent years have been successful in almost every field, including extremely complex problem statements. However, these models are huge in size, with millions (and even billions) of parameters, thus demanding more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Lin Wang , Kuk-Jin Yoon

Pre-training a large transformer model on a massive amount of unlabeled data and fine-tuning it on labeled datasets for diverse downstream tasks has proven to be a successful strategy, for a variety of vision and natural language processing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang , Kenji Kawaguchi

Knowledge distillation has made remarkable achievements in model compression. However, most existing methods require the original training data, which is usually unavailable due to privacy and security issues. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Xinyi Yu , Ling Yan , Yang Yang , Libo Zhou , Linlin Ou

The remarkable performance gains realized by large pretrained models, e.g., GPT-3, hinge on the massive amounts of data they are exposed to during training. Analogously, distilling such large models to compact models for efficient…

Machine Learning · Computer Science 2022-08-16 Manzil Zaheer , Ankit Singh Rawat , Seungyeon Kim , Chong You , Himanshu Jain , Andreas Veit , Rob Fergus , Sanjiv Kumar

Recent advances in language modeling have led to computationally intensive and resource-demanding state-of-the-art models. In an effort towards sustainable practices, we study the impact of pre-training data volume on compact language…

Computation and Language · Computer Science 2020-10-12 Vincent Micheli , Martin d'Hoffschmidt , François Fleuret

Deep Learning requires large amounts of data to train models that work well. In data-deficient settings, performance can be degraded. We investigate which Deep Learning methods benefit training models in a data-deficient setting, by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Robert-Jan Bruintjes , Attila Lengyel , Osman Semih Kayhan , Davide Zambrano , Nergis Tömen , Hadi Jamali-Rad , Jan van Gemert