English
Related papers

Related papers: Data, Data Everywhere: A Guide for Pretraining Dat…

200 papers

As both machine learning models and the datasets on which they are evaluated have grown in size and complexity, the practice of using a few summary statistics to understand model performance has become increasingly problematic. This is…

With a growing number of BERTology work analyzing different components of pre-trained language models, we extend this line of research through an in-depth analysis of discourse information in pre-trained and fine-tuned language models. We…

Computation and Language · Computer Science 2022-04-12 Patrick Huber , Giuseppe Carenini

Large language models (LLMs) are routinely pre-trained on billions of tokens, only to restart the process over again once new data becomes available. A much cheaper and more efficient solution would be to enable the continual pre-training…

Computation and Language · Computer Science 2023-09-08 Kshitij Gupta , Benjamin Thérien , Adam Ibrahim , Mats L. Richter , Quentin Anthony , Eugene Belilovsky , Irina Rish , Timothée Lesort

While self-supervised learning has made rapid advances in natural language processing, it remains unclear when researchers should engage in resource-intensive domain-specific pretraining (domain pretraining). The law, puzzlingly, has…

Computation and Language · Computer Science 2021-07-07 Lucia Zheng , Neel Guha , Brandon R. Anderson , Peter Henderson , Daniel E. Ho

Foundation models are trained on increasingly immense and opaque datasets. Even while these models are now key in AI system building, it can be difficult to answer the straightforward question: has the model already encountered a given…

Machine Learning · Computer Science 2023-12-15 Marc Marone , Benjamin Van Durme

Language modeling on large-scale datasets leads to impressive performance gains on various downstream language tasks. The validation pre-training loss (or perplexity in autoregressive language modeling) is often used as the evaluation…

Machine Learning · Computer Science 2022-10-26 Hong Liu , Sang Michael Xie , Zhiyuan Li , Tengyu Ma

This paper provides a comprehensive survey of the latest research on multilingual large language models (MLLMs). MLLMs not only are able to understand and generate language across linguistic boundaries, but also represent an important…

Computation and Language · Computer Science 2024-11-20 Shaolin Zhu , Supryadi , Shaoyang Xu , Haoran Sun , Leiyu Pan , Menglong Cui , Jiangcun Du , Renren Jin , António Branco , Deyi Xiong

Recently many research efforts have been devoted to image annotation by leveraging on the associated tags/keywords of web images as training labels. A key issue to resolve is the relatively low accuracy of the tags. In this paper, we…

Multimedia · Computer Science 2011-07-15 Jinhui Tang , Shuicheng Yan , Tat-Seng Chua , Ramesh Jain

Pre-trained Large Language Models (LLMs) have shown success in a diverse set of language inference and understanding tasks. The pre-training stage of LLMs looks at a large corpus of raw textual data. The BabyLM shared task compares LLM…

Computation and Language · Computer Science 2024-01-11 Khushi Bhardwaj , Raj Sanjay Shah , Sashank Varma

We provide an empirical investigation of the potential of pre-training vision-language models on an unprecedented scale: 100 billion examples. We find that model performance tends to saturate at this scale on many common Western-centric…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Xiao Wang , Ibrahim Alabdulmohsin , Daniel Salz , Zhe Li , Keran Rong , Xiaohua Zhai

State-of-the-art pre-trained language models have been shown to memorise facts and perform well with limited amounts of training data. To gain a better understanding of how these models learn, we study their generalisation and memorisation…

Computation and Language · Computer Science 2022-03-16 Michael Tänzer , Sebastian Ruder , Marek Rei

Collecting more diverse and representative training data is often touted as a remedy for the disparate performance of machine learning predictors across subpopulations. However, a precise framework for understanding how dataset properties…

Machine Learning · Computer Science 2021-06-08 Esther Rolf , Theodora Worledge , Benjamin Recht , Michael I. Jordan

Data-to-text generation has recently attracted substantial interests due to its wide applications. Existing methods have shown impressive performance on an array of tasks. However, they rely on a significant amount of labeled data for each…

Computation and Language · Computer Science 2020-10-13 Wenhu Chen , Yu Su , Xifeng Yan , William Yang Wang

Pre-training state-of-the-art large language models (LLMs) requires vast amounts of clean and diverse text data. While the open development of large high-quality English pre-training datasets has seen substantial recent progress, training…

Language models are typically trained on large corpora of text in their default orthographic form. However, this is not the only option; representing data as streams of phonemes can offer unique advantages, from deeper insights into…

Computation and Language · Computer Science 2024-10-31 Zébulon Goriely , Richard Diehl Martinez , Andrew Caines , Lisa Beinborn , Paula Buttery

Instruction-tuning language models has become a crucial step in aligning them for general use. Typically, this process involves extensive training on large datasets, incurring high training costs. In this paper, we introduce a novel…

Computation and Language · Computer Science 2024-02-19 Dheeraj Mekala , Alex Nguyen , Jingbo Shang

To obtain high-quality sentence embeddings from pretrained language models (PLMs), they must either be augmented with additional pretraining objectives or finetuned on a large set of labeled text pairs. While the latter approach typically…

Computation and Language · Computer Science 2021-10-05 Timo Schick , Hinrich Schütze

Pre-trained language models for code (PLMCs) have gained attention in recent research. These models are pre-trained on large-scale datasets using multi-modal objectives. However, fine-tuning them requires extensive supervision and is…

Computation and Language · Computer Science 2023-05-11 Hung Quoc To , Nghi D. Q. Bui , Jin Guo , Tien N. Nguyen

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

With the great success of pre-trained models, the pretrain-then-finetune paradigm has been widely adopted on downstream tasks for source code understanding. However, compared to costly training a large-scale model from scratch, how to…

Software Engineering · Computer Science 2022-03-16 Deze Wang , Zhouyang Jia , Shanshan Li , Yue Yu , Yun Xiong , Wei Dong , Xiangke Liao