English
Related papers

Related papers: Collapse of Self-trained Language Models

200 papers

Expressing natural language descriptions of structured facts or relations -- data-to-text generation (D2T) -- increases the accessibility of structured knowledge repositories. Previous work shows that pre-trained language models(PLMs)…

Computation and Language · Computer Science 2022-05-24 Moniba Keymanesh , Adrian Benton , Mark Dredze

Dominant pre-trained language models (PLMs) have demonstrated the potential risk of memorizing and outputting the training data. While this concern has been discussed mainly in English, it is also practically important to focus on…

Computation and Language · Computer Science 2024-08-16 Shotaro Ishihara , Hiromu Takahashi

Current language models are considered to have sub-human capabilities at natural language tasks like question-answering or writing code. However, language models are not trained to perform well at these tasks, they are trained to accurately…

Computation and Language · Computer Science 2024-07-16 Buck Shlegeris , Fabien Roger , Lawrence Chan , Euan McLean

Recent work on large language models relies on the intuition that most natural language processing tasks can be described via natural language instructions. Language models trained on these instructions show strong zero-shot performance on…

Computation and Language · Computer Science 2022-11-01 Thomas Scialom , Tuhin Chakrabarty , Smaranda Muresan

Recent advances in image tokenizers, such as VQ-VAE, have enabled text-to-image generation using auto-regressive methods, similar to language modeling. However, these methods have yet to leverage pre-trained language models, despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yuhui Zhang , Brandon McKinzie , Zhe Gan , Vaishaal Shankar , Alexander Toshev

Recent large language models have been trained on vast datasets, but also often on repeated data, either intentionally for the purpose of upweighting higher quality data, or unintentionally because data deduplication is not perfect and the…

We define general linguistic intelligence as the ability to reuse previously acquired knowledge about a language's lexicon, syntax, semantics, and pragmatic conventions to adapt to new tasks quickly. Using this definition, we analyze…

Large language models (LLMs) often necessitate extensive labeled datasets and training compute to achieve impressive performance across downstream tasks. This paper explores a self-training paradigm, where the LLM autonomously curates its…

Computation and Language · Computer Science 2024-11-13 Wei Jie Yeo , Teddy Ferdinan , Przemyslaw Kazienko , Ranjan Satapathy , Erik Cambria

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

The self-rationalising capabilities of large language models (LLMs) have been explored in restricted settings, using task/specific data sets. However, current LLMs do not (only) rely on specifically annotated data; nonetheless, they…

Computation and Language · Computer Science 2024-12-18 Jenny Kunz , Marco Kuhlmann

Recent studies have put into question the belief that emergent abilities in language models are exclusive to large models. This skepticism arises from two observations: 1) smaller models can also exhibit high performance on emergent…

Computation and Language · Computer Science 2025-01-16 Zhengxiao Du , Aohan Zeng , Yuxiao Dong , Jie Tang

Language models that are trained on the next-word prediction task have been shown to accurately model human behavior in word prediction and reading speed. In contrast with these findings, we present a scenario in which the performance of…

Computation and Language · Computer Science 2023-10-24 Aditya R. Vaidya , Javier Turek , Alexander G. Huth

What happens if we train a new Large Language Model (LLM) using data that are at least partially generated by other LLMs? The explosive success of LLMs means that a substantial amount of content online will be generated by LLMs rather than…

Computation and Language · Computer Science 2024-07-26 Jinghui Zhang , Dandan Qiao , Mochen Yang , Qiang Wei

Whether machines can originate novel content has been debated for nearly two centuries, from Lovelace's assertion that no engine can "originate anything" to Turing's question of whether a machine can amplify ideas brought in from outside.…

Multiagent Systems · Computer Science 2026-05-19 Weiyi Kong , Shiyang Lai , Jinghua Piao , James Evans

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

Language models such as GPT-2 have performed well on constructing syntactically sound sentences for text auto-completion task. However, such models often require considerable training effort to adapt to specific writing domains (e.g.,…

Computation and Language · Computer Science 2021-09-16 Dong-Ho Lee , Zhiqiang Hu , Roy Ka-Wei Lee

Recent advances in Large Language Models (LLMs) have exhibited remarkable proficiency across various tasks. Given the potent applications of LLMs in numerous fields, there has been a surge in LLM development. In developing LLMs, a common…

Computation and Language · Computer Science 2024-01-09 Chen-An Li , Hung-Yi Lee

This paper takes a first step towards a critical thinking curriculum for neural auto-regressive language models. We introduce a synthetic corpus of deductively valid arguments, and generate artificial argumentative texts to train and…

Computation and Language · Computer Science 2020-12-18 Gregor Betz , Christian Voigt , Kyle Richardson

Pre-trained models are nowadays a fundamental component of machine learning research. In continual learning, they are commonly used to initialize the model before training on the stream of non-stationary data. However, pre-training is…

Machine Learning · Computer Science 2022-05-20 Andrea Cossu , Tinne Tuytelaars , Antonio Carta , Lucia Passaro , Vincenzo Lomonaco , Davide Bacciu

As synthetic content increasingly infiltrates the web, generative AI models may be retrained on their own outputs: a process termed "autophagy". This leads to model collapse: a progressive loss of performance and diversity across…

Computation and Language · Computer Science 2025-09-03 Daniele Gambetta , Gizem Gezici , Fosca Giannotti , Dino Pedreschi , Alistair Knott , Luca Pappalardo