English
Related papers

Related papers: Understanding How Model Size Affects Few-shot Inst…

200 papers

Transformers-based pretrained language models achieve outstanding results in many well-known NLU benchmarks. However, while pretraining methods are very convenient, they are expensive in terms of time and resources. This calls for a study…

Computation and Language · Computer Science 2021-09-10 Laura Pérez-Mayos , Miguel Ballesteros , Leo Wanner

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

Recent advances in Large Language Models (LLMs) have significantly reshaped the landscape of Natural Language Processing (NLP). Among the various prompting techniques, few-shot prompting has gained considerable attention for its…

Computation and Language · Computer Science 2025-10-07 Deshan Sumanathilaka , Nicholas Micallef , Julian Hough

Retrieval-augmented language models pose a promising alternative to standard language modeling. During pretraining, these models search in a corpus of documents for contextually relevant information that could aid the language modeling…

Computation and Language · Computer Science 2024-04-18 David Samuel , Lucas Georges Gabriel Charpentier , Sondre Wold

Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging knowledge and achieve robustness in dynamic environments. Our…

Computation and Language · Computer Science 2025-02-13 Çağatay Yıldız , Nishaanth Kanna Ravichandran , Nitin Sharma , Matthias Bethge , Beyza Ermis

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these…

Computation and Language · Computer Science 2024-03-26 Yida Mu , Ben P. Wu , William Thorne , Ambrose Robinson , Nikolaos Aletras , Carolina Scarton , Kalina Bontcheva , Xingyi Song

Scaling existing applications and solutions to multiple human languages has traditionally proven to be difficult, mainly due to the language-dependent nature of preprocessing and feature engineering techniques employed in traditional…

Computation and Language · Computer Science 2020-01-01 Xiaotong Liu , Yingbei Tong , Anbang Xu , Rama Akkiraju

A wide body of evidence shows that human language processing difficulty is predicted by the information-theoretic measure surprisal, a word's negative log probability in context. However, it is still unclear how to best estimate these…

Computation and Language · Computer Science 2024-07-04 Tong Liu , Iza Škrjanec , Vera Demberg

We develop a methodology for analyzing language model task performance at the individual example level based on training data density estimation. Experiments with paraphrasing as a controlled intervention on finetuning data demonstrate that…

In-context learning enables large language models (LLMs) to perform a variety of tasks, including learning to make reward-maximizing choices in simple bandit tasks. Given their potential use as (autonomous) decision-making agents, it is…

Computation and Language · Computer Science 2024-05-21 William M. Hayes , Nicolas Yax , Stefano Palminteri

Large language models memorize parts of their training data. Memorizing short snippets and facts is required to answer questions about the world and to be fluent in any language. But models have also been shown to reproduce long verbatim…

Computation and Language · Computer Science 2024-11-18 Michael Aerni , Javier Rando , Edoardo Debenedetti , Nicholas Carlini , Daphne Ippolito , Florian Tramèr

Recent studies have put into question the belief that emergent abilities in language models are exclusive to large models. This skepticism arises from two observations: 1) smaller models can also exhibit high performance on emergent…

Computation and Language · Computer Science 2025-01-16 Zhengxiao Du , Aohan Zeng , Yuxiao Dong , Jie Tang

Deep learning (DL) creates impactful advances following a virtuous recipe: model architecture search, creating large training data sets, and scaling computation. It is widely believed that growing training sets and models should improve…

Large language models (LLMs) are increasingly adopted in educational technologies for a variety of tasks, from generating instructional materials and assisting with assessment design to tutoring. While prior work has investigated how models…

Computation and Language · Computer Science 2025-12-24 Kirk Vanacore , Rene F. Kizilcec

Large crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including those licensed by…

Computation and Language · Computer Science 2019-04-30 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Modern neural language models that are widely used in various NLP tasks risk memorizing sensitive information from their training data. Understanding this memorization is important in real world applications and also from a…

Computation and Language · Computer Science 2023-10-17 Chiyuan Zhang , Daphne Ippolito , Katherine Lee , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

The performance of deep neural network-based speech enhancement systems typically increases with the training dataset size. However, studies that investigated the effect of training dataset size on speech enhancement performance did not…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

This paper investigates the effectiveness of large language models (LLMs) in answering questions over datasets. We examine their performance in two scenarios: (a) directly answering questions given a dataset file as input, and (b)…

Computation and Language · Computer Science 2026-05-12 Andreas Xenofontos , Pavlos Fafalios

When using active learning, smaller batch sizes are typically more efficient from a learning efficiency perspective. However, in practice due to speed and human annotator considerations, the use of larger batch sizes is necessary. While…

Machine Learning · Computer Science 2018-05-18 Garrett Beatty , Ethan Kochis , Michael Bloodgood