English
Related papers

Related papers: Toward Corpus Size Requirements for Training and E…

200 papers

This study investigates the relative impact of training data quality versus quantity on the performance of small language models (SLMs), utilizing the TinyStories dataset for empirical analysis. Analysis of dataset variations with respect…

Computation and Language · Computer Science 2025-11-11 Aryan Sajith , Krishna Chaitanya Rao Kathala

As the performance of larger, newer Large Language Models continues to improve for strategic Theory of Mind (ToM) tasks, the demand for these state-of-the-art models increases commensurately. However, their deployment is costly both in…

Computation and Language · Computer Science 2024-11-01 Nunzio Lore , Sepehr Ilami , Babak Heydari

Stressors are related to depression, but this relationship is complex. We investigate the relationship between open-ended text responses about stressors and depressive symptoms across gender and racial/ethnic groups. First, we use topic…

Computation and Language · Computer Science 2022-11-16 Carlos Aguirre , Mark Dredze , Philip Resnik

This paper empirically investigates the relationship between subword vocabulary size and the performance of large language models (LLMs) to provide insights on how to define the vocabulary size. Experimental results show that larger…

Computation and Language · Computer Science 2025-05-29 Sho Takase , Ryokan Ri , Shun Kiyono , Takuya Kato

We present HealthBench, an open-source benchmark measuring the performance and safety of large language models in healthcare. HealthBench consists of 5,000 multi-turn conversations between a model and an individual user or healthcare…

Multilingual language models (MLLMs) are crucial for handling text across various languages, yet they often show performance disparities due to differences in resource availability and linguistic characteristics. While the impact of…

Computation and Language · Computer Science 2024-12-18 Sina Bagheri Nezhad , Ameeta Agrawal , Rhitabrat Pokharel

For conversational large-vocabulary continuous speech recognition (LVCSR) tasks, up to about two thousand hours of audio is commonly used to train state of the art models. Collection of labeled conversational audio however, is prohibitively…

Computation and Language · Computer Science 2017-05-30 Shane Walker , Morten Pedersen , Iroro Orife , Jason Flaks

Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful way is to continuously scale up sizes of the models and the pre-training corpora. These…

Computation and Language · Computer Science 2023-11-17 Yipei Xu , Dakuan Lu , Jiaqing Liang , Xintao Wang , Yipeng Geng , Yingsi Xin , Hengkui Wu , Ken Chen , ruiji zhang , Yanghua Xiao

Warning: This paper may contain texts with uncomfortable content. Large Language Models (LLMs) have achieved remarkable performance in various tasks, including those involving multimodal data like speech. However, these models often exhibit…

Computation and Language · Computer Science 2025-05-22 Yi-Cheng Lin , Wei-Chih Chen , Hung-yi Lee

In this paper, we ask what properties makes a large corpus more or less useful. We suggest that size, by itself, should not be the ultimate goal of building a corpus. Large-scale corpora are considered desirable because they offer…

Sound · Computer Science 2010-12-14 Greg P. Kochanski , Chilin Shih , Ryan Shosted

A multilingual tokenizer is a fundamental component of multilingual neural machine translation. It is trained from a multilingual corpus. Since a skewed data distribution is considered to be harmful, a sampling strategy is usually used to…

Computation and Language · Computer Science 2022-09-13 Shiyue Zhang , Vishrav Chaudhary , Naman Goyal , James Cross , Guillaume Wenzek , Mohit Bansal , Francisco Guzman

Understanding how large language models (LLMs) process emotionally sensitive content is critical for building safe and reliable systems, particularly in mental health contexts. We investigate the scaling behavior of LLMs on two key tasks:…

Computation and Language · Computer Science 2025-09-08 Edoardo Pinzuti , Oliver Tüscher , André Ferreira Castro

The current trend of scaling language models involves increasing both parameter count and training dataset size. Extrapolating this trend suggests that training dataset size may soon be limited by the amount of text data available on the…

Poisoning attacks can compromise the safety of large language models (LLMs) by injecting malicious documents into their training data. Existing work has studied pretraining poisoning assuming adversaries control a percentage of the training…

Multimodal Large Language Models (MLLMs) exhibit promising advancements across various tasks, yet they still encounter significant trustworthiness issues. Prior studies apply Split Conformal Prediction (SCP) in language modeling to…

Computation and Language · Computer Science 2025-07-01 Qingni Wang , Tiantian Geng , Zhiyuan Wang , Teng Wang , Bo Fu , Feng Zheng

As language models (LMs) become increasingly powerful and widely used, it is important to quantify them for sociodemographic bias with potential for harm. Prior measures of bias are sensitive to perturbations in the templates designed to…

Computation and Language · Computer Science 2024-08-09 Vipul Gupta , Pranav Narayanan Venkit , Hugo Laurençon , Shomir Wilson , Rebecca J. Passonneau

Subjective well-being is a key metric in economic, medical, and policy decision-making. As artificial intelligence provides scalable tools for modelling human outcomes, it is crucial to evaluate whether large language models (LLMs) can…

Human-Computer Interaction · Computer Science 2025-07-09 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Archiwaranguprok , Pattie Maes

Data in the healthcare domain arise from a variety of sources and modalities, such as x-ray images, continuous measurements, and clinical notes. Medical practitioners integrate these diverse data types daily to make informed and accurate…

Machine Learning · Computer Science 2024-08-14 Liv Björkdahl , Oskar Pauli , Johan Östman , Chiara Ceccobello , Sara Lundell , Magnus Kjellberg

We investigate the predictability of large language model (LLM) capabilities: given records of past experiments using different model families, numbers of parameters, tasks, and numbers of in-context examples, can we accurately predict LLM…

Computation and Language · Computer Science 2023-11-01 Qinyuan Ye , Harvey Yiyun Fu , Xiang Ren , Robin Jia

Tokenization, a crucial initial step in natural language processing, is governed by several key parameters, such as the tokenization algorithm, vocabulary size, pre-tokenization strategy, inference strategy, and training data corpus. This…

Computation and Language · Computer Science 2025-06-17 Varshini Reddy , Craig W. Schmidt , Yuval Pinter , Chris Tanner
‹ Prev 1 3 4 5 6 7 10 Next ›