English
Related papers

Related papers: Low-Perplexity LLM-Generated Sequences and Where T…

200 papers

With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational…

Computation and Language · Computer Science 2023-10-31 Maria Valentini , Jennifer Weber , Jesus Salcido , Téa Wright , Eliana Colunga , Katharina Kann

Can autoregressive large language models (LLMs) learn consistent probability distributions when trained on sequences in different token orders? We prove formally that for any well-defined probability distribution, sequence perplexity is…

Computation and Language · Computer Science 2025-05-14 Xiaoliang Luo , Xinyi Xu , Michael Ramscar , Bradley C. Love

Over the past decade, extensive research efforts have been dedicated to the extraction of information from textual process descriptions. Despite the remarkable progress witnessed in natural language processing (NLP), information extraction…

Computation and Language · Computer Science 2024-07-29 Julian Neuberger , Lars Ackermann , Han van der Aa , Stefan Jablonski

Large Language Models (LLMs) have recently emerged as promising tools for recommendation thanks to their advanced textual understanding ability and context-awareness. Despite the current practice of training and evaluating LLM-based…

Information Retrieval · Computer Science 2025-06-12 Sein Kim , Hongseok Kang , Kibum Kim , Jiwan Kim , Donghyun Kim , Minchul Yang , Kwangjin Oh , Julian McAuley , Chanyoung Park

Large Language Models (LLMs) have been widely used as general-purpose AI agents showing comparable performance on many downstream tasks. However, existing work shows that it is challenging for LLMs to integrate structured data (e.g. KG,…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Sungchul Kim , Tong Yu , Ryan A. Rossi , Xiang Chen

Large language models (LLMs) have been recently leveraged as training data generators for various natural language processing (NLP) tasks. While previous research has explored different approaches to training models using generated data,…

Computation and Language · Computer Science 2023-10-19 Yue Yu , Yuchen Zhuang , Jieyu Zhang , Yu Meng , Alexander Ratner , Ranjay Krishna , Jiaming Shen , Chao Zhang

Recent work has demonstrated surprisingly good performance of pre-trained LLMs on regression tasks (for example, time-series prediction), with the ability to incorporate expert prior knowledge and the information contained in textual…

Machine Learning · Computer Science 2026-05-14 Felix Biggs , Samuel Willis

As more content generated by large language models (LLMs) floods into the Internet, information retrieval (IR) systems now face the challenge of distinguishing and handling a blend of human-authored and machine-generated texts. Recent…

Information Retrieval · Computer Science 2025-08-26 Wei Huang , Keping Bi , Yinqiong Cai , Wei Chen , Jiafeng Guo , Xueqi Cheng

Vector embeddings derived from large language models (LLMs) show promise in capturing latent information from the literature. Interestingly, these can be integrated into material embeddings, potentially useful for data-driven predictions of…

Computation and Language · Computer Science 2024-09-19 Luke P. J. Gilligan , Matteo Cobelli , Hasan M. Sayeed , Taylor D. Sparks , Stefano Sanvito

Learning to generate fluent natural language from structured data with neural networks has become an common approach for NLG. This problem can be challenging when the form of the structured data varies between examples. This paper presents…

Computation and Language · Computer Science 2018-10-12 Sebastian Gehrmann , Falcon Z. Dai , Henry Elder , Alexander M. Rush

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Collecting diverse human opinions is costly and challenging. This leads to a recent trend in exploiting large language models (LLMs) for generating diverse data for potential scalable and efficient solutions. However, the extent to which…

Computation and Language · Computer Science 2024-10-15 Shirley Anugrah Hayati , Minhwa Lee , Dheeraj Rajagopal , Dongyeop Kang

Training data compositions for Large Language Models (LLMs) can significantly affect their downstream performance. However, a thorough data ablation study exploring large sets of candidate data mixtures is typically prohibitively expensive…

Computation and Language · Computer Science 2024-12-10 Clara Na , Ian Magnusson , Ananya Harsh Jha , Tom Sherborne , Emma Strubell , Jesse Dodge , Pradeep Dasigi

Maintaining consistent model performance across domains is a fundamental challenge in machine learning. While recent work has explored using LLM-generated data for fine-tuning, its impact on cross-domain generalization remains poorly…

Computation and Language · Computer Science 2025-12-12 Chao-Chung Wu , Zhi Rui Tam , Chieh-Yen Lin , Yun-Nung Chen , Shao-Hua Sun , Hung-yi Lee

The generation of texts using Large Language Models (LLMs) is inherently uncertain, with sources of uncertainty being not only the generation of texts, but also the prompt used and the downstream interpretation. Within this work, we provide…

Machine Learning · Computer Science 2026-03-30 Steffen Herbold , Florian Lemmerich

Large language models (LLMs) are widely used in decision-making, but their reliability, especially in critical tasks like healthcare, is not well-established. Therefore, understanding how LLMs reason and make decisions is crucial for their…

Machine Learning · Computer Science 2025-02-25 Ze Yu Zhang , Arun Verma , Finale Doshi-Velez , Bryan Kian Hsiang Low

In this work we explore recent advances in Recurrent Neural Networks for large scale Language Modeling, a task central to language understanding. We extend current models to deal with two key challenges present in this task: corpora and…

Computation and Language · Computer Science 2016-02-15 Rafal Jozefowicz , Oriol Vinyals , Mike Schuster , Noam Shazeer , Yonghui Wu

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

Text Generation aims to produce plausible and readable text in a human language from input data. The resurgence of deep learning has greatly advanced this field, in particular, with the help of neural generation models based on pre-trained…

Computation and Language · Computer Science 2022-05-17 Junyi Li , Tianyi Tang , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Large Language Models (LLMs) are used for many tasks, including those related to coding. An important aspect of being able to utilize LLMs is the ability to assess their fitness for specific usages. The common practice is to evaluate LLMs…

Artificial Intelligence · Computer Science 2024-07-30 Marcel Zalmanovici , Orna Raz , Eitan Farchi , Iftach Freund