English
Related papers

Related papers: KNN-LM Does Not Improve Open-ended Text Generation

200 papers

Large Language Models (LLMs) have become dominant in the Natural Language Processing (NLP) field causing a huge surge in progress in a short amount of time. However, their limitations are still a mystery and have primarily been explored…

Software Engineering · Computer Science 2024-04-11 Nathan Cooper , Torsten Scholak

To ensure large language models (LLMs) are used safely, one must reduce their propensity to hallucinate or to generate unacceptable answers. A simple and often used strategy is to first let the LLM generate multiple hypotheses and then…

Computation and Language · Computer Science 2025-02-12 António Farinhas , Haau-Sing Li , André F. T. Martins

Large Language Models (LLMs) excel at generating fluent text but struggle to enforce external constraints because they generate tokens sequentially without explicit control mechanisms. GenCP addresses this limitation by combining LLM…

Computation and Language · Computer Science 2025-06-02 Alexandre Bonlarron , Florian Régin , Elisabetta De Maria , Jean-Charles Régin

Diffusion language models have seen exciting recent progress, offering far more flexibility in generative trajectories than autoregressive models. This flexibility has motivated a growing body of research into new approaches to diffusion…

Machine Learning · Computer Science 2026-04-06 Patrick Pynadath , Jiaxin Shi , Ruqi Zhang

Diffusion large language models (dLLMs) theoretically permit token decoding in arbitrary order, a flexibility that could enable richer exploration of reasoning paths than autoregressive (AR) LLMs. In practice, however, random-order decoding…

Computation and Language · Computer Science 2026-04-02 Liancheng Fang , Aiwei Liu , Henry Peng Zou , Yankai Chen , Enze Ma , Leyi Pan , Chunyu Miao , Wei-Chieh Huang , Xue Liu , Philip S. Yu

Large language models (LLMs) often hallucinate and lack the ability to provide attribution for their generations. Semi-parametric LMs, such as kNN-LM, approach these limitations by refining the output of an LM for a given prompt using its…

Computation and Language · Computer Science 2025-04-28 Minghan Li , Xilun Chen , Ari Holtzman , Beidi Chen , Jimmy Lin , Wen-tau Yih , Xi Victoria Lin

Despite recent progress, it has been difficult to prevent semantic hallucinations in generative Large Language Models. One common solution to this is augmenting LLMs with a retrieval system and making sure that the generated output is…

Computation and Language · Computer Science 2023-02-16 Renat Aksitov , Chung-Ching Chang , David Reitter , Siamak Shakeri , Yunhsuan Sung

LLM text decoding is key component for perceived LLM quality. We demonstrate two experiments showing that decoding methods could be improved by manipulation of token probabilities. First, we test few LLM on SummEval summary scoring dataset,…

Computation and Language · Computer Science 2024-09-27 Krystian Zawistowski

Diffusion language models have emerged as a promising approach for text generation. One would naturally expect this method to be an efficient replacement for autoregressive models since multiple tokens can be sampled in parallel during each…

Machine Learning · Computer Science 2025-06-10 Guhao Feng , Yihan Geng , Jian Guan , Wei Wu , Liwei Wang , Di He

Neural language models (LMs) based on recurrent neural networks (RNN) are some of the most successful word and character-level LMs. Why do they work so well, in particular better than linear neural LMs? Possible explanations are that RNNs…

Machine Learning · Statistics 2013-06-21 Marius Pachitariu , Maneesh Sahani

In recent years, the field of neural machine translation (NMT) for SPARQL query generation has witnessed significant growth. Incorporating the copy mechanism with traditional encoder-decoder architectures and using pre-trained…

Computation and Language · Computer Science 2024-01-15 Papa Abdou Karim Karou Diallo , Samuel Reyd , Amal Zouaq

The rapid advancement in large language models (LLMs) has significantly enhanced their ability to generate coherent and contextually relevant text, raising concerns about the misuse of AI-generated content and making it critical to detect…

Computation and Language · Computer Science 2025-07-15 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

Information Retrieval · Computer Science 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Despite the successes of large language models (LLMs), they exhibit significant drawbacks, particularly when processing long contexts. Their inference cost scales quadratically with respect to sequence length, making it expensive for…

Computation and Language · Computer Science 2024-07-22 Thomas Merth , Qichen Fu , Mohammad Rastegari , Mahyar Najibi

Using large language models (LMs) for query or document expansion can improve generalization in information retrieval. However, it is unknown whether these techniques are universally beneficial or only effective in specific settings, such…

Information Retrieval · Computer Science 2024-02-28 Orion Weller , Kyle Lo , David Wadden , Dawn Lawrie , Benjamin Van Durme , Arman Cohan , Luca Soldaini

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

Information Retrieval · Computer Science 2025-09-10 Julian Killingback , Hamed Zamani

As more content generated by large language models (LLMs) floods into the Internet, information retrieval (IR) systems now face the challenge of distinguishing and handling a blend of human-authored and machine-generated texts. Recent…

Information Retrieval · Computer Science 2025-08-26 Wei Huang , Keping Bi , Yinqiong Cai , Wei Chen , Jiafeng Guo , Xueqi Cheng

Generating multiple translation candidates would enable users to choose the one that satisfies their needs. Although there has been work on diversified generation, there exists room for improving the diversity mainly because the previous…

Computation and Language · Computer Science 2024-02-15 Yuto Nishida , Makoto Morishita , Hidetaka Kamigaito , Taro Watanabe

In the last decade, the generalization and adaptation abilities of deep learning models were typically evaluated on fixed training and test distributions. Contrary to traditional deep learning, large language models (LLMs) are (i) even more…

Computation and Language · Computer Science 2024-10-17 Fırat Öncel , Matthias Bethge , Beyza Ermis , Mirco Ravanelli , Cem Subakan , Çağatay Yıldız

Retrieval-augmented language models (RaLM) have demonstrated the potential to solve knowledge-intensive natural language processing (NLP) tasks by combining a non-parametric knowledge base with a parametric language model. Instead of…

Machine Learning · Computer Science 2024-01-26 Zhihao Zhang , Alan Zhu , Lijie Yang , Yihua Xu , Lanting Li , Phitchaya Mangpo Phothilimthana , Zhihao Jia