English
Related papers

Related papers: Beyond Tokens in Language Models: Interpreting Act…

200 papers

The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As…

Computation and Language · Computer Science 2024-04-22 Junchao Wu , Shu Yang , Runzhe Zhan , Yulin Yuan , Derek F. Wong , Lidia S. Chao

The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven…

Computation and Language · Computer Science 2024-06-14 Millicent Ochieng , Varun Gumma , Sunayana Sitaram , Jindong Wang , Vishrav Chaudhary , Keshet Ronen , Kalika Bali , Jacki O'Neill

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information…

Computation and Language · Computer Science 2025-06-04 Shota Takashiro , Takeshi Kojima , Andrew Gambardella , Qi Cao , Yusuke Iwasawa , Yutaka Matsuo

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

The widespread use of Large Language Models (LLMs), celebrated for their ability to generate human-like text, has raised concerns about misinformation and ethical implications. Addressing these concerns necessitates the development of…

Computation and Language · Computer Science 2024-03-28 Wissam Antoun , Benoît Sagot , Djamé Seddah

Large language models (LLMs) excel at modeling relationships between strings in natural language and have shown promise in extending to other symbolic domains like coding or mathematics. However, the extent to which they implicitly model…

Computation and Language · Computer Science 2025-07-18 Andrew Shin , Kunitake Kaneko

Text Generation aims to produce plausible and readable text in a human language from input data. The resurgence of deep learning has greatly advanced this field, in particular, with the help of neural generation models based on pre-trained…

Computation and Language · Computer Science 2022-05-17 Junyi Li , Tianyi Tang , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Formal languages are an integral part of modeling and simulation. They allow the distillation of knowledge into concise simulation models amenable to automatic execution, interpretation, and analysis. However, the arguably most humanly…

Machine Learning · Computer Science 2025-10-23 Justin N. Kreikemeyer , Miłosz Jankowski , Pia Wilsdorf , Adelinde M. Uhrmacher

This guide introduces Large Language Models (LLM) as a highly versatile text analysis method within the social sciences. As LLMs are easy-to-use, cheap, fast, and applicable on a broad range of text analysis tasks, ranging from text…

Computation and Language · Computer Science 2023-07-26 Petter Törnberg

The text produced by language models (LMs) can exhibit specific `behaviors,' such as a failure to follow alignment training, that we hope to detect and react to during deployment. Identifying these behaviors can often only be done post…

Computation and Language · Computer Science 2025-09-24 Dhananjay Ashok , Jonathan May

Large language models (LLMs) sometimes fail to respond appropriately to deterministic tasks -- such as counting or forming acronyms -- because the implicit prior distribution they have learned over sequences of tokens influences their…

Computation and Language · Computer Science 2025-04-18 Liyi Zhang , Veniamin Veselovsky , R. Thomas McCoy , Thomas L. Griffiths

Interpretability and explainability of AI are becoming increasingly important in light of the rapid development of large language models (LLMs). This paper investigates the interpretation of LLMs in the context of the knowledge-based…

Computation and Language · Computer Science 2024-06-05 Valeriya Goloviznina , Evgeny Kotelnikov

Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by…

Computation and Language · Computer Science 2026-02-11 Bakhtawar Ahtisham , Kirk Vanacore , Zhuqian Zhou , Jinsook Lee , Rene F. Kizilcec

Language models (LMs) are pre-trained on raw text datasets to generate text sequences token-by-token. While this approach facilitates the learning of world knowledge and reasoning, it does not explicitly optimize for linguistic competence.…

Computation and Language · Computer Science 2026-04-17 Atsuki Yamaguchi , Maggie Mi , Nikolaos Aletras

This work investigates the ability of open Large Language Models (LLMs) to predict citation intent through in-context learning and fine-tuning. Unlike traditional approaches relying on domain-specific pre-trained models like SciBERT, we…

Computation and Language · Computer Science 2025-11-17 Paris Koloveas , Serafeim Chatzopoulos , Thanasis Vergoulis , Christos Tryfonopoulos

With the enhancement in the field of generative artificial intelligence (AI), contextual question answering has become extremely relevant. Attributing model generations to the input source document is essential to ensure trustworthiness and…

Computation and Language · Computer Science 2024-05-29 Anirudh Phukan , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami , Balaji Vasan Srinivasan

This paper exploits the zero-shot capabilities of pre-trained large language models (LLMs) for music genre classification. The proposed approach splits audio signals into 20 ms chunks and processes them through convolutional feature…

We consider the problem of distinguishing human-written creative fiction (excerpts from novels) from similar text generated by an LLM. Our results show that, while human observers perform poorly (near chance levels) on this binary…

Computation and Language · Computer Science 2026-01-13 Minerva Suvanto , Andrea McGlinchey , Mattias Wahde , Peter J Barclay

We propose a novel framework that leverages large language models (LLMs) to guide the rank selection in tensor network models for higher-order data analysis. By utilising the intrinsic reasoning capabilities and domain knowledge of LLMs,…

Machine Learning · Computer Science 2024-10-15 Giorgos Iacovides , Wuyang Zhou , Danilo Mandic