English
Related papers

Related papers: Word Definitions from Large Language Models

200 papers

The proliferation of NLP-powered language technologies, AI-based natural language generation models, and English as a mainstream means of communication among both native and non-native speakers make the output of AI-powered tools especially…

Computation and Language · Computer Science 2025-02-07 Karolina Rudnicka

Existing works have studied the impacts of the order of words within natural text. They usually analyze it by destroying the original order of words to create a scrambled sequence, and then comparing the models' performance between the…

Computation and Language · Computer Science 2024-03-19 Qinghua Zhao , Jiaang Li , Lei Li , Zenghui Zhou , Junfeng Liu

ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of…

Computation and Language · Computer Science 2023-09-20 Yucheng Shi , Hehuan Ma , Wenliang Zhong , Qiaoyu Tan , Gengchen Mai , Xiang Li , Tianming Liu , Junzhou Huang

Neural network based models are a very powerful tool for creating word embeddings, the objective of these models is to group similar words together. These embeddings have been used as features to improve results in various applications such…

Computation and Language · Computer Science 2016-11-27 Salman Mahmood , Rami Al-Rfou , Klaus Mueller

Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computational semantics community. We propose to focus on relating…

Computation and Language · Computer Science 2022-05-30 Timothee Mickus , Kees van Deemter , Mathieu Constant , Denis Paperno

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Word embeddings and language models have transformed natural language processing (NLP) by facilitating the representation of linguistic elements in continuous vector spaces. This review visits foundational concepts such as the…

Deep transformer models have pushed performance on NLP tasks to new limits, suggesting sophisticated treatment of complex linguistic inputs, such as phrases. However, we have limited understanding of how these models handle representation…

Computation and Language · Computer Science 2020-10-15 Lang Yu , Allyson Ettinger

Dictionaries are inherently circular in nature. A given word is linked to a set of alternative words (the definition) which in turn point to further descendants. Iterating through definitions in this way, one typically finds that…

Computation and Language · Computer Science 2011-03-14 David Levary , Jean-Pierre Eckmann , Elisha Moses , Tsvi Tlusty

The words of a language reflect the structure of the human mind, allowing us to transmit thoughts between individuals. However, language can represent only a subset of our rich and detailed cognitive architecture. Here, we ask what kinds of…

Computation and Language · Computer Science 2018-03-07 Gabriel Grand , Idan Asher Blank , Francisco Pereira , Evelina Fedorenko

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

Computation and Language · Computer Science 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

Are the predictions of humans and language models affected by similar things? Research suggests that while comprehending language, humans make predictions about upcoming words, with more predictable words being processed more easily.…

Computation and Language · Computer Science 2022-11-11 James A. Michaelov , Benjamin K. Bergen

Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that position embeddings capture the position of individual words,…

Computation and Language · Computer Science 2020-06-30 Benyou Wang , Donghao Zhao , Christina Lioma , Qiuchi Li , Peng Zhang , Jakob Grue Simonsen

Work done to uncover the knowledge encoded within pre-trained language models rely on annotated corpora or human-in-the-loop methods. However, these approaches are limited in terms of scalability and the scope of interpretation. We propose…

Computation and Language · Computer Science 2023-10-23 Basel Mousi , Nadir Durrani , Fahim Dalvi

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

Computation and Language · Computer Science 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

We use contextualized word definitions generated by large language models as semantic representations in the task of diachronic lexical semantic change detection (LSCD). In short, generated definitions are used as `senses', and the change…

Computation and Language · Computer Science 2024-08-01 Mariia Fedorova , Andrey Kutuzov , Yves Scherrer

Recent progress in pretraining language models on large corpora has resulted in large performance gains on many NLP tasks. These large models acquire linguistic knowledge during pretraining, which helps to improve performance on downstream…

Computation and Language · Computer Science 2021-02-09 Lutfi Kerem Senel , Hinrich Schütze

The introduction of ChatGPT has put Artificial Intelligence (AI) Natural Language Processing (NLP) in the spotlight. ChatGPT adoption has been exponential with millions of users experimenting with it in a myriad of tasks and application…

Computation and Language · Computer Science 2023-10-02 Gonzalo Martínez , Javier Conde , Pedro Reviriego , Elena Merino-Gómez , José Alberto Hernández , Fabrizio Lombardi

Large-scale language models, like ChatGPT, have garnered significant media attention and stunned the public with their remarkable capacity for generating coherent text from short natural language prompts. In this paper, we aim to conduct a…

Computation and Language · Computer Science 2024-12-11 Dongqi Liu , Vera Demberg

As Large Language Models (LLMs) are increasingly being used in scientific research, the issue of their trustworthiness becomes crucial. In psycholinguistics, LLMs have been recently employed in automatically augmenting human-rated datasets,…

Computation and Language · Computer Science 2025-12-16 Veronica Mangiaterra , Hamad Al-Azary , Chiara Barattieri di San Pietro , Paolo Canal , Valentina Bambini