English
Related papers

Related papers: Evaluating Large Language Models' Ability Using a …

200 papers

Sarcasm is hard to interpret as human beings. Being able to interpret sarcasm is often termed as a sign of intelligence, given the complex nature of sarcasm. Hence, this is a field of Natural Language Processing which is still complex for…

Computation and Language · Computer Science 2024-12-03 Harleen Kaur Bagga , Jasmine Bernard , Sahil Shaheen , Sarthak Arora

Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment…

Computation and Language · Computer Science 2023-09-29 Aniket Kumar Singh , Suman Devkota , Bishal Lamichhane , Uttam Dhakal , Chandra Dhakal

The Abstraction Reasoning Corpus (ARC) is a visual analogical reasoning test designed for humans and machines (Chollet, 2019). We compared human and large language model (LLM) performance on a new child-friendly set of ARC items. Results…

Computation and Language · Computer Science 2024-05-14 Gustaw Opiełka , Hannes Rosenbusch , Veerle Vijverberg , Claire E. Stevenson

While recent advancements in large language models (LLMs) bring us closer to achieving artificial general intelligence, the question persists: Do LLMs truly understand language, or do they merely mimic comprehension through pattern…

Computation and Language · Computer Science 2023-11-15 Houquan Zhou , Yang Hou , Zhenghua Li , Xuebin Wang , Zhefeng Wang , Xinyu Duan , Min Zhang

Automatic Speech Recognition (ASR) has recently shown remarkable progress, but accurately transcribing children's speech remains a significant challenge. Recent developments in Large Language Models (LLMs) have shown promise in improving…

Computation and Language · Computer Science 2025-05-27 Anfeng Xu , Tiantian Feng , So Hyun Kim , Somer Bishop , Catherine Lord , Shrikanth Narayanan

Large language models (LLMs) have been shown to perform well at a variety of syntactic, discourse, and reasoning tasks. While LLMs are increasingly deployed in many forms including conversational agents that interact with humans, we lack a…

Computation and Language · Computer Science 2024-04-02 Minje Choi , Jiaxin Pei , Sagar Kumar , Chang Shu , David Jurgens

Metaphors in natural language are a reflection of fundamental cognitive processes such as analogical reasoning and categorisation, and are deeply rooted in everyday communication. Metaphor understanding is therefore an essential task for…

Computation and Language · Computer Science 2024-03-19 Xiaoyu Tong , Rochelle Choenni , Martha Lewis , Ekaterina Shutova

Can large language models (LLMs) simulate social surveys? To answer this question, we conducted millions of simulations in which LLMs were asked to answer subjective questions. A comparison of different LLM responses with the European…

Computation and Language · Computer Science 2024-10-22 Mingmeng Geng , Sihong He , Roberto Trotta

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

Sarcasm is a specific type of irony which involves discerning what is said from what is meant. Detecting sarcasm depends not only on the literal content of an utterance but also on non-verbal cues such as speaker's tonality, facial…

Machine Learning · Computer Science 2025-10-29 Anisha Saha , Varsha Suresh , Timothy Hospedales , Vera Demberg

While large language models (LLMs) are increasingly being explored for mental health applications, recent studies reveal that they can exhibit stigma toward individuals with psychological conditions. Existing evaluations of this stigma…

Whether large language models (LLMs) process language similarly to humans has been the subject of much theoretical and practical debate. We examine this question through the lens of the production-interpretation distinction found in human…

Computation and Language · Computer Science 2025-06-04 Suet-Ying Lam , Qingcheng Zeng , Jingyi Wu , Rob Voigt

Sarcasm is a sophisticated way of wrapping any immanent truth, mes-sage, or even mockery within a hilarious manner. The advent of communications using social networks has mass-produced new avenues of socialization. It can be further said…

Computation and Language · Computer Science 2021-06-11 Sourav Das , Anup Kumar Kolya

Language models (LMs) are increasingly used to simulate human-like responses in scenarios where accurately mimicking a population's behavior can guide decision-making, such as in developing educational materials and designing public…

Computation and Language · Computer Science 2024-07-23 Joy He-Yueya , Wanjing Anya Ma , Kanishk Gandhi , Benjamin W. Domingue , Emma Brunskill , Noah D. Goodman

Sarcasm is an intricate form of speech, where meaning is conveyed implicitly. Being a convoluted form of expression, detecting sarcasm is an assiduous problem. The difficulty in recognition of sarcasm has many pitfalls, including…

Computation and Language · Computer Science 2020-06-02 Kartikey Pant , Tanvi Dadu

Current large language models (LLMs) have demonstrated emerging capabilities in social intelligence tasks, including implicature resolution and theory-of-mind reasoning, both of which require substantial pragmatic understanding. However,…

Computation and Language · Computer Science 2026-01-13 Kefan Yu , Qingcheng Zeng , Weihao Xuan , Wanxin Li , Jingyi Wu , Rob Voigt

Cross-modal reasoning (CMR), the intricate process of synthesizing and drawing inferences across divergent sensory modalities, is increasingly recognized as a crucial capability in the progression toward more sophisticated and…

Computation and Language · Computer Science 2024-10-01 Shengsheng Qian , Zuyi Zhou , Dizhan Xue , Bing Wang , Changsheng Xu

Large Language Models (LLM) like ChatGPT have significantly advanced in recent years and are now being used by the general public. As more people interact with these systems, improving our understanding of these black box models is crucial,…

Computation and Language · Computer Science 2023-10-10 Nutchanon Yongsatianchot , Parisa Ghanad Torshizi , Stacy Marsella

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi