English
Related papers

Related papers: Measuring and Benchmarking Large Language Models' …

200 papers

The versatility of Large Language Models (LLMs) on natural language understanding tasks has made them popular for research in social sciences. To properly understand the properties and innate personas of LLMs, researchers have performed…

Computation and Language · Computer Science 2024-04-03 Bangzhao Shu , Lechen Zhang , Minje Choi , Lavinia Dunagan , Lajanugen Logeswaran , Moontae Lee , Dallas Card , David Jurgens

This paper presents a method to analyze the inference patterns used by Large Language Models (LLMs) for judgment in a case study on legal LLMs, so as to identify potential incorrect representations of the LLM, according to human domain…

Artificial Intelligence · Computer Science 2025-05-21 Lu Chen , Yuxuan Huang , Yixing Li , Dongrui Liu , Qihan Ren , Shuai Zhao , Kun Kuang , Zilong Zheng , Quanshi Zhang

As large language models take on growing roles as automated evaluators in practical settings, a critical question arises: Can individuals persuade an LLM judge to assign unfairly high scores? This study is the first to reveal that…

Computation and Language · Computer Science 2025-08-12 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Yongil Kim , Kyomin Jung

The impressive linguistic abilities of large language models (LLMs) have recommended them as models of human sentence processing, with some conjecturing a positive 'quality-power' relationship (Wilcox et al., 2023), in which language…

Computation and Language · Computer Science 2025-05-20 Yi-Chien Lin , Hongao Zhu , William Schuler

Large Language Models (LLMs) can generate biased and toxic responses. Yet most prior work on LLM gender bias evaluation requires predefined gender-related phrases or gender stereotypes, which are challenging to be comprehensively collected…

Computation and Language · Computer Science 2023-11-02 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Large Language Models (LLMs) excel in generating personalized content and facilitating interactive dialogues, showcasing their remarkable aptitude for a myriad of applications. However, their capabilities in reasoning and providing…

Computation and Language · Computer Science 2024-02-16 Min Zhang , Sato Takumi , Jack Zhang , Jun Wang

The current fascination with large language models, or LLMs, derives from the fact that many users lack the expertise to evaluate the quality of the generated text. LLMs may therefore appear more capable than they actually are. The…

Computation and Language · Computer Science 2024-03-15 Eliza Mik

Large language models can now generate political messages as persuasive as those written by humans, raising concerns about how far this persuasiveness may continue to increase with model size. Here, we generate 720 persuasive messages on 10…

Computation and Language · Computer Science 2024-06-21 Kobi Hackenburg , Ben M. Tappin , Paul Röttger , Scott Hale , Jonathan Bright , Helen Margetts

As Large Vision-Language Models (LVLMs) are increasingly deployed in domains such as shopping, health, and news, they are exposed to pervasive persuasive content. A critical question is how these models function as persuadees-how and why…

Computation and Language · Computer Science 2025-10-28 Haoyi Qiu , Yilun Zhou , Pranav Narayanan Venkit , Kung-Hsiang Huang , Jiaxin Zhang , Nanyun Peng , Chien-Sheng Wu

Large Language Models (LLMs) have significantly impacted nearly every domain of human knowledge. However, the explainability of these models esp. to laypersons, which are crucial for instilling trust, have been examined through various…

Human-Computer Interaction · Computer Science 2024-12-12 Arion Das , Asutosh Mishra , Amitesh Patel , Soumilya De , V. Gurucharan , Kripabandhu Ghosh

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

Computation and Language · Computer Science 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

This paper explores the effectiveness of using large language models (LLMs) for personalized movie recommendations from users' perspectives in an online field experiment. Our study involves a combination of between-subject prompt and…

Information Retrieval · Computer Science 2024-05-01 Ruixuan Sun , Xinyi Li , Avinash Akella , Joseph A. Konstan

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. More recently, they have been shown to be very effective in textual…

Computation and Language · Computer Science 2025-10-07 Nelvin Tan , James Asikin Cheung , Yu-Ching Shih , Dong Yang , Amol Salunkhe

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

Computation and Language · Computer Science 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

Computation and Language · Computer Science 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

The language generation and reasoning capabilities of large language models (LLMs) have enabled conversational systems with impressive performance in a variety of tasks, from code generation, to composing essays, to passing STEM and legal…

Artificial Intelligence · Computer Science 2025-02-28 Konstantina Christakopoulou , Iris Qu , John Canny , Andrew Goodridge , Cj Adams , Minmin Chen , Maja Matarić