English
Related papers

Related papers: Aligning Large Language Model Behavior with Human …

200 papers

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach,…

In this work, we research user preferences to see a chart, table, or text given a question asked by the user. This enables us to understand when it is best to show a chart, table, or text to the user for the specific question. For this, we…

Human-Computer Interaction · Computer Science 2024-11-13 Reuben Luera , Ryan Rossi , Franck Dernoncourt , Alexa Siu , Sungchul Kim , Tong Yu , Ruiyi Zhang , Xiang Chen , Nedim Lipka , Zhehao Zhang , Seon Gyeom Kim , Tak Yeon Lee

Large language models (LLMs) exhibit systematic preferences for well-known entities, a phenomenon often attributed to popularity bias. However, the extent to which these preferences reflect real-world popularity versus statistical exposure…

Computation and Language · Computer Science 2026-05-13 Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Assessing the quality of scientific research is essential for scholarly communication, yet widely used approaches face limitations in scalability, subjectivity, and time delay. Recent advances in large language models (LLMs) offer new…

Information Retrieval · Computer Science 2026-04-21 Mengjia Wu , Yi Zhang , Robin Haunschild , Lutz Bornmann

Traditional recommender systems leverage users' item preference history to recommend novel content that users may like. However, modern dialog interfaces that allow users to express language-based preferences offer a fundamentally different…

Information Retrieval · Computer Science 2023-07-27 Scott Sanner , Krisztian Balog , Filip Radlinski , Ben Wedin , Lucas Dixon

Large Language Models (LLMs) are known to overuse certain terms like "delve" and "intricate." The exact reasons for these lexical choices, however, have been unclear. Using Meta's Llama model, this study investigates the contribution of…

Computation and Language · Computer Science 2025-08-05 Tom S. Juzek , Zina B. Ward

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

Computation and Language · Computer Science 2024-06-18 Filip Trhlik , Pontus Stenetorp

Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research…

Computation and Language · Computer Science 2024-06-18 Yijiang River Dong , Tiancheng Hu , Nigel Collier

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

While textual frequency has been validated as relevant to human cognition in reading speed, its relatedness to Large Language Models (LLMs) is seldom studied. We propose a novel research direction in terms of textual data frequency, which…

Computation and Language · Computer Science 2026-04-08 Hongyuan Adam Lu , Z. L. , Victor Wei , Zefan Zhang , Zhao Hong , Qiqi Xiang , Bowen Cao , Wai Lam

Recent studies have shown that prompting can enable large language models (LLMs) to simulate specific personality traits and produce behaviors that align with those traits. However, there is limited understanding of how these simulated…

Computation and Language · Computer Science 2026-01-06 Nuo Chen , Hanpei Fang , Piaohong Wang , Jiqun Liu , Tetsuya Sakai , Xiao-Ming Wu

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Large Language Models (LLMs) are becoming increasingly persuasive, demonstrating the ability to personalize arguments in conversation with humans by leveraging their personal data. This may have serious impacts on the scale and…

Computation and Language · Computer Science 2025-01-30 Jasper Timm , Chetan Talele , Jacob Haimes

Citation analysis is one of the most frequently used methods in research evaluation. We are seeing significant growth in citation analysis through bibliometric metadata, primarily due to the availability of citation databases such as the…

Digital Libraries · Computer Science 2020-09-01 Sehrish Iqbal , Saeed-Ul Hassan , Naif Radi Aljohani , Salem Alelyani , Raheel Nawaz , Lutz Bornmann

Citation counts remain the dominant metric for assessing research impact, yet they suffer from well-documented limitations: temporal lag, disciplinary bias, and Matthew effects. Here we propose LLM-Metrics, a research-impact assessment…

Artificial Intelligence · Computer Science 2026-05-22 Si Shen , Wenhua Zhao , Danhao Zhu

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

The paper explores stylometry as a method to distinguish between texts created by Large Language Models (LLMs) and humans, addressing issues of model attribution, intellectual property, and ethical AI use. Stylometry has been used…

Computation and Language · Computer Science 2025-07-25 Karol Przystalski , Jan K. Argasiński , Iwona Grabska-Gradzińska , Jeremi K. Ochab

The emergence of Large Language Models (LLMs) demonstrates their potential to encapsulate the logic and patterns inherent in human behavior simulation by leveraging extensive web data pre-training. However, the boundaries of LLM…

Physics and Society · Physics 2025-11-19 Jiarui Ji , Runlin Lei , Xuchen Pan , Zhewei Wei , Hao Sun , Yankai Lin , Xu Chen , Yongzheng Yang , Yaliang Li , Bolin Ding , Ji-Rong Wen

Although LLM context lengths have grown, there is evidence that their ability to integrate information across long-form texts has not kept pace. We evaluate one such understanding task: generating summaries of novels. When human authors of…

Computation and Language · Computer Science 2026-04-09 Rebecca M. M. Hicke , Sil Hamilton , David Mimno , Ross Deans Kristensen-McLachlan