English
Related papers

Related papers: LLM-based relevance assessment still can't replace…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities across various applications, fundamentally reshaping the landscape of natural language processing (NLP) research. However, recent evaluation frameworks often rely on the…

Computation and Language · Computer Science 2024-07-10 Chenyang Lyu , Minghao Wu , Alham Fikri Aji

Purpose: Artificial intelligence (AI), and in particular large language models (LLMs), are increasingly being explored as tools to support life cycle assessment (LCA). While demonstrations exist across environmental and social domains,…

Computation and Language · Computer Science 2025-10-24 Artur Donaldson , Bharathan Balaji , Cajetan Oriekezie , Manish Kumar , Laure Patouillard

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

Computation and Language · Computer Science 2025-07-15 Xuanxin Wu , Yuki Arase

Large Language Model (LLM) has transformative potential in various domains, including recommender systems (RS). There have been a handful of research that focuses on empowering the RS by LLM. However, previous efforts mainly focus on LLM as…

Information Retrieval · Computer Science 2025-03-11 Qidong Liu , Xiangyu Zhao , Yuhao Wang , Yejing Wang , Zijian Zhang , Yuqi Sun , Xiang Li , Maolin Wang , Pengyue Jia , Chong Chen , Wei Huang , Feng Tian

Large Language Models (LLMs) have become increasingly powerful and ubiquitous, but their stochastic nature poses challenges to the reliability of their outputs. While deterministic settings can improve consistency, they do not guarantee…

Computation and Language · Computer Science 2025-02-19 Kayla Schroeder , Zach Wood-Doughty

With the improving semantic understanding capability of Large Language Models (LLMs), they exhibit a greater awareness and alignment with human values, but this comes at the cost of transparency. Although promising results are achieved via…

Computation and Language · Computer Science 2026-05-27 Nafis Tanveer Islam , Zhiming Zhao

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Evaluation is fundamental in optimizing search experiences and supporting diverse user intents in Information Retrieval (IR). Traditional search evaluation methods primarily rely on relevance labels, which assess how well retrieved…

Information Retrieval · Computer Science 2025-05-09 Mouly Dewan , Jiqun Liu , Aditya Gautam , Chirag Shah

Large language models have recently been proposed as tools for automated essay scoring, but their agreement with human grading remains unclear. In this work, we evaluate how LLM-generated scores compare with human grades and analyze the…

Artificial Intelligence · Computer Science 2026-03-26 Jerin George Mathew , Sumayya Taher , Anindita Kundu , Denilson Barbosa

As humans, we consistently interact with our peers and receive feedback in the form of natural language. This language feedback allows us to maintain appropriate behavior, and rectify potential errors. The question arises naturally: can we…

Computation and Language · Computer Science 2024-06-07 Weiwen Xu , Deng Cai , Zhisong Zhang , Wai Lam , Shuming Shi

Large Language Models (LLMs) have transformed artificial intelligence by excelling in complex natural language processing tasks. Their ability to generate human-like text has opened new possibilities for market research, particularly in…

Artificial Intelligence · Computer Science 2026-04-20 Mengxin Wang , Dennis J. Zhang , Heng Zhang

Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain. However, recent disputes over GPT-4's law evaluation raise questions concerning their performance in real-world legal…

Computation and Language · Computer Science 2023-10-19 Ruihao Shui , Yixin Cao , Xiang Wang , Tat-Seng Chua

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Large language models (LLMs) are increasingly used to support question answering and decision-making in high-stakes, domain-specific settings such as natural hazard response and infrastructure planning, where effective answers must convey…

Computation and Language · Computer Science 2026-02-11 Homaira Huda Shomee , Rochana Chaturvedi , Yangxinyu Xie , Tanwi Mallick

This paper argues that large language model-based recommenders can displace today's attention-allocation machinery. LLM-based recommenders would ingest open-web content, infer a user's natural-language goals, and present information that…

Computers and Society · Computer Science 2025-07-03 Seth Lazar , Luke Thorburn , Tian Jin , Luca Belli

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

This study deeply explores the application of large language model (LLM) in personalized recommendation system of e-commerce. Aiming at the limitations of traditional recommendation algorithms in processing large-scale and multi-dimensional…

Information Retrieval · Computer Science 2024-10-18 Wei Xu , Jue Xiao , Jianlong Chen

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

Computation and Language · Computer Science 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing