English
Related papers

Related papers: Evaluating ChatGPT as a Recommender System: A Rigo…

200 papers

Online news platforms commonly employ personalized news recommendation methods to assist users in discovering interesting articles, and many previous works have utilized language model techniques to capture user interests and understand…

Information Retrieval · Computer Science 2023-06-21 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

Recently large language models (LLMs) like ChatGPT have shown impressive performance on many natural language processing tasks with zero-shot. In this paper, we investigate the effectiveness of zero-shot LLMs in the financial domain. We…

Computation and Language · Computer Science 2023-05-29 Agam Shah , Sudheer Chava

When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper,…

The remarkable achievements of Large Language Models (LLMs) have led to the emergence of a novel recommendation paradigm -- Recommendation via LLM (RecLLM). Nevertheless, it is important to note that LLMs may contain social prejudices, and…

Information Retrieval · Computer Science 2023-10-18 Jizhi Zhang , Keqin Bao , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these…

Computation and Language · Computer Science 2024-03-26 Yida Mu , Ben P. Wu , William Thorne , Ambrose Robinson , Nikolaos Aletras , Carolina Scarton , Kalina Bontcheva , Xingyi Song

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

The integration of Large Language Models into recommendation frameworks presents key advantages for personalization and adaptability of experiences to the users. Classic methods of recommendations, such as collaborative filtering and…

Information Retrieval · Computer Science 2025-01-20 Peiyang Yu , Zeqiu Xu , Jiani Wang , Xiaochuan Xu

Large Language Models (LLMs) have exhibited remarkable performance on various Natural Language Processing (NLP) tasks. However, there is a current hot debate regarding their reasoning capacity. In this paper, we examine the performance of…

Computation and Language · Computer Science 2023-09-21 Jessica López Espejel , El Hassane Ettifouri , Mahaman Sanoussi Yahaya Alassan , El Mehdi Chouham , Walid Dahhane

Large language models (LLMs) have demonstrated exceptional performance across various linguistic tasks. However, it remains uncertain whether LLMs have developed human-like fine-grained grammatical intuition. This preregistered study…

Computation and Language · Computer Science 2024-06-18 Zhuang Qiu , Xufeng Duan , Zhenguang G. Cai

Large Language Models (LLMs) have been gaining increasing attention and demonstrated promising performance across a variety of Software Engineering (SE) tasks, such as Automated Program Repair (APR), code summarization, and code completion.…

Software Engineering · Computer Science 2024-04-18 Quanjun Zhang , Tongke Zhang , Juan Zhai , Chunrong Fang , Bowen Yu , Weisong Sun , Zhenyu Chen

In this paper, we present empirical studies on conversational recommendation tasks using representative large language models in a zero-shot setting with three primary contributions. (1) Data: To gain insights into model behavior in…

Information Retrieval · Computer Science 2023-08-22 Zhankui He , Zhouhang Xie , Rahul Jha , Harald Steck , Dawen Liang , Yesu Feng , Bodhisattwa Prasad Majumder , Nathan Kallus , Julian McAuley

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Narrative-driven recommenders aim to provide personalized suggestions for user requests expressed in free-form text such as "I want to watch a thriller with a mind-bending story, like Shutter Island." Although large language models (LLMs)…

Information Retrieval · Computer Science 2024-10-18 Lukas Eberhard , Thorsten Ruprechter , Denis Helic

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Large Language Models (LLMs) have achieved remarkable success recently, displaying exceptional capabilities in creating understandable and organized text. These LLMs have been utilized in diverse fields, such as clinical research, where…

Statistical Finance · Quantitative Finance 2025-01-17 Shuoling Liu , Gaoguo Jia , Yuhang Jiang , Liyuan Chen , Qiang Yang

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

This paper explores the biases in ChatGPT-based recommender systems, focusing on provider fairness (item-side fairness). Through extensive experiments and over a thousand API calls, we investigate the impact of prompt design…

Information Retrieval · Computer Science 2024-07-08 Yashar Deldjoo

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in…

Information Retrieval · Computer Science 2025-10-06 Rahul Raja , Anshaj Vats , Arpita Vats , Anirban Majumder

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations…

As a natural language assistant, ChatGPT is capable of performing various tasks, including but not limited to article generation, code completion, and data analysis. Furthermore, ChatGPT has consistently demonstrated a remarkable level of…

Computation and Language · Computer Science 2023-03-15 Yunjie Ji , Yan Gong , Yiping Peng , Chao Ni , Peiyan Sun , Dongyu Pan , Baochang Ma , Xiangang Li