中文
相关论文

相关论文: Comparing Human and AI Rater Effects Using the Man…

200 篇论文

In this paper, we explore how large language models (LLMs) approach financial decision-making by systematically comparing their responses to those of human participants across the globe. We posed a set of commonly used financial…

综合经济学 · 经济学 2025-07-16 Orhan Erdem , Ragavi Pobbathi Ashok

Public leaderboards increasingly suggest that large language models (LLMs) surpass human experts on benchmarks spanning academic knowledge, law, and programming. Yet most benchmarks are fully public, their questions widely mirrored across…

人工智能 · 计算机科学 2026-03-18 Eshwar Reddy M , Sourav Karmakar

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

计算与语言 · 计算机科学 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

Large Language Models(LLMs) have demonstrated remarkable performance across various natural language processing tasks; however, how to comprehensively and accurately assess their performance becomes an urgent issue to be addressed. This…

计算与语言 · 计算机科学 2024-02-27 Xiaotian Zhang , Chunyang Li , Yi Zong , Zhengyu Ying , Liang He , Xipeng Qiu

Our research investigates the potential of Large-scale Language Models (LLMs), specifically OpenAI's GPT, in credit risk assessment-a binary classification task. Our findings suggest that LLMs, when directed by judiciously designed prompts…

计算与语言 · 计算机科学 2023-07-25 Yashar Deldjoo

Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve…

计算与语言 · 计算机科学 2023-10-24 Andrea Sottana , Bin Liang , Kai Zou , Zheng Yuan

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

计算与语言 · 计算机科学 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Large language models (LLMs) are used by over a billion people globally, most often to assist with writing. In this work, we demonstrate that LLMs not only alter the voice and tone of human writing, but also consistently alter the intended…

计算与语言 · 计算机科学 2026-03-20 Marwa Abdulhai , Isadora White , Yanming Wan , Ibrahim Qureshi , Joel Leibo , Max Kleiman-Weiner , Natasha Jaques

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

计算与语言 · 计算机科学 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large Language Models (LLMs),such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs may even be able to simulate human…

人工智能 · 计算机科学 2025-08-14 Sarah Schröder , Thekla Morgenroth , Ulrike Kuhl , Valerie Vaquet , Benjamin Paaßen

The advent of Large Language Models (LLMs) has revolutionized code completion, transforming it into a more intelligent and context-aware feature in modern integrated development environments. These advancements have significantly enhanced…

软件工程 · 计算机科学 2025-02-24 Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du , Yiyi Tao , Yixian Shen

Recent advancements in AI, particularly in large language models (LLMs) like ChatGPT, Claude, and Gemini, have prompted questions about their proximity to Artificial General Intelligence (AGI). This study compares LLM performance on…

人工智能 · 计算机科学 2024-07-16 Mfon Akpan

Large Language Models (LLMs) such as ChatGPT have received enormous attention over the past year and are now used by hundreds of millions of people every day. The rapid adoption of this technology naturally raises questions about the…

人工智能 · 计算机科学 2024-03-15 Jonathan Shaki , Sarit Kraus , Michael Wooldridge

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

计算与语言 · 计算机科学 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

As Large-Scale Language Models (LLMs) continue to evolve, they demonstrate significant enhancements in performance and an expansion of functionalities, impacting various domains, including education. In this study, we conducted interviews…

人机交互 · 计算机科学 2024-07-18 He Zhang , Jingyi Xie , Chuhao Wu , Jie Cai , ChanMin Kim , John M. Carroll

Large language models (LLMs) offer the potential to simulate human-like responses and behaviors, creating new opportunities for psychological science. In the context of self-regulated learning (SRL), if LLMs can reliably simulate survey…

The rapid development of Large Language Models (LLMs) opens up the possibility of using them as personal tutors. This has led to the development of several intelligent tutoring systems and learning assistants that use LLMs as back-ends with…

新兴技术 · 计算机科学 2025-06-11 Sankalan Pal Chowdhury , Terry Jingchen Zhang , Donya Rooein , Dirk Hovy , Tanja Käser , Mrinmaya Sachan

Large language models (LLMs) are increasingly used in academic peer review, yet their reliability, alignment with human judgment, and robustness to adversarial attacks remain poorly understood. We present a systematic benchmark of…

计算与语言 · 计算机科学 2026-05-26 Lingyao Li , Junjie Xiong , Changjia Zhu , Runlong Yu , Chen Chen , Junyu Wang , Renkai Ma , Zhicong Lu

Large vision-language models (LVLMs) have been regarded as a breakthrough advance in an astoundingly variety of tasks, from content generation to virtual assistants and multimodal search or retrieval. However, for many of these…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Kailash Hambarde , Pranita Samale , Hugo Proença