中文
相关论文

相关论文: The Challenges of Evaluating LLM Applications: An …

200 篇论文

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

计算与语言 · 计算机科学 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

The past few decades have witnessed an upsurge in data, forming the foundation for data-hungry, learning-based AI technology. Conversational agents, often referred to as AI chatbots, rely heavily on such data to train large language models…

计算与语言 · 计算机科学 2024-11-19 Sumit Kumar Dam , Choong Seon Hong , Yu Qiao , Chaoning Zhang

There have been many recent advances in the fields of generative Artificial Intelligence (AI) and Large Language Models (LLM), with the Generative Pre-trained Transformer (GPT) model being a leading "chatbot." LLM-based chatbots have become…

计算与语言 · 计算机科学 2024-08-12 Gauri Anil Godghase , Rishit Agrawal , Tanush Obili , Mark Stamp

Large Language Models (LLMs) have showcased remarkable capabilities in various Natural Language Processing tasks. For automatic open-domain dialogue evaluation in particular, LLMs have been seamlessly integrated into evaluation frameworks,…

计算与语言 · 计算机科学 2024-07-08 John Mendonça , Alon Lavie , Isabel Trancoso

The advent of large language models (LLMs), such as GPT, Gemini, and DeepSeek, has significantly advanced natural language processing, giving rise to sophisticated chatbots capable of diverse language-related tasks. The transition from…

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…

A chatbot's personality design is key to interaction quality. As chatbots evolved from rule-based systems to those powered by large language models (LLMs), evaluating the effectiveness of their personality design has become increasingly…

人机交互 · 计算机科学 2025-08-11 Huiqi Zou , Pengda Wang , Zihan Yan , Tianjun Sun , Ziang Xiao

Large language models (LLMs) have transformed natural language processing, with frameworks like Chatbot Arena providing pioneering platforms for evaluating these models. By facilitating millions of pairwise comparisons based on human…

机器学习 · 统计学 2025-06-02 Siavash Ameli , Siyuan Zhuang , Ion Stoica , Michael W. Mahoney

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

计算机与社会 · 计算机科学 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

人机交互 · 计算机科学 2025-03-04 Si Thu , A. Baki Kocaballi

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

计算与语言 · 计算机科学 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

With the advancement of large language models (LLMs), the focus in Conversational AI has shifted from merely generating coherent and relevant responses to tackling more complex challenges, such as personalizing dialogue systems. In an…

计算与语言 · 计算机科学 2025-02-13 Maria Molchanova , Anna Mikhailova , Anna Korzanova , Lidiia Ostyakova , Alexandra Dolidze

AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and…

人机交互 · 计算机科学 2025-05-14 He Zhang , Chuhao Wu , Jingyi Xie , Yao Lyu , Jie Cai , John M. Carroll

In the rapidly evolving domain of artificial intelligence, chatbots have emerged as a potent tool for various applications ranging from e-commerce to healthcare. This research delves into the intricacies of chatbot technology, from its…

人机交互 · 计算机科学 2023-11-17 Feriel Khennouche , Youssef Elmir , Nabil Djebari , Yassine Himeur , Abbes Amira

Tool-augmented LLMs are a promising approach to create AI agents that can have realistic conversations, follow procedures, and call appropriate functions. However, evaluating them is challenging due to the diversity of possible…

计算与语言 · 计算机科学 2024-10-11 Samuel Arcadinho , David Aparicio , Mariana Almeida

The advancement of Large Language Models (LLMs) has led to significant enhancements in the performance of chatbot systems. Many researchers have dedicated their efforts to the development of bringing characteristics to chatbots. While there…

计算与语言 · 计算机科学 2024-03-20 Xi Wang , Hongliang Dai , Shen Gao , Piji Li

Conversation with chatbots based on Large Language Models (LLMs) such as ChatGPT has become one of the major forms of interaction with Artificial Intelligence (AI) in everyday life. What makes this interaction so convenient is that…

人机交互 · 计算机科学 2026-03-18 Sarah Diefenbach , Daniel Ullrich

Large Language Models (LLMs) have unlocked new capabilities and applications; however, evaluating the alignment with human preferences still poses significant challenges. To address this issue, we introduce Chatbot Arena, an open platform…

Personalized support is essential to fulfill individuals' emotional needs and sustain their mental well-being. Large language models (LLMs), with great customization flexibility, hold promises to enable individuals to create their own…

人机交互 · 计算机科学 2025-05-01 Xi Zheng , Zhuoyang Li , Xinning Gui , Yuhan Luo
‹ 上一页 1 2 3 10 下一页 ›