中文
相关论文

相关论文: Evaluating Large Language Models for Document-grou…

200 篇论文

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

计算与语言 · 计算机科学 2025-10-14 Dana Sotto Porat , Ella Rabinovich

Dialogue systems controlled by predefined or rule-based scenarios derived from counseling techniques, such as cognitive behavioral therapy (CBT), play an important role in mental health apps. Despite the need for responsible responses, it…

Large language models (LLMs) such as ChatGPT and GPT-4 have demonstrated impressive capabilities in various generative tasks. However, their performance is often hampered by limitations in accessing and leveraging long-term memory, leading…

人工智能 · 计算机科学 2024-07-16 Zhongsheng Wang , Jiamou Liu , Qiming Bao , Hongfei Rong , Jingfeng Zhang

We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the…

计算与语言 · 计算机科学 2023-11-23 Inderjeet Nair , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami

In recent times, the grandeur of Large Language Models (LLMs) has not only shone in the realm of natural language processing but has also cast its brilliance across a vast array of applications. This remarkable display of LLM capabilities…

计算与语言 · 计算机科学 2024-03-22 Hanieh Alipour , Nick Pendar , Kohinoor Roy

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

计算与语言 · 计算机科学 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive…

计算与语言 · 计算机科学 2024-10-08 Yun Long , Haifeng Luo , Yu Zhang

Complementing natural language (NL) requirements with graphical models can improve stakeholders' communication and provide directions for system design. However, creating models from requirements involves manual effort. The advent of…

软件工程 · 计算机科学 2024-07-02 Alessio Ferrari , Sallam Abualhaija , Chetan Arora

Over the last few years, large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) that fundamentally transform research and developments in the field. ChatGPT represents one of the…

Mental health disorders impose a substantial global socioeconomic burden. While large language models (LLMs) offer 24/7, non-judgmental interactions to address this gap, pretrained models lack contextual coherence and emotional alignment…

计算与语言 · 计算机科学 2026-02-17 Eric Hua Qing Zhang , Julia Ive

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

计算与语言 · 计算机科学 2025-09-15 Jing Ren , Weiqi Wang

This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition. We present three different approaches to predicting turn-level qualities of chatbot responses based on large language models (LLMs). We…

计算与语言 · 计算机科学 2023-08-15 Ondřej Plátek , Vojtěch Hudeček , Patricia Schmidtová , Mateusz Lango , Ondřej Dušek

In the era of generative AI and specifically large language models (LLMs), exemplified by ChatGPT, the intersection of artificial intelligence and human reasoning has become a focal point of global attention. Unlike conventional search…

计算机与社会 · 计算机科学 2023-11-13 Niina Zuber , Jan Gogoll

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

信息检索 · 计算机科学 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

Large Language Models (LLMs) are advanced Artificial Intelligence (AI) systems that have undergone extensive training using large datasets in order to understand and produce language that closely resembles that of humans. These models have…

软件工程 · 计算机科学 2023-08-10 Alessio Buscemi

Effective conversation requires common ground: a shared understanding between the participants. Common ground, however, does not emerge spontaneously in conversation. Speakers and listeners work together to both identify and construct a…

计算与语言 · 计算机科学 2024-04-04 Omar Shaikh , Kristina Gligorić , Ashna Khetan , Matthias Gerstgrasser , Diyi Yang , Dan Jurafsky

Large language models (LLMs) have recently soared in popularity due to their ease of access and the unprecedented ability to synthesize text responses to diverse user questions. However, LLMs like ChatGPT present significant limitations in…

人机交互 · 计算机科学 2023-08-08 Peiling Jiang , Jude Rayan , Steven P. Dow , Haijun Xia

Interacting with human via high-quality multi-turn dialogues is a key feature of large language models (LLMs). However, human-based evaluation of such capability involves intensive manual labor. This report provides a preliminary evaluation…

计算与语言 · 计算机科学 2023-10-23 Haodong Duan , Jueqi Wei , Chonghua Wang , Hongwei Liu , Yixiao Fang , Songyang Zhang , Dahua Lin , Kai Chen

The performance of conversational Large Language Models (LLMs) in general, and of ChatGPT in particular, is currently being evaluated on many different tasks, from logical reasoning or maths to answering questions on a myriad of topics.…

计算与语言 · 计算机科学 2024-10-22 Gonzalo Martínez , José Alberto Hernández , Javier Conde , Pedro Reviriego , Elena Merino

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

机器人学 · 计算机科学 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter