中文
相关论文

相关论文: Evaluating Large Language Models for Document-grou…

200 篇论文

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction. These powerful tools can answer complex questions and, surprisingly, perform…

人工智能 · 计算机科学 2023-11-14 Pier Luca Lanzi , Daniele Loiacono

Collecting data for training dialog systems can be extremely expensive due to the involvement of human participants and need for extensive annotation. Especially in document-grounded dialog systems, human experts need to carefully read the…

计算与语言 · 计算机科学 2021-12-16 Qingyang Wu , Song Feng , Derek Chen , Sachindra Joshi , Luis A. Lastras , Zhou Yu

Large Language Models (LLMs) such as ChatGPT demonstrated the potential to replicate human language abilities through technology, ranging from text generation to engaging in conversations. However, it remains controversial to what extent…

计算与语言 · 计算机科学 2025-07-09 Martin Schuele

What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large…

计算与语言 · 计算机科学 2025-09-03 Katharine Kowalyshyn , Matthias Scheutz

Large Language Model (LLM) assistants, such as ChatGPT, have emerged as potential alternatives to search methods for helping users navigate complex, feature-rich software. LLMs use vast training data from domain-specific texts, software…

人机交互 · 计算机科学 2024-02-14 Anjali Khurana , Hari Subramonyam , Parmit K Chilana

Timely and accurate situational reports are essential for humanitarian decision-making, yet current workflows remain largely manual, resource intensive, and inconsistent. We present a fully automated framework that uses large language…

计算与语言 · 计算机科学 2025-12-23 Ivan Decostanzi , Yelena Mejova , Kyriaki Kalimeri

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

人工智能 · 计算机科学 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

There is an increasing interest in developing LLMs for medical diagnosis to improve diagnosis efficiency. Despite their alluring technological potential, there is no unified and comprehensive evaluation criterion, leading to the inability…

计算与语言 · 计算机科学 2023-08-16 Xiaoming Shi , Jie Xu , Jinru Ding , Jiali Pang , Sichen Liu , Shuqing Luo , Xingwei Peng , Lu Lu , Haihong Yang , Mingtao Hu , Tong Ruan , Shaoting Zhang

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

The use of large language models (LLMs) in scholarly publications has grown dramatically since the launch of ChatGPT in late 2022. This usage is often undisclosed, and it can be challenging for readers and reviewers to identify human…

数字图书馆 · 计算机科学 2025-12-02 Andrew Gray

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

人工智能 · 计算机科学 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients…

计算与语言 · 计算机科学 2023-09-28 June M. Liu , Donghao Li , He Cao , Tianhe Ren , Zeyi Liao , Jiamin Wu

This paper introduces DevGPT, a dataset curated to explore how software developers interact with ChatGPT, a prominent large language model (LLM). The dataset encompasses 29,778 prompts and responses from ChatGPT, including 19,106 code…

软件工程 · 计算机科学 2024-02-15 Tao Xiao , Christoph Treude , Hideaki Hata , Kenichi Matsumoto

While recent advancements in the capabilities and widespread accessibility of generative language models, such as ChatGPT (OpenAI, 2022), have brought about various benefits by generating fluent human-like text, the task of distinguishing…

计算与语言 · 计算机科学 2023-09-15 Mahdi Dhaini , Wessel Poelman , Ege Erdogan

This paper provides preliminary results on exploring the task of performing turn-level data augmentation for dialogue system based on different types of commonsense relationships, and the automatic evaluation of the generated synthetic…

计算与语言 · 计算机科学 2025-06-25 Marcos Estecha-Garitagoitia , Chen Zhang , Mario Rodríguez-Cantelar , Luis Fernando D'Haro

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

软件工程 · 计算机科学 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

Large Language Models are now key assistants in human decision-making processes. However, a common note always seems to follow: "LLMs can make mistakes. Be careful with important info." This points to the reality that not all outputs from…

计算与语言 · 计算机科学 2025-05-16 Longchao Da , Parth Mitesh Shah , Kuan-Ru Liou , Jiaxing Zhang , Hua Wei

Scientific research heavily depends on suitable datasets for method validation, but existing academic platforms with dataset management like PapersWithCode suffer from inefficiencies in their manual workflow. To overcome this bottleneck, we…

数据库 · 计算机科学 2025-05-29 Anjie Xu , Ruiqing Ding , Leye Wang

ChatGPT is a large language model (LLM) created by OpenAI that has been carefully trained on a large amount of data. It has revolutionized the field of natural language processing (NLP) and has pushed the boundaries of LLM capabilities.…

计算与语言 · 计算机科学 2023-07-18 Salman Mohamadi , Ghulam Mujtaba , Ngan Le , Gianfranco Doretto , Donald A. Adjeroh

In this paper, we study how to improve the zero-shot reasoning ability of large language models~(LLMs) over structured data in a unified way. Inspired by the study on tool augmentation for LLMs, we develop an \emph{Iterative…

计算与语言 · 计算机科学 2023-10-24 Jinhao Jiang , Kun Zhou , Zican Dong , Keming Ye , Wayne Xin Zhao , Ji-Rong Wen