English
Related papers

Related papers: LMSYS-Chat-1M: A Large-Scale Real-World LLM Conver…

200 papers

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

Large language models (LLMs) have advanced virtual educators and learners, bridging NLP with AI4Education. Existing work often lacks scalability and fails to leverage diverse, large-scale course content, with limited frameworks for…

Artificial Intelligence · Computer Science 2025-09-08 Jiahuan Pei , Fanghua Ye , Xin Sun , Wentao Deng , Koen Hindriks , Junxiao Wang

Aligning large language models (LLMs) with human preferences has proven to drastically improve usability and has driven rapid adoption as demonstrated by ChatGPT. Alignment techniques such as supervised fine-tuning (SFT) and reinforcement…

The development of chatbots requires collecting a large number of human-chatbot dialogues to reflect the breadth of users' sociodemographic backgrounds and conversational goals. However, the resource requirements to conduct the respective…

Computation and Language · Computer Science 2024-10-15 Hovhannes Tamoyan , Hendrik Schuff , Iryna Gurevych

As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, existing benchmarks primarily focus on casual conversation or…

Computation and Language · Computer Science 2026-01-13 Haonan Bian , Zhiyuan Yao , Sen Hu , Zishan Xu , Shaolei Zhang , Yifu Guo , Ziliang Yang , Xueran Han , Huacan Wang , Ronghao Chen

People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence suggests that…

Human-Computer Interaction · Computer Science 2025-05-12 Inhwa Song , Sachin R. Pendse , Neha Kumar , Munmun De Choudhury

Recent advances in large language models (LLMs) have shown promise for scalable educational applications, but their use in dialog-based tutoring systems remains challenging due to the need for effective pedagogical strategies and the high…

Computation and Language · Computer Science 2024-10-28 Menna Fateen , Tsunenori Mine

Large language models (LLMs) have demonstrated impressive capabilities in mathematical problem solving, particularly in single turn question answering formats. However, real world scenarios often involve mathematical question answering that…

Artificial Intelligence · Computer Science 2024-05-31 Zhenwen Liang , Dian Yu , Wenhao Yu , Wenlin Yao , Zhihan Zhang , Xiangliang Zhang , Dong Yu

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

Ensuring the safety and compliance of large language models (LLMs) is of paramount importance. However, existing LLM safety datasets often rely on ad-hoc taxonomies for data generation and suffer from a significant shortage of…

Computation and Language · Computer Science 2026-04-17 Wenbin Hu , Huihao Jing , Haochen Shi , Changxuan Fan , Haoran Li , Yangqiu Song

Multi-modal large language models have garnered significant interest recently. Though, most of the works focus on vision-language multi-modal models providing strong capabilities in following vision-and-language instructions. However, we…

Computation and Language · Computer Science 2023-09-19 Yu Shu , Siwei Dong , Guangyao Chen , Wenhao Huang , Ruihua Zhang , Daochen Shi , Qiqi Xiang , Yemin Shi

Large language models (LLMs) are capable of producing high quality information at unprecedented rates. As these models continue to entrench themselves in society, the content they produce will become increasingly pervasive in databases that…

Artificial Intelligence · Computer Science 2024-06-19 Hayden Helm , Brandon Duderstadt , Youngser Park , Carey E. Priebe

The integration of emotional support into various conversational scenarios presents profound societal benefits, such as social interactions, mental health counseling, and customer service. However, there are unsolved challenges that hinder…

Computation and Language · Computer Science 2023-08-23 Zhonghua Zheng , Lizi Liao , Yang Deng , Liqiang Nie

The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn…

Computation and Language · Computer Science 2024-11-06 Ge Bai , Jie Liu , Xingyuan Bu , Yancheng He , Jiaheng Liu , Zhanhui Zhou , Zhuoran Lin , Wenbo Su , Tiezheng Ge , Bo Zheng , Wanli Ouyang

With the advancement of large language models (LLMs), the focus in Conversational AI has shifted from merely generating coherent and relevant responses to tackling more complex challenges, such as personalizing dialogue systems. In an…

Computation and Language · Computer Science 2025-02-13 Maria Molchanova , Anna Mikhailova , Anna Korzanova , Lidiia Ostyakova , Alexandra Dolidze

Large Language Models (LLMs) are now commonplace in conversation applications. However, their risks of misuse for generating harmful responses have raised serious societal concerns and spurred recent research on LLM conversation safety.…

Computation and Language · Computer Science 2024-03-28 Zhichen Dong , Zhanhui Zhou , Chao Yang , Jing Shao , Yu Qiao

LLM-based digital twin simulation, where large language models are used to emulate individual human behavior, holds great promise for research in AI, social science, and digital experimentation. However, progress in this area has been…

Computers and Society · Computer Science 2025-05-26 Olivier Toubia , George Z. Gui , Tianyi Peng , Daniel J. Merlau , Ang Li , Haozhe Chen

In this study, we explore the application of Large Language Models (LLMs) for generating synthetic users and simulating user conversations with a task-oriented dialogue system and present detailed results and their analysis. We propose a…

Computation and Language · Computer Science 2025-02-19 Adnan Ahmad , Stefan Hillmann , Sebastian Möller