中文
相关论文

相关论文: BotEval: Facilitating Interactive Human Evaluation

200 篇论文

A natural conversational interface that allows longitudinal symptom tracking would be extremely valuable in health/wellness applications. However, the task of designing emotionally-aware agents for behavior change is still poorly…

人机交互 · 计算机科学 2019-07-26 Asma Ghandeharioun , Daniel McDuff , Mary Czerwinski , Kael Rowan

With the resurgence of chat-based dialog systems in consumer and enterprise applications, there has been much success in developing data-driven and rule-based natural language models to understand human intent. Since these models require…

计算与语言 · 计算机科学 2018-05-14 Nicholas Ruiz , Srinivas Bangalore , John Chen

Evaluating natural language systems poses significant challenges, particularly in the realms of natural language understanding and high-level reasoning. In this paper, we introduce 'Fusion-Eval', an innovative approach that leverages Large…

计算与语言 · 计算机科学 2024-06-10 Lei Shu , Nevan Wichers , Liangchen Luo , Yun Zhu , Yinxiao Liu , Jindong Chen , Lei Meng

Natural language (NL) toolkits enable visualization developers, who may not have a background in natural language processing (NLP), to create natural language interfaces (NLIs) for end-users to flexibly specify and interact with…

人机交互 · 计算机科学 2022-08-16 Rishab Mitra , Arpit Narechania , Alex Endert , John Stasko

Traditional recommendation systems produce static rather than interactive recommendations invariant to a user's specific requests, clarifications, or current mood, and can suffer from the cold-start problem if their tastes are unknown.…

计算与语言 · 计算机科学 2019-09-10 Dongyeop Kang , Anusha Balakrishnan , Pararth Shah , Paul Crook , Y-Lan Boureau , Jason Weston

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

计算与语言 · 计算机科学 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

To build open-domain chatbots that are able to use diverse communicative skills, we propose a novel framework BotsTalk, where multiple agents grounded to the specific target skills participate in a conversation to automatically annotate…

计算与语言 · 计算机科学 2022-10-25 Minju Kim , Chaehyeong Kim , Yongho Song , Seung-won Hwang , Jinyoung Yeo

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…

NLP has recently made exciting progress toward training language models (LMs) with strong scientific problem-solving skills. However, model development has not focused on real-life use-cases of LMs for science, including applications in…

In the field of Geriatronics, enabling effective and transparent communication between humans and robots is crucial for enhancing the acceptance and performance of assistive robots. Our early-stage research project investigates the…

The conversational nature of chatbots poses challenges to designers since their development is different from other software and requires investigating new practices in the context of human-AI interaction and their impact on user…

人机交互 · 计算机科学 2023-01-18 Geovana Ramos Sousa Silva , Edna Dias Canedo

Large language models (LLMs) have shown remarkable performance on various tasks, but existing evaluation benchmarks are often static and insufficient to fully assess their robustness and generalization in realistic scenarios. Prior work…

计算与语言 · 计算机科学 2025-07-01 JiaRu Wu , Mingwei Liu

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

人机交互 · 计算机科学 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Effective task management is essential to successful team collaboration. While the past decade has seen considerable innovation in systems that track and manage group tasks, these innovations have typically been outside of the principal…

人机交互 · 计算机科学 2018-02-12 Carlos Toxtli , Andrés Monroy-Hernández , Justin Cranshaw

Large Language Models (LLMs) have shown strong potential as conversational agents. Yet, their effectiveness remains limited by deficiencies in robust long-term memory, particularly in complex, long-term web-based services such as online…

计算与语言 · 计算机科学 2026-02-03 Tiantian Chen , Jiaqi Lu , Ying Shen , Lin Zhang

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

计算与语言 · 计算机科学 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

计算与语言 · 计算机科学 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

Business processes are commonly represented by modelling languages, such as Event-driven Process Chain (EPC), Yet Another Workflow Language (YAWL), and the most popular standard notation for modelling business processes, the Business…

计算与语言 · 计算机科学 2023-12-08 Luis Fernando Lins , Nathalia Nascimento , Paulo Alencar , Toacy Oliveira , Donald Cowan

The research community has traditionally shown a keen interest in emotion modeling, with a notable emphasis on the detection aspect. In contrast, the exploration of emotion generation has received less attention.This study delves into an…

人机交互 · 计算机科学 2024-11-06 Taseen Mubassira , Mehedi Hasan , A. B. M. Alim Al Iislam

As artificial intelligence (AI) becomes a prominent part of modern life, AI literacy is becoming important for all citizens, not just those in technology careers. Previous research in AI education materials has largely focused on the…

计算与语言 · 计算机科学 2022-12-16 Kate Pearce , Sharifa Alghowinem , Cynthia Breazeal