English
Related papers

Related papers: An Open-Source Web-Based Tool for Evaluating Open-…

200 papers

Natural language dialogue systems raise great attention recently. As many dialogue models are data-driven, high-quality datasets are essential to these systems. In this paper, we introduce Pchatbot, a large-scale dialogue dataset that…

Computation and Language · Computer Science 2021-06-01 Hongjin Qian , Xiaohe Li , Hanxun Zhong , Yu Guo , Yueyuan Ma , Yutao Zhu , Zhanliang Liu , Zhicheng Dou , Ji-Rong Wen

We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE, aiming to support the prediction of relation(s) between two arguments that appear in a dialogue. We further offer DialogRE as a platform for…

Computation and Language · Computer Science 2020-04-20 Dian Yu , Kai Sun , Claire Cardie , Dong Yu

Interactions with virtual assistants typically start with a trigger phrase followed by a command. In this work, we explore the possibility of making these interactions more natural by eliminating the need for a trigger phrase. Our goal is…

Through reading the documentation in the context, tool-using language models can dynamically extend their capability using external tools. The cost is that we have to input lengthy documentation every time the model needs to use the tool,…

Computation and Language · Computer Science 2024-07-03 Yang Xu , Yunlong Feng , Honglin Mu , Yutai Hou , Yitong Li , Xinghao Wang , Wanjun Zhong , Zhongyang Li , Dandan Tu , Qingfu Zhu , Min Zhang , Wanxiang Che

Recommender systems are software applications that help users find items of interest in situations of information overload in a personalized way, using knowledge about the needs and preferences of individual users. In conversational…

Artificial Intelligence · Computer Science 2022-02-10 Tommaso Di Noia , Francesco Donini , Dietmar Jannach , Fedelucio Narducci , Claudio Pomo

Data contamination in model evaluation has become increasingly prevalent with the growing popularity of large language models. It allows models to "cheat" via memorisation instead of displaying true capabilities. Therefore, contamination…

Computation and Language · Computer Science 2024-01-30 Yucheng Li , Frank Guerin , Chenghua Lin

With the rapid advancement of large language models (LLMs), intelligent conversational assistants have demonstrated remarkable capabilities across various domains. However, they still mainly rely on explicit textual input and do not know…

Human-Computer Interaction · Computer Science 2025-12-29 Ziyan Zhang , Nan Gao , Zhiqiang Nie , Shantanu Pal , Haining Zhang

Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. As mainstream chatbots increasingly ship with reasoning capabilities and web search tools -- and millions of…

Computation and Language · Computer Science 2025-11-25 Matthew R. DeVerna , Kai-Cheng Yang , Harry Yaojun Yan , Filippo Menczer

In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant progress has been achieved, especially recently with neural…

Computation and Language · Computer Science 2018-10-09 Karin Sim Smith , Lucia Specia

Despite known differences between reading and listening in the brain, recent work has shown that text-based language models predict both text-evoked and speech-evoked brain activity to an impressive degree. This poses the question of what…

Computation and Language · Computer Science 2024-06-18 Subba Reddy Oota , Emin Çelik , Fatma Deniz , Mariya Toneva

Automatic Speech Recognition and Text-to-Speech systems are primarily trained in a supervised fashion and require high-quality, accurately labeled speech datasets. In this work, we examine common problems with speech data and introduce a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-10 Evelina Bakhturina , Vitaly Lavrukhin , Boris Ginsburg

Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is…

Computation and Language · Computer Science 2024-07-30 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current…

Computation and Language · Computer Science 2023-09-21 Xinyu Zhou , Delong Chen , Yudong Chen

Human feedback data is a critical component in developing language models. However, collecting this feedback is costly and ultimately not scalable. Inspired by the way human interlocutors provide spontaneous unsolicited feedback to each…

Computation and Language · Computer Science 2025-03-04 Shachar Don-Yehiya , Leshem Choshen , Omri Abend

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

Language models are often used as the backbone of modern dialogue systems. These models are pre-trained on large amounts of written fluent language. Repetition is typically penalised when evaluating language model generations. However, it…

Computation and Language · Computer Science 2023-11-23 Aron Molnar , Jaap Jumelet , Mario Giulianelli , Arabella Sinclair

Chat-based large language models have the opportunity to empower individuals lacking high-quality healthcare access to receive personalized information across a variety of topics. However, users may ask underspecified questions that require…

Computation and Language · Computer Science 2024-03-11 Sharon Levy , Tahilin Sanchez Karver , William D. Adler , Michelle R. Kaufman , Mark Dredze

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in…

Large Language Models (LLMs) are trained on vast amounts of data, most of which is automatically scraped from the internet. This data includes encyclopedic documents that harbor a vast amount of general knowledge (e.g., Wikipedia) but also…