English
Related papers

Related papers: Topic-Conversation Relevance (TCR) Dataset and Ben…

200 papers

Automated radiology report generation is essential in clinical practice. However, diagnosing radiological images typically requires physicians 5-10 minutes, resulting in a waste of valuable healthcare resources. Existing studies have not…

Multimedia · Computer Science 2025-09-16 Jing Xiao , Hongfei Liu , Ruiqi Dong , Jimin Liu , Haoyong Yu

In this work we explored building automatic speech recognition models for transcribing doctor patient conversation. We collected a large scale dataset of clinical conversations ($14,000$ hr), designed the task to represent the real word…

Unlike well-structured text, such as news reports and encyclopedia articles, dialogue content often comes from two or more interlocutors, exchanging information with each other. In such a scenario, the topic of a conversation can vary upon…

Computation and Language · Computer Science 2021-09-13 Junpeng Liu , Yanyan Zou , Hainan Zhang , Hongshen Chen , Zhuoye Ding , Caixia Yuan , Xiaojie Wang

Identifying the topic (domain) of each user's utterance in open-domain conversational systems is a crucial step for all subsequent language understanding and response tasks. In particular, for complex domains, an utterance is often routed…

Computation and Language · Computer Science 2020-05-29 Ali Ahmadvand , Harshita Sahijwani , Jason Ingyu Choi , Eugene Agichtein

By evaluating Large Language Models (LLMs) through uniform, text-only interfaces, current academic benchmarks obscure how the unique designs and affordances of distinct commercial platforms shape real-world user behavior and system…

Computation and Language · Computer Science 2026-05-19 Yueru Yan , Tuc Nguyen , Bo Su , Melissa Lieffers , Thai Le

Document-level relation extraction aims to categorize the association between any two entities within a document. We find that previous methods for document-level relation extraction are ineffective in exploiting the full potential of large…

Computation and Language · Computer Science 2024-06-11 Chufan Gao , Xuan Wang , Jimeng Sun

This study presents a framework for automated evaluation of dynamically evolving topic models using Large Language Models (LLMs). Topic modeling is essential for organizing and retrieving scholarly content in digital library systems,…

Computation and Language · Computer Science 2025-10-24 Zhiyin Tan , Jennifer D'Souza

Theme detection is a fundamental task in user-centric dialogue systems, aiming to identify the latent topic of each utterance without relying on predefined schemas. Unlike intent induction, which operates within fixed label spaces, theme…

Computation and Language · Computer Science 2025-12-29 Rui Ke , Jiahui Xu , Shenghao Yang , Kuang Wang , Feng Jiang , Haizhou Li

Large Language Models (LLMs) excel at generating contextually appropriate responses but remain poorly calibrated for multi-party conversations, where deciding when to speak is as critical as what to say. In such settings, naively responding…

Computation and Language · Computer Science 2026-05-08 Vihaan Nama , Shreya Mendi , Zian Ye , Brinnae Bent

The majority of current Text-to-Speech (TTS) datasets, which are collections of individual utterances, contain few conversational aspects. In this paper, we introduce DailyTalk, a high-quality conversational speech dataset designed for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Keon Lee , Kyumin Park , Daeyoung Kim

Recent years have seen a surge of research into conversational recommender systems (CRS). Among existing datasets, ReDial is the most widely used benchmark, cited in hundreds of studies. However, variations in how the dataset is…

Information Retrieval · Computer Science 2026-05-21 Ivica Kostric , Krisztian Balog

The ability of Large Language Models (LLMs) to generate structured outputs that follow arbitrary schemas is crucial to a wide range of downstream tasks that require diverse structured representations of results such as information…

Computation and Language · Computer Science 2025-11-25 James Y. Huang , Wenxuan Zhou , Nan Xu , Fei Wang , Qin Liu , Sheng Zhang , Hoifung Poon , Muhao Chen

To handle the vast amounts of qualitative data produced in corporate climate communication, stakeholders increasingly rely on Retrieval Augmented Generation (RAG) systems. However, a significant gap remains in evaluating domain-specific…

Information Retrieval · Computer Science 2024-10-02 Tobias Schimanski , Jingwei Ni , Roberto Spacey , Nicola Ranger , Markus Leippold

Query-focused meeting summarization (QFMS) aims to generate summaries from meeting transcripts in response to a given query. Previous works typically concatenate the query with meeting transcripts and implicitly model the query relevance…

Computation and Language · Computer Science 2023-06-02 Xingxian Liu , Bin Duan , Bo Xiao , Yajing Xu

This document provides a brief description of the National Institute of Standards and Technology (NIST) speaker recognition evaluation (SRE) conversational telephone speech (CTS) Superset. The CTS Superset has been created in an attempt to…

Sound · Computer Science 2021-08-17 Seyed Omid Sadjadi

We present ClidSum, a benchmark dataset for building cross-lingual summarization systems on dialogue documents. It consists of 67k+ dialogue documents from two subsets (i.e., SAMSum and MediaSum) and 112k+ annotated summaries in different…

Computation and Language · Computer Science 2022-10-18 Jiaan Wang , Fandong Meng , Ziyao Lu , Duo Zheng , Zhixu Li , Jianfeng Qu , Jie Zhou

Effective customer support requires not only accurate problem solving but also structured and empathetic communication aligned with professional standards. However, existing dialogue datasets often lack strategic guidance, and real-world…

Computation and Language · Computer Science 2025-11-11 Jie Zhu , Huaixia Dou , Junhui Li , Lifan Guo , Feng Chen , Chi Zhang , Fang Kong

Stakeholders' conversations in requirements elicitation meetings hold valuable insights into system and client needs. However, manually extracting requirements is time-consuming, labor-intensive, and prone to errors and biases. While…

Software Engineering · Computer Science 2025-05-20 Gianmario Voria , Francesco Casillo , Carmine Gravino , Gemma Catolino , Fabio Palomba

We present MeeQA, a dataset for natural-language question answering over meeting transcripts. It includes real questions asked during meetings by its participants. The dataset contains 48K question-answer pairs, extracted from 422 meeting…

Computation and Language · Computer Science 2023-05-16 Reut Apel , Tom Braude , Amir Kantor , Eyal Kolman

Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is…

Computation and Language · Computer Science 2024-07-30 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto