English
Related papers

Related papers: CASPER: A Large Scale Spontaneous Speech Dataset

200 papers

This paper describes an English audio and textual dataset of debating speeches, a unique resource for the growing research field of computational argumentation and debating technologies. We detail the process of speech recording by…

Computation and Language · Computer Science 2018-03-28 Shachar Mirkin , Michal Jacovi , Tamar Lavee , Hong-Kwang Kuo , Samuel Thomas , Leslie Sager , Lili Kotlerman , Elad Venezian , Noam Slonim

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Most existing datasets for speaker identification contain samples obtained under quite constrained conditions, and are usually hand-annotated, hence limited in size. The goal of this paper is to generate a large scale text-independent…

Sound · Computer Science 2020-11-05 Arsha Nagrani , Joon Son Chung , Andrew Zisserman

Spoken conversational systems require more than accurate speech generation to have human-like conversations: to feel natural and engaging, they must produce conversational behaviour that adapts dynamically to the context. Current spoken…

Computation and Language · Computer Science 2026-04-16 Maike Züfle , Ondrej Klejch , Nicholas Sanders , Jan Niehues , Alexandra Birch , Tsz Kin Lam

This paper presents a dataset collected from natural dialogs which enables to test the ability of dialog systems to learn new facts from user utterances throughout the dialog. This interactive learning will help with one of the most…

Computation and Language · Computer Science 2016-05-17 Miroslav Vodolán , Filip Jurčíček

The majority of current Text-to-Speech (TTS) datasets, which are collections of individual utterances, contain few conversational aspects. In this paper, we introduce DailyTalk, a high-quality conversational speech dataset designed for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Keon Lee , Kyumin Park , Daeyoung Kim

Spoken dialogue is essential for human-AI interactions, providing expressive capabilities beyond text. Developing effective spoken dialogue systems (SDSs) requires large-scale, high-quality, and diverse spoken dialogue corpora. However,…

Computation and Language · Computer Science 2026-04-03 Wataru Nakata , Kentaro Seki , Hitomi Yanaka , Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Everyday speech conveys far more than words, it reflects who we are, how we feel, and the circumstances surrounding our interactions. Yet, most existing speech datasets are acted, limited in scale, and fail to capture the expressive…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Zongyang Du , Shreeram Suresh Chandra , Ismail Rasim Ulgen , Aurosweta Mahapatra , Ali N. Salman , Carlos Busso , Berrak Sisman

Recent advancements in speech generation models have been significantly driven by the use of large-scale training data. However, producing highly spontaneous, human-like speech remains a challenge due to the scarcity of large, diverse, and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Haorui He , Zengqiang Shang , Chaoren Wang , Xuyuan Li , Yicheng Gu , Hua Hua , Liwei Liu , Chen Yang , Jiaqi Li , Peiyang Shi , Yuancheng Wang , Kai Chen , Pengyuan Zhang , Zhizheng Wu

As sharing images in an instant message is a crucial factor, there has been active research on learning an image-text multi-modal dialogue models. However, training a well-generalized multi-modal dialogue model remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Young-Jun Lee , Byungsoo Ko , Han-Gyu Kim , Jonghwan Hyeon , Ho-Jin Choi

Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open-ended generation tasks most relevant to long-context reasoning pose well-known challenges for…

Recent advancements in speech generation have been driven by large-scale training datasets. However, current models struggle to capture the spontaneity and variability inherent in real-world human speech, as they are primarily trained on…

Many users communicate with chatbots and AI assistants in order to help them with various tasks. A key component of the assistant is the ability to understand and answer a user's natural language questions for question-answering (QA).…

Computation and Language · Computer Science 2020-06-08 Anthony Colas , Trung Bui , Franck Dernoncourt , Moumita Sinha , Doo Soon Kim

Existing dialog datasets contain a sequence of utterances and responses without any explicit background knowledge associated with them. This has resulted in the development of models which treat conversation as a sequence-to-sequence…

Computation and Language · Computer Science 2018-09-24 Nikita Moghe , Siddhartha Arora , Suman Banerjee , Mitesh M. Khapra

In this paper, we present a 170.83 hour Indian English spontaneous speech dataset. Lack of Indian English speech data is one of the major hindrances in developing robust speech systems which are adapted to the Indian speech style. Moreover…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-04 Abhayjeet Singh , Charu Shah , Rajashri Varadaraj , Sonakshi Chauhan , Prasanta Kumar Ghosh

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao

The timings of spoken response offsets in human dialogue have been shown to vary based on contextual elements of the dialogue. We propose neural models that simulate the distributions of these response offsets, taking into account the…

Computation and Language · Computer Science 2020-05-20 Matthew Roddy , Naomi Harte

Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation…

Computation and Language · Computer Science 2023-06-07 Zekun Li , Wenhu Chen , Shiyang Li , Hong Wang , Jing Qian , Xifeng Yan

Spontaneous style speech synthesis, which aims to generate human-like speech, often encounters challenges due to the scarcity of high-quality data and limitations in model capabilities. Recent language model-based TTS systems can be trained…

Sound · Computer Science 2024-07-19 Weiqin Li , Peiji Yang , Yicheng Zhong , Yixuan Zhou , Zhisheng Wang , Zhiyong Wu , Xixin Wu , Helen Meng

With the emergence of increasingly powerful large language models, there is a burgeoning interest in leveraging these models for casual conversation and role-play applications. However, existing conversational and role-playing datasets…

Computation and Language · Computer Science 2023-08-14 Tear Gosling , Alpin Dale , Yinhe Zheng