English
Related papers

Related papers: MD3: The Multi-Dialect Dataset of Dialogues

200 papers

The current public datasets for speech recognition (ASR) tend not to focus specifically on the fairness aspect, such as performance across different demographic groups. This paper introduces a novel dataset, Fair-Speech, a publicly released…

Artificial Intelligence · Computer Science 2024-08-26 Irina-Elena Veliche , Zhuangqun Huang , Vineeth Ayyat Kochaniyan , Fuchun Peng , Ozlem Kalinli , Michael L. Seltzer

The recent advances in deep-learning have led to the development of highly sophisticated systems with an unquenchable appetite for data. On the other hand, building good deep-learning models for low-resource languages remains a challenging…

Computation and Language · Computer Science 2024-02-20 Maithili Sabane , Onkar Litake , Aman Chadha

This study focuses on recognizing Bangladeshi dialects and converting diverse Bengali accents into standardized formal Bengali speech. Dialects, often referred to as regional languages, are distinctive variations of a language spoken in a…

Computation and Language · Computer Science 2024-11-19 Md. Nazmus Sadat Samin , Jawad Ibn Ahad , Tanjila Ahmed Medha , Fuad Rahman , Mohammad Ruhul Amin , Nabeel Mohammed , Shafin Rahman

The problem of synthetic speech detection has enjoyed considerable attention, with recent methods achieving low error rates across several established benchmarks. However, to what extent can low error rates on academic benchmarks translate…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ashi Garg , Zexin Cai , Lin Zhang , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

The rising demand for inclusive speech technologies amplifies the need for multilingual datasets for Natural Language Processing (NLP) research. However, limited awareness of existing task-specific resources in low-resource languages…

Computation and Language · Computer Science 2026-03-02 Swati Sharma , Divya V. Sharma , Anubha Gupta

Sign languages are the primary means of communication for many hard-of-hearing people worldwide. Recently, to bridge the communication gap between the hard-of-hearing community and the rest of the population, several sign language…

Computation and Language · Computer Science 2023-07-12 Abhinav Joshi , Susmit Agrawal , Ashutosh Modi

Full-duplex spoken dialogue systems can model natural conversational behaviours such as interruptions, overlaps, and backchannels, yet such systems remain largely unexplored for Indian languages. We present the first open, reproducible…

Computation and Language · Computer Science 2026-05-26 Bhaskar Singh , Shobhit Banga , Mahima Manik , Pranav Sharma

Conversational artificial intelligence has the potential to assist users in preliminary medical consultations, particularly in settings where access to healthcare professionals is limited. However, many existing medical dialogue systems…

Computation and Language · Computer Science 2026-03-26 Shubham Kumar Nigam , Suparnojit Sarkar , Piyush Patel

We present OOD-Speech, the first out-of-distribution (OOD) benchmarking dataset for Bengali automatic speech recognition (ASR). Being one of the most spoken languages globally, Bengali portrays large diversity in dialects and prosodic…

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Existing studies on talking video generation have predominantly focused on single-person monologues or isolated facial animations, limiting their applicability to realistic multi-human interactions. To bridge this gap, we introduce MIT, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zeyu Zhu , Weijia Wu , Mike Zheng Shou

We conducted a labeling work on a spoken Japanese dataset (I-JAS) for the text classification, which contains 50 interview dialogues of two-way Japanese conversation that discuss the participants' past present and future. Each dialogue is…

Computation and Language · Computer Science 2021-03-23 Changzeng Fu

Disentangling conversations mixed together in a single stream of messages is a difficult task, made harder by the lack of large manually annotated datasets. We created a new dataset of 77,563 messages manually annotated with reply-structure…

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao

Natural Language Generation (NLG) for non-English languages is hampered by the scarcity of datasets in these languages. In this paper, we present the IndicNLG Benchmark, a collection of datasets for benchmarking NLG for 11 Indic languages.…

Computation and Language · Computer Science 2022-10-28 Aman Kumar , Himani Shrotriya , Prachi Sahu , Raj Dabre , Ratish Puduppully , Anoop Kunchukuttan , Amogh Mishra , Mitesh M. Khapra , Pratyush Kumar

Automatic speech recognition (ASR) systems are designed to transcribe spoken language into written text and find utility in a variety of applications including voice assistants and transcription services. However, it has been observed that…

Computation and Language · Computer Science 2023-07-21 Anand Kumar Rai , Siddharth D Jaiswal , Animesh Mukherjee

Full-duplex, spontaneous conversational data are essential for enhancing the naturalness and interactivity of synthesized speech in conversational TTS systems. We present two open-source dual-track conversational speech datasets, one in…

Sound · Computer Science 2025-09-05 Zhitong Zhou , Qingqing Zhang , Lei Luo , Jiechen Liu , Ruohua Zhou

This paper presents an analysis of the distribution of spoken language in the V3C video retrieval benchmark dataset based on automatically generated transcripts. It finds that a large portion of the dataset is covered by spoken language.…

Multimedia · Computer Science 2022-12-16 Luca Rossetto

There is an increasing demand for goal-oriented conversation systems which can assist users in various day-to-day activities such as booking tickets, restaurant reservations, shopping, etc. Most of the existing datasets for building such…

Computation and Language · Computer Science 2018-06-18 Suman Banerjee , Nikita Moghe , Siddhartha Arora , Mitesh M. Khapra

Speech synthesis is crucial for human-computer interaction, enabling natural and intuitive communication. However, existing datasets involve high construction costs due to manual annotation and suffer from limited character diversity,…

Computation and Language · Computer Science 2025-04-22 Xiang Li , Duyi Pan , Hongru Xiao , Jiale Han , Jing Tang , Jiabao Ma , Wei Wang , Bo Cheng