English
Related papers

Related papers: A language model based approach towards large scal…

200 papers

Sequence-to-sequence models provide a simple and elegant solution for building speech recognition systems by folding separate components of a typical system, namely acoustic (AM), pronunciation (PM) and language (LM) models into a single…

Audio and Speech Processing · Electrical Eng. & Systems 2017-12-06 Bo Li , Tara N. Sainath , Khe Chai Sim , Michiel Bacchiani , Eugene Weinstein , Patrick Nguyen , Zhifeng Chen , Yonghui Wu , Kanishka Rao

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Recently, end-to-end (E2E) models, which allow to take spectral vector sequences of L2 (second-language) learners' utterances as input and produce the corresponding phone-level sequences as output, have attracted much research attention in…

Sound · Computer Science 2021-10-19 Tien-Hong Lo , Yao-Ting Sung , Berlin Chen

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

The pre-trained multi-lingual XLSR model generalizes well for language identification after fine-tuning on unseen languages. However, the performance significantly degrades when the languages are not very distinct from each other, for…

Machine Learning · Computer Science 2023-02-17 Shangeth Rajaa , Kriti Anandan , Swaraj Dalmia , Tarun Gupta , Eng Siong Chng

Large language models (LLMs) have shown great promise for capturing contextual information in natural language processing tasks. We propose a novel approach to speaker diarization that incorporates the prowess of LLMs to exploit contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Tae Jin Park , Kunal Dhawan , Nithin Koluguri , Jagadeesh Balam

Diffusion models that are based on iterative denoising have been recently proposed and leveraged in various generation tasks like image generation. Whereas, as a way inherently built for continuous data, existing diffusion models still have…

Computation and Language · Computer Science 2023-04-11 Jiaao Chen , Aston Zhang , Mu Li , Alex Smola , Diyi Yang

This paper is concerned with automatic continuous speech recognition using trainable systems. The aim of this work is to build acoustic models for spoken Swedish. This is done employing hidden Markov models and using the SpeechDat database…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-26 Giampiero Salvi

This paper analyses language modeling in spoken dialogue systems for accessing a database. The use of several language models obtained by exploiting dialogue predictions gives better results than the use of a single model for the whole…

cmp-lg · Computer Science 2008-02-03 Cosmin Popovici , Paolo Baggia

Speech enhancement is a task to improve the intelligibility and perceptual quality of degraded speech signal. Recently, neural networks based methods have been applied to speech enhancement. However, many neural network based methods…

Sound · Computer Science 2021-02-22 Qiuqiang Kong , Haohe Liu , Xingjian Du , Li Chen , Rui Xia , Yuxuan Wang

Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of an individual recording. However, language identification…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Suzy J. Styles , Victoria Y. H. Chua , Fei Ting Woon , Hexin Liu , Leibny Paola Garcia Perera , Sanjeev Khudanpur , Andy W. H. Khong , Justin Dauwels

Generative Spoken Language Modeling research focuses on optimizing speech Language Models (LMs) using raw audio recordings without accessing any textual supervision. Such speech LMs usually operate over discrete units obtained from…

Computation and Language · Computer Science 2023-05-30 Itai Gat , Felix Kreuk , Tu Anh Nguyen , Ann Lee , Jade Copet , Gabriel Synnaeve , Emmanuel Dupoux , Yossi Adi

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

Machine Learning · Computer Science 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

Machine learning techniques have conquered many different tasks in speech and natural language processing, such as speech recognition, information extraction, text and speech generation, and human machine interaction using natural language…

Computation and Language · Computer Science 2025-03-18 Sebastian Möller , Pia Knoeferle , Britta Schulte , Nils Feldhus

This survey provides an overview of the evolution of visually grounded models of spoken language over the last 20 years. Such models are inspired by the observation that when children pick up a language, they rely on a wide range of…

Artificial Intelligence · Computer Science 2022-02-22 Grzegorz Chrupała

The audio data is increasing day by day throughout the globe with the increase of telephonic conversations, video conferences and voice messages. This research provides a mechanism for identifying a speaker in an audio file, based on the…

Sound · Computer Science 2022-05-31 Syeda Rabia Arshad , Syed Mujtaba Haider , Abdul Basit Mughal

This article describes an unsupervised language model adaptation approach that can be used to enhance the performance of language identification methods. The approach is applied to a current version of the HeLI language identification…

Computation and Language · Computer Science 2019-03-27 Tommi Jauhiainen , Krister Lindén , Heidi Jauhiainen

Speech recognition has of late become a practical technology for real world applications. Aiming at speech-driven text retrieval, which facilitates retrieving information with spoken queries, we propose a method to integrate speech…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Katunobu Itou , Tetsuya Ishikawa

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

For decades, context-dependent phonemes have been the dominant sub-word unit for conventional acoustic modeling systems. This status quo has begun to be challenged recently by end-to-end models which seek to combine acoustic, pronunciation,…