English
Related papers

Related papers: Phoneme Boundary Detection using Learnable Segment…

200 papers

This paper advances phrase break prediction (also known as phrasing) in multi-speaker text-to-speech (TTS) systems. We integrate speaker-specific features by leveraging speaker embeddings to enhance the performance of the phrasing model. We…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Dong Yang , Yuki Saito , Takaaki Saeki , Tomoki Koriyama , Wataru Nakata , Detai Xin , Hiroshi Saruwatari

We present a model of visually-grounded language learning based on stacked gated recurrent neural networks which learns to predict visual features given an image description in the form of a sequence of phonemes. The learning task resembles…

Computation and Language · Computer Science 2016-10-12 Lieke Gelderloos , Grzegorz Chrupała

In noisy conditions, knowing speech contents facilitates listeners to more effectively suppress background noise components and to retrieve pure speech signals. Previous studies have also confirmed the benefits of incorporating phonetic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Yen-Ju Lu , Chien-Feng Liao , Xugang Lu , Jeih-weih Hung , Yu Tsao

Phoneme recognition is a largely unsolved problem in NLP, especially for low-resource languages like Urdu. The systems that try to extract the phonemes from audio speech require hand-labeled phonetic transcriptions. This requires expert…

Computation and Language · Computer Science 2022-04-19 Saad Naeem , Omer Beg

Machine learning techniques are an active area of research for speech enhancement for hearing aids, with one particular focus on improving the intelligibility of a noisy speech signal. Recent work has shown that feature encodings from…

Sound · Computer Science 2024-07-19 Robert Sutherland , George Close , Thomas Hain , Stefan Goetze , Jon Barker

Recent neural supervised topic segmentation models achieve distinguished superior effectiveness over unsupervised methods, with the availability of large-scale training corpora sampled from Wikipedia. These models may, however, suffer from…

Computation and Language · Computer Science 2022-09-20 Linzi Xing , Patrick Huber , Giuseppe Carenini

While models in audio and speech processing are becoming deeper and more end-to-end, they as a consequence need expensive training on large data, and are often brittle. We build on a classical model of human hearing and make it…

Sound · Computer Science 2024-09-16 Ruolan Leslie Famularo , Dmitry N. Zotkin , Shihab A. Shamma , Ramani Duraiswami

Many self-supervised speech models (S3Ms) have been introduced over the last few years, improving performance and data efficiency on various speech tasks. However, these empirical successes alone do not give a complete picture of what is…

Computation and Language · Computer Science 2024-02-01 Ankita Pasad , Chung-Ming Chien , Shane Settle , Karen Livescu

In this work we show that adapting Deep Convolutional Neural Network training to the task of boundary detection can result in substantial improvements over the current state-of-the-art in boundary detection. Our contributions consist…

Computer Vision and Pattern Recognition · Computer Science 2016-01-25 Iasonas Kokkinos

For decades, context-dependent phonemes have been the dominant sub-word unit for conventional acoustic modeling systems. This status quo has begun to be challenged recently by end-to-end models which seek to combine acoustic, pronunciation,…

In this paper, we present how to hybridize a Word2vec model and an attention-based end-to-end speech recognition model. We build a phoneme recognition system based on Listen, Attend and Spell model. And the phoneme recognition model uses a…

Computation and Language · Computer Science 2019-12-20 Xin Feng , Lei Wang

In this study, we present an innovative technique for speaker adaptation in order to improve the accuracy of segmentation with application to unit-selection Text-To-Speech (TTS) systems. Unlike conventional techniques for speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Claudio Zito , Fabio Tesser , Mauro Nicolao , Piero Cosi

We propose the application of a semi-supervised learning method to improve the performance of acoustic modelling for automatic speech recognition based on deep neural net- works. As opposed to unsupervised initialisation followed by…

Machine Learning · Statistics 2016-10-04 Akash Kumar Dhaka , Giampiero Salvi

A crucial step in processing speech audio data for information extraction, topic detection, or browsing/playback is to segment the input into sentence and topic units. Speech segmentation is challenging, since the cues typically present for…

Computation and Language · Computer Science 2022-02-28 E. Shriberg , A. Stolcke , D. Hakkani-Tur , G. Tur

In this paper, we present a joint multi-task learning framework for semantic segmentation and boundary detection. The critical component in the framework is the iterative pyramid context module (PCM), which couples two tasks and stores the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Mingmin Zhen , Jinglu Wang , Lei Zhou , Shiwei Li , Tianwei Shen , Jiaxiang Shang , Tian Fang , Quan Long

In response to the growing importance of geospatial data, its analysis including semantic segmentation becomes an increasingly popular task in computer vision today. Convolutional neural networks are powerful visual models that yield…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Alexey Bokhovkin , Evgeny Burnaev

Automated tongue image segmentation in tongue images is a challenging task for two reasons: 1) there are many pathological details on the tongue surface, which affect the extraction of the boundary; 2) the shapes of the tongues captured…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Xinyi Zeng , Qian Zhang , Jia Chen , Guixu Zhang , Aimin Zhou , Yiqin Wang

This paper proposes a novel method for high-quality image segmentation of both objects and scenes. Inspired by the dilation and erosion operations in morphological image processing techniques, the pixel-level image segmentation problems are…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Hao He , Xiangtai Li , Yibo Yang , Guangliang Cheng , Yunhai Tong , Lubin Weng , Zhouchen Lin , Shiming Xiang

In a noisy environment, a lossy speech signal can be automatically restored by a listener if he/she knows the language well. That is, with the built-in knowledge of a "language model", a listener may effectively suppress noise interference…

Machine Learning · Computer Science 2019-07-03 Chien-Feng Liao , Yu Tsao , Xugang Lu , Hisashi Kawai

Large-scale pre-trained language models have been shown to be helpful in improving the naturalness of text-to-speech (TTS) models by enabling them to produce more naturalistic prosodic patterns. However, these models are usually word-level…

Computation and Language · Computer Science 2023-01-24 Yinghao Aaron Li , Cong Han , Xilin Jiang , Nima Mesgarani