English
Related papers

Related papers: Polyphone Disambiguation in Mandarin Chinese with …

200 papers

Self-supervised learning offers an efficient way of extracting rich representations from various types of unlabeled data while avoiding the cost of annotating large-scale datasets. This is achievable by designing a pretext task to form…

Machine Learning · Computer Science 2023-10-11 Pouya Mehralian , Bagher BabaAli , Ashena Gorgan Mohammadi

Contemporary language models are increasingly multilingual, but Chinese LLM developers must navigate complex political and business considerations of language diversity. Language policy in China aims at influencing the public discourse and…

Computation and Language · Computer Science 2025-08-12 Andrea W Wen-Yi , Unso Eun Seo Jo , Lu Jia Lin , David Mimno

In this paper we present a novel Neural Network algorithm for conducting semi-supervised learning for sequence labeling tasks arranged in a linguistically motivated hierarchy. This relationship is exploited to regularise the representations…

Computation and Language · Computer Science 2016-12-30 Jonathan Godwin , Pontus Stenetorp , Sebastian Riedel

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

Sound · Computer Science 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

Self-learning is a classical approach for learning with both labeled and unlabeled observations which consists in giving pseudo-labels to unlabeled training instances with a confidence score over a predetermined threshold. At the same time,…

Machine Learning · Computer Science 2021-09-30 Vasilii Feofanov , Emilie Devijver , Massih-Reza Amini

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

This paper is concerned with phonetic reconstruction of the consonant system of Middle Chinese. We propose to cast the problem as a Mixed Integer Programming problem, which is able to automatically explore homophonic information from…

Computation and Language · Computer Science 2025-07-08 Xiaoxi Luo , Weiwei Sun

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Self-supervised learning (SSL) leverages large datasets of unlabeled speech to reach impressive performance with reduced amounts of annotated data. The high number of proposed approaches fostered the emergence of comprehensive benchmarks…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-22 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

Through solving pretext tasks, self-supervised learning (SSL) leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. A common pretext task consists in pretraining a SSL…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-14 Salah Zaiem , Titouan Parcollet , Slim Essid

Existing semi-supervised learning (SSL) methods assume that labeled and unlabeled data share the same class space. However, in real-world applications, unlabeled data always contain classes not present in the labeled set, which may cause…

Machine Learning · Computer Science 2024-01-17 Wenjuan Xi , Xin Song , Weili Guo , Yang Yang

Utilizing the pseudo-labeling algorithm with large-scale unlabeled data becomes crucial for semi-supervised domain adaptation in speaker verification tasks. In this paper, we propose a novel pseudo-labeling method named Multi-objective…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Ze Li , Yuke Lin , Ning Jiang , Xiaoyi Qin , Guoqing Zhao , Haiying Wu , Ming Li

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Source coding is the canonical problem of data compression in information theory. In a locally encodable source coding, each compressed bit depends on only few bits of the input. In this paper, we show that a recently popular model of…

Machine Learning · Statistics 2020-11-10 Arya Mazumdar , Soumyabrata Pal

The proposed algorithmic approach deals with finding the sense of a word in an electronic data. Now a day,in different communication mediums like internet, mobile services etc. people use few words, which are slang in nature. This approach…

Computation and Language · Computer Science 2017-02-15 Alok Ranjan Pal , Diganta Saha

Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Suichan Li , Bin Liu , Dongdong Chen , Qi Chu , Lu Yuan , Nenghai Yu

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

Ancient Chinese word segmentation (WSG) and part-of-speech tagging (POS) are important to study ancient Chinese, but the amount of ancient Chinese WSG and POS tagging data is still rare. In this paper, we propose a novel augmentation method…

Computation and Language · Computer Science 2023-03-07 Shuo Feng , Piji Li