English
Related papers

Related papers: Empowering Low-Resource Language ASR via Large-Sca…

200 papers

We introduce MarginMatch, a new SSL approach combining consistency regularization and pseudo-labeling, with its main novelty arising from the use of unlabeled data training dynamics to measure pseudo-label quality. Instead of using only the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Tiberiu Sosea , Cornelia Caragea

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

The struggle of social media platforms to moderate content in a timely manner, encourages users to abuse such platforms to spread vulgar or abusive language, which, when performed repeatedly becomes cyberbullying a social problem taking…

Computation and Language · Computer Science 2023-08-31 Tanjim Mahmud , Michal Ptaszynski , Juuso Eronen , Fumito Masui

Learning visual knowledge from massive weakly-labeled web videos has attracted growing research interests thanks to the large corpus of easily accessible video data on the Internet. However, for video action recognition, the action of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kunpeng Li , Zizhao Zhang , Guanhang Wu , Xuehan Xiong , Chen-Yu Lee , Zhichao Lu , Yun Fu , Tomas Pfister

Data-driven based approaches, in spite of great success in many tasks, have poor generalization when applied to unseen image domains, and require expensive cost of annotation especially for dense pixel prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Shuaijun Chen , Xu Jia , Jianzhong He , Yongjie Shi , Jianzhuang Liu

This study investigates the efficacy of data augmentation techniques for low-resource automatic speech recognition (ASR), focusing on two endangered Austronesian languages, Amis and Seediq. Recognizing the potential of self-supervised…

Computation and Language · Computer Science 2025-10-01 Yao-Fei Cheng , Li-Wei Chen , Hung-Shin Lee , Hsin-Min Wang

Automatic speech recognition (ASR) plays a vital role in enabling natural human-machine interaction across applications such as virtual assistants, industrial automation, customer support, and real-time transcription. However, developing…

Computation and Language · Computer Science 2025-08-13 Mahmoud Salhab , Shameed Sait , Mohammad Abusheikh , Hasan Abusheikh

Fine-tuning multilingual ASR models like Whisper for low-resource languages often improves read speech but degrades spontaneous audio performance, a phenomenon we term studio-bias. To diagnose this mismatch, we introduce Vividh-ASR, a…

Computation and Language · Computer Science 2026-05-14 Kush Juvekar , Kavya Manohar , Aditya Srinivas Menon , Arghya Bhattacharya , Kumarmanas Nethil

Deep neural networks have achieved remarkable performance across various tasks when supplied with large-scale labeled data. However, the collection of labeled data can be time-consuming and labor-intensive. Semi-supervised learning (SSL),…

Machine Learning · Computer Science 2024-06-28 Chaoqi Liang , Guanglei Yang , Lifeng Qiao , Zitong Huang , Hongliang Yan , Yunchao Wei , Wangmeng Zuo

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

Machine Learning · Computer Science 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Sociotechnical systems, such as language technologies, frequently exhibit identity-based biases. These biases exacerbate the experiences of historically marginalized communities and remain understudied in low-resource contexts. While models…

Computation and Language · Computer Science 2026-05-08 Dipto Das , Shion Guha , Bryan Semaan

An effective approach to the development of ASR systems for low-resource languages is to fine-tune an existing multilingual end-to-end model. When the original model has been trained on large quantities of data from many languages,…

Computation and Language · Computer Science 2025-06-06 Ondřej Klejch , William Lamb , Peter Bell

Scientific documents often contain a large number of acronyms. Disambiguation of these acronyms will help researchers better understand the meaning of vocabulary in the documents. In the past, thanks to large amounts of data from English…

Computation and Language · Computer Science 2022-02-08 Yixuan Weng , Fei Xia , Bin Li , Xiusheng Huang , Shizhu He

Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks…

Computation and Language · Computer Science 2026-03-23 Jianan Chen , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

Detecting depression from social media text is still a challenging task. This is due to different language styles, informal expression, and the lack of annotated data in many languages. To tackle these issues, we propose, Semi-SMDNet, a…

Computation and Language · Computer Science 2026-01-01 Mohammad Zia Ur Rehman , Velpuru Navya , Sanskar , Shuja Uddin Qureshi , Nagendra Kumar

Automatic speech recognition (ASR) has witnessed remarkable progress in recent years, largely driven by the emergence of LLM-based ASR paradigm. Despite their strong performance on a variety of open-source benchmarks, existing LLM-based ASR…

Sound · Computer Science 2026-01-06 Zheshu Song , Lu Wang , Wei Deng , Zhuo Yang , Yong Wu , Bin Xia

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

In this work, we showcase a cost-effective method for generating training data for speech processing tasks. First, we transcribe unlabeled speech using a state-of-the-art Automatic Speech Recognition (ASR) model. Next, we align generated…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Taras Sereda

This study discusses the effect of semi-supervised learning in combination with pretrained language models for data-to-text generation. It is not known whether semi-supervised learning is still helpful when a large-scale language model is…

Computation and Language · Computer Science 2022-07-15 Chris van der Lee , Thiago Castro Ferreira , Chris Emmery , Travis Wiltshire , Emiel Krahmer

Audio-visual speech contains synchronized audio and visual information that provides cross-modal supervision to learn representations for both automatic speech recognition (ASR) and visual speech recognition (VSR). We introduce continuous…

Machine Learning · Computer Science 2023-10-02 Andrew Rouditchenko , Ronan Collobert , Tatiana Likhomanenko