English
Related papers

Related papers: Mitigating Data Imbalance in Automated Speaking As…

200 papers

Imbalanced datasets pose a considerable challenge in training deep learning (DL) models for medical diagnostics, particularly for segmentation tasks. Imbalance may be associated with annotation quality limited annotated datasets, rare…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Bashir Alam , Masa Cirkovic , Mete Harun Akcay , Md Kaf Shahrier , Sebastien Lafond , Hergys Rexha , Kurt Benke , Sepinoud Azimi , Janan Arslan

The category of figurative language contains many varieties, some of which are non-compositional in nature. This type of phrase or multi-word expression (MWE) includes idioms, which represent a single meaning that does not consist of the…

Computation and Language · Computer Science 2026-03-25 Blake Matheny , Phuong Minh Nguyen , Minh Le Nguyen

Building inclusive speech recognition systems is a crucial step towards developing technologies that speakers of all language varieties can use. Therefore, ASR systems must work for everybody independently of the way they speak. To…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-18 Alëna Aksënova , Zhehuai Chen , Chung-Cheng Chiu , Daan van Esch , Pavel Golik , Wei Han , Levi King , Bhuvana Ramabhadran , Andrew Rosenberg , Suzan Schwartz , Gary Wang

Recently proposed self-supervised learning approaches have been successful for pre-training speech representation models. The utility of these learned representations has been observed empirically, but not much has been studied about the…

Computation and Language · Computer Science 2022-12-06 Ankita Pasad , Ju-Chieh Chou , Karen Livescu

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

Machine Learning · Computer Science 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

Recently, pioneer work finds that speech pre-trained models can solve full-stack speech processing tasks, because the model utilizes bottom layers to learn speaker-related information and top layers to encode content-related information.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-17 Chengyi Wang , Yu Wu , Sanyuan Chen , Shujie Liu , Jinyu Li , Yao Qian , Zhenglu Yang

This article presents an evaluation of several machine learning methods applied to automated text classification, alongside the design of a demonstrative system for unbalanced document categorization and distribution. The study focuses on…

Computation and Language · Computer Science 2026-02-25 Radoslaw Roszczyk , Pawel Tecza , Maciej Stodolski , Krzysztof Siwek

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

Computation and Language · Computer Science 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

Large language models (LLMs) are increasingly used in decision-making tasks where they can amplify or suppress perspectives, raising concerns in high-stakes settings affecting autistic communities. While previous research has identified…

Computation and Language · Computer Science 2026-05-27 Naba Rizvi , Harper Strickland , Saleha Ahmedi , Nedjma Ousidhoum

Speech Emotion Recognition (SER) is crucial for human-computer interaction but still remains a challenging problem because of two major obstacles: data scarcity and imbalance. Many datasets for SER are substantially imbalanced, where data…

Sound · Computer Science 2022-08-11 Shijun Wang , Hamed Hemati , Jón Guðnason , Damian Borth

Historically lower-level tasks such as automatic speech recognition (ASR) and speaker identification are the main focus in the speech field. Interest has been growing in higher-level spoken language understanding (SLU) tasks recently, like…

Computation and Language · Computer Science 2022-04-25 Lin Yao , Jianfei Song , Ruizhuo Xu , Yingfang Yang , Zijian Chen , Yafeng Deng

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Adaptive S-norm (AS-norm) calibrates automatic speaker verification (ASV) scores by normalizing them utilize the scores of impostors which are similar to the input speaker. However, AS-norm does not involve any learning process, limiting…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-08 Jeong-Hwan Choi , Ju-Seok Seong , Ye-Rin Jeoung , Joon-Hyuk Chang

End-to-end (E2E) automatic speech recognition (ASR) models have become standard practice for various commercial applications. However, in real-world scenarios, the long-tailed nature of word distribution often leads E2E ASR models to…

Computation and Language · Computer Science 2024-09-11 Yi-Cheng Wang , Li-Ting Pai , Bi-Cheng Yan , Hsin-Wei Wang , Chi-Han Lin , Berlin Chen

Classification tasks require a balanced distribution of data to ensure the learner to be trained to generalize over all classes. In real-world datasets, however, the number of instances vary substantially among classes. This typically leads…

Machine Learning · Computer Science 2020-11-24 Joel Jang , Yoonjeon Kim , Kyoungho Choi , Sungho Suh

Reliable and interpretable automated assessment of second-language (L2) speech remains a central challenge, as large speech-language models (SpeechLLMs) often struggle to align with the nuanced variability of human raters. To address this,…

Computation and Language · Computer Science 2026-03-19 Aditya Kamlesh Parikh , Cristian Tejedor-Garcia , Catia Cucchiarini , Helmer Strik

In the era of big data, many big organizations are integrating machine learning into their work pipelines to facilitate data analysis. However, the performance of their trained models is often restricted by limited and imbalanced data…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Jiaying Zhou , Jie Ding , Yi Zhou

General-purpose ASR underperforms for atypical speakers, such as L2 learners, reinforcing bias and limiting use in education and accessibility. Using the CEFR-graded Speak and Improve corpus, we show that naive fine-tuning of Whisper…

Sound · Computer Science 2025-10-14 Ling Sun , Charlotte Zhu , Shuju Shi

The pre-trained BERT model achieves a remarkable state of the art across a wide range of tasks in natural language processing. For solving the gender bias in gendered pronoun resolution task, I propose a novel neural network model based on…

Computation and Language · Computer Science 2019-08-02 Zili Wang

Automatic pronunciation evaluation plays an important role in pronunciation training and second language education. This field draws heavily on concepts from automatic speech recognition (ASR) to quantify how close the pronunciation of…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-06 Ming Tu , Anna Grabek , Julie Liss , Visar Berisha