English
Related papers

Related papers: Parameter-Efficient Transfer Learning under Federa…

200 papers

Speech recognition and speech synthesis models are typically trained separately, each with its own set of learning objectives, training data, and model parameters, resulting in two distinct large networks. We propose a parameter-efficient…

Computation and Language · Computer Science 2024-10-25 Hawau Olamide Toyin , Hao Li , Hanan Aldarmaki

Personalized federated learning is extensively utilized in scenarios characterized by data heterogeneity, facilitating more efficient and automated local training on data-owning terminals. This includes the automated selection of…

Machine Learning · Computer Science 2025-04-29 Chuanyin Wang , Yifei Zhang , Neng Gao , Qiang Luo

Alongside acoustic information, linguistic features based on speech transcripts have been proven useful in Speech Emotion Recognition (SER). However, due to the scarcity of emotion labelled data and the difficulty of recognizing emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Yuanchao Li , Peter Bell , Catherine Lai

In the expanding field of machine learning, federated learning has emerged as a pivotal methodology for distributed data environments, ensuring privacy while leveraging decentralized data sources. However, the heterogeneity of client data…

Machine Learning · Computer Science 2025-01-28 Alice Smith , Bob Johnson , Michael Geller

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

In the evolving landscape of recommender systems, the challenge of effectively conducting privacy-preserving Cross-Domain Recommendation (CDR), especially under strict non-overlapping constraints, has emerged as a key focus. Despite…

Information Retrieval · Computer Science 2025-04-01 Ziang Lu , Lei Guo , Xu Yu , Zhiyong Cheng , Xiaohui Han , Lei Zhu

With the growing attention on data privacy and communication security in face recognition applications, federated learning has been introduced to learn a face recognition model with decentralized datasets in a privacy-preserving manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Di Qiu , Xinyang Lin , Kaiye Wang , Xiangxiang Chu , Pengfei Yan

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

Machine Learning · Computer Science 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

Federated learning is a common method for privacy-preserving training of machine learning models. In this paper, we analyze the vulnerability of ASR models to attribute inference attacks in the federated setting. We test a non-parametric…

Computation and Language · Computer Science 2025-10-16 Hamdan Al-Ali , Ali Reza Ghavamipour , Tommaso Caselli , Fatih Turkmen , Zeerak Talat , Hanan Aldarmaki

Automatic recognition of disordered and elderly speech remains highly challenging tasks to date due to data scarcity. Parameter fine-tuning is often used to exploit the large quantities of non-aged and healthy speech pre-trained models,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Tianzi Wang , Shoukang Hu , Jiajun Deng , Zengrui Jin , Mengzhe Geng , Yi Wang , Helen Meng , Xunying Liu

In this work, we devise a parameter-efficient solution to bring differential privacy (DP) guarantees into adaptation of a cross-lingual speech classifier. We investigate a new frozen pre-trained adaptation framework for DP-preserving speech…

Sound · Computer Science 2023-08-28 Chun-Wei Ho , Chao-Han Huck Yang , Sabato Marco Siniscalchi

End-to-End automatic speech recognition (ASR) models aim to learn a generalised speech representation to perform recognition. In this domain there is little research to analyse internal representation dependencies and their relationship to…

Computation and Language · Computer Science 2022-11-04 Anna Ollerenshaw , Md Asif Jalal , Thomas Hain

This paper presents a study on the use of federated learning to train an ASR model based on a wav2vec 2.0 model pre-trained by self supervision. Carried out on the well-known TED-LIUM 3 dataset, our experiments show that such a model can…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-22 Tuan Nguyen , Salima Mdhaffar , Natalia Tomashenko , Jean-François Bonastre , Yannick Estève

We propose a self-speaker adaptation method for streaming multi-talker automatic speech recognition (ASR) that eliminates the need for explicit speaker queries. Unlike conventional approaches requiring target speaker embeddings or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Weiqing Wang , Taejin Park , Ivan Medennikov , Jinhan Wang , Kunal Dhawan , He Huang , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

Training automatic speech recognition (ASR) models increasingly relies on decentralized federated learning to ensure data privacy and accessibility, producing multiple local models that require effective merging. In hybrid ASR systems,…

Computation and Language · Computer Science 2026-03-06 Mengze Hong , Yi Gu , Di Jiang , Hanlin Gu , Chen Jason Zhang , Lu Wang , Zhiyang Su

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

Computation and Language · Computer Science 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

Automatic speech recognition (ASR) is a relevant area in multiple settings because it provides a natural communication mechanism between applications and users. ASRs often fail in environments that use language specific to particular…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Rafael Viana-Cámara , Mario Campos-Soberanis , Diego Campos-Sobrino

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia

Automatic speech recognition (ASR) has reached a level of accuracy in recent years, that even outperforms humans in transcribing speech to text. Nevertheless, all current ASR approaches show a certain weakness against ambient noise. To…

Sound · Computer Science 2023-12-22 Christopher Simic , Tobias Bocklet
‹ Prev 1 4 5 6 7 8 10 Next ›