English
Related papers

Related papers: Pre-Trained Foundation Model representations to un…

200 papers

Interactions between the brain and body are of fundamental importance for human behavior and health. Functional magnetic resonance imaging (fMRI) captures whole-brain activity noninvasively, and modeling how fMRI signals interact with…

Respiratory diseases remain major global health challenges, and traditional auscultation is often limited by subjectivity, environmental noise, and inter-clinician variability. This study presents an explainable multimodal deep learning…

Sound · Computer Science 2025-12-02 S M Asiful Islam Saky , Md Rashidul Islam , Md Saiful Arefin , Shahaba Alam

Self-supervised pre-training could effectively improve the performance of low-resource automatic speech recognition (ASR). However, existing self-supervised pre-training are task-agnostic, i.e., could be applied to various downstream tasks.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-20 Han Zhu , Li Wang , Jindong Wang , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

The recent resurgence of interest in spatio-temporal neural network as speech recognition tool motivates the present investigation. In this paper an approach was developed based on temporal radial basis function "TRBF" looking to many…

Computation and Language · Computer Science 2009-12-22 Mustapha Guezouri , Larbi Mesbahi , Abdelkader Benyettou

In end-to-end automatic speech recognition system, one of the difficulties for language expansion is the limited paired speech and text training data. In this paper, we propose a novel method to generate augmented samples with unpaired…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-01 Eric Sun , Jinyu Li , Jian Xue , Yifan Gong

Wav2vec 2.0 is a recently proposed self-supervised framework for speech representation learning. It follows a two-stage training process of pre-training and fine-tuning, and performs well in speech recognition tasks especially ultra-low…

Sound · Computer Science 2021-01-15 Zhiyun Fan , Meng Li , Shiyu Zhou , Bo Xu

We aim at improving spoken language modeling (LM) using very large amount of automatically transcribed speech. We leverage the INA (French National Audiovisual Institute) collection and obtain 19GB of text after applying ASR on 350,000…

Computation and Language · Computer Science 2022-07-06 Valentin Pelloin , Franck Dary , Nicolas Herve , Benoit Favre , Nathalie Camelin , Antoine Laurent , Laurent Besacier

Automating radiology report generation with Large Vision-Language Models (LVLMs) holds great potential, yet these models often produce clinically critical hallucinations, posing serious risks. Existing hallucination detection methods…

Computation and Language · Computer Science 2025-10-28 Alois Thomas , Maya Varma , Jean-Benoit Delbrouck , Curtis P. Langlotz

Transfer learning using latent representations from pre-trained speech models achieves outstanding performance in tasks where labeled data is scarce. However, their applicability to non-speech data and the specific acoustic properties…

Self-supervised pre-trained models such as Wav2vec2, Hubert, and WavLM have been shown to significantly improve many speech tasks. However, their large memory and strong computational requirements hinder their industrial applicability.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-08 Haoyu Wang , Siyuan Wang , Wei-Qiang Zhang , Hongbin Suo , Yulong Wan

Pretraining data has a direct impact on the behaviors and quality of language models (LMs), but we only understand the most basic principles of this relationship. While most work focuses on pretraining data's effect on downstream task…

Computation and Language · Computer Science 2025-04-18 Jack Merullo , Noah A. Smith , Sarah Wiegreffe , Yanai Elazar

Visual Speech Recognition (VSR) differs from the common perception tasks as it requires deeper reasoning over the video sequence, even by human experts. Despite the recent advances in VSR, current approaches rely on labeled data to fully…

Pre-trained models have demonstrated exceptional generalization capabilities in time-series forecasting; however, adapting them to evolving data distributions remains a significant challenge. A key hurdle lies in accessing the original…

Machine Learning · Computer Science 2025-11-18 Tianyi Yin , Jingwei Wang , Chenze Wang , Han Wang , Jiexuan Cai , Min Liu , Yunlong Ma , Kun Gao , Yuting Song , Weiming Shen

Real-time magnetic resonance imaging (RT-MRI) of human speech production is enabling significant advances in speech science, linguistics, bio-inspired speech technology development, and clinical applications. Easy access to RT-MRI is…

With the development of computer -systems that can collect and analyze enormous volumes of data, the medical profession is establishing several non-invasive tools. This work attempts to develop a non-invasive technique for identifying…

Sound · Computer Science 2023-03-16 Hafsa Gulzar , Jiyun Li , Arslan Manzoor , Sadaf Rehmat , Usman Amjad , Hadiqa Jalil Khan

With the widespread use of telemedicine services, automatic assessment of health conditions via telephone speech can significantly impact public health. This work summarizes our preliminary findings on automatic detection of respiratory…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-19 Meemnur Rashid , Kaisar Ahmed Alman , Khaled Hasan , John H. L. Hansen , Taufiq Hasan

Preschool evaluation is crucial because it gives teachers and parents influential knowledge about children's growth and development. The COVID-19 pandemic has highlighted the necessity of online assessment for preschool children. One of the…

Computation and Language · Computer Science 2023-08-25 Amirhossein Abaskohi , Fatemeh Mortazavi , Hadi Moradi

Cardiorespiratory fitness is an established predictor of metabolic disease and mortality. Fitness is directly measured as maximal oxygen consumption (VO$_{2}max$), or indirectly assessed using heart rate responses to standard exercise…

Machine Learning · Computer Science 2023-08-28 Dimitris Spathis , Ignacio Perez-Pozuelo , Tomas I. Gonzales , Yu Wu , Soren Brage , Nicholas Wareham , Cecilia Mascolo

Recently, remote respiratory rate measurement techniques gained much attention as they were developed to overcome the limitations of device-based classical methods and manual counting. Many approaches for RR extraction from the video stream…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Petro Franchuk , Tetiana Yezerska

Automatic pronunciation evaluation plays an important role in pronunciation training and second language education. This field draws heavily on concepts from automatic speech recognition (ASR) to quantify how close the pronunciation of…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-06 Ming Tu , Anna Grabek , Julie Liss , Visar Berisha