English
Related papers

Related papers: Learnable Frontends that do not Learn: Quantifying…

200 papers

Randomly initialized neural networks induce a prior over functions, but the predictor used in practice is produced only after training. We ask how much of this initial bias survives the training pipeline. To make the question measurable, we…

Machine Learning · Computer Science 2026-05-29 Mohua Das , Pierfrancesco Beneventano , Shibshankar Dey , Gareth H. McKinkey , Tomaso Poggio

End-to-end neural network based approaches to audio modelling are generally outperformed by models trained on high-level data representations. In this paper we present preliminary work that shows the feasibility of training the first layers…

Sound · Computer Science 2017-12-04 Tycho Max Sylvester Tax , Jose Luis Diez Antich , Hendrik Purwins , Lars Maaløe

Active noise control (ANC) must adapt quickly when the acoustic environment changes, yet early performance is largely dictated by initialization. We address this with a Model-Agnostic Meta-Learning (MAML) co-initialization that jointly sets…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Ziyi Yang , Li Rao , Zhengding Luo , Dongyuan Shi , Qirui Huang , Woon-Seng Gan

The sensitivity of human ear is dependent on frequency which is nonlinearly resolved across the audio spectrum .Now to improve the recognition performance in a similar non linear approach requires a front -end design, suggested by empirical…

Sound · Computer Science 2012-06-08 Debalina Ghosh , Depanwita Sarkar Debnath , Saikat Bose

In this paper we present first results from a comparative study. Its aim is to test the feasibility of different inductive learning techniques to perform the automatic acquisition of linguistic knowledge within a natural language database…

cmp-lg · Computer Science 2008-02-03 Werner Winiwarter , Yahiko Kambayashi

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

Non-native speakers show difficulties with spoken word processing. Many studies attribute these difficulties to imprecise phonological encoding of words in the lexical memory. We test an alternative hypothesis: that some of these…

Computation and Language · Computer Science 2021-03-12 Yevgen Matusevych , Herman Kamper , Thomas Schatz , Naomi H. Feldman , Sharon Goldwater

Acoustic analyses of infant vocalizations are valuable for research on speech development as well as applications in sound classification. Previous studies have focused on measures of acoustic features based on theories of speech…

Sound · Computer Science 2020-05-27 Mohammad K. Ebrahimpour , Sara Schneider , David C. Noelle , Christopher T. Kello

LoRA adapts large language models (LLMs) by restricting updates to low-rank subspaces of pre-trained weights. While this substantially reduces training cost, the effectiveness of adaptation critically depends on which subspace is chosen at…

Machine Learning · Computer Science 2026-05-28 Zhi-Quan Feng , Ying-Jia Lin , Hung-Yu Kao

Although deep RL models have shown a great potential for solving various types of tasks with minimal supervision, several key challenges remain in terms of learning from limited experience, adapting to environmental changes, and…

Artificial Intelligence · Computer Science 2020-07-10 Dongjae Kim , Jee Hang Lee , Jae Hoon Shin , Minsu Abel Yang , Sang Wan Lee

Learning robust speaker representations under noisy conditions presents significant challenges, which requires careful handling of both discriminative and noise-invariant properties. In this work, we proposed an anchor-based stage-wise…

Sound · Computer Science 2026-01-21 Bin Gu , Lipeng Dai , Huipeng Du , Haitao Zhao , Jibo Wei

Machine learning has the potential to revolutionize passive acoustic monitoring (PAM) for ecological assessments. However, high annotation and compute costs limit the field's efficacy. Generalizable pretrained networks can overcome these…

Readability assessment aims to automatically classify text by the level appropriate for learning readers. Traditional approaches to this task utilize a variety of linguistically motivated features paired with simple machine learning models.…

Computation and Language · Computer Science 2020-08-04 Tovly Deutsch , Masoud Jasbi , Stuart Shieber

Robust and far-field speech recognition is critical to enable true hands-free communication. In far-field conditions, signals are attenuated due to distance. To improve robustness to loudness variation, we introduce a novel frontend called…

Computation and Language · Computer Science 2016-07-20 Yuxuan Wang , Pascal Getreuer , Thad Hughes , Richard F. Lyon , Rif A. Saurous

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

For multi-channel speech recognition, speech enhancement techniques such as denoising or dereverberation are conventionally applied as a front-end processor. Deep learning-based front-ends using such techniques require aligned clean and…

Sound · Computer Science 2020-07-28 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Hyung Yong Kim , Nam Soo Kim

Multi-channel speech enhancement with ad-hoc sensors has been a challenging task. Speech model guided beamforming algorithms are able to recover natural sounding speech, but the speech models tend to be oversimplified or the inference would…

Computation and Language · Computer Science 2018-02-16 Kaizhi Qian , Yang Zhang , Shiyu Chang , Xuesong Yang , Dinei Florencio , Mark Hasegawa-Johnson

Building a good speech recognition system usually requires large amounts of transcribed data, which is expensive to collect. To tackle this problem, many unsupervised pre-training methods have been proposed. Among these methods, Masked…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Dongwei Jiang , Wubo Li , Ruixiong Zhang , Miao Cao , Ne Luo , Yang Han , Wei Zou , Xiangang Li

Level assessment for foreign language students is necessary for putting them in the right level group, furthermore, interviewing students is a very time-consuming task, so we propose to automate the evaluation of speaker fluency level by…

Machine Learning · Statistics 2018-09-03 Alan Preciado-Grijalva , Ramon F. Brena

Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This feat could result from the brain's ability to fine-tune generic sound representations for speech-specific processes. To test this hypothesis, we…

Computation and Language · Computer Science 2021-03-02 Juliette Millet , Jean-Remi King