English
Related papers

Related papers: Lightweight and interpretable neural modeling of a…

200 papers

Self-supervised pre-training using so-called "pretext" tasks has recently shown impressive performance across a wide range of modalities. In this work, we advance self-supervised learning from permutations, by pre-training a model to…

Sound · Computer Science 2021-05-05 Andrew N Carr , Quentin Berthet , Mathieu Blondel , Olivier Teboul , Neil Zeghidour

Direct speech-to-speech translation (S2ST) with discrete units leverages recent progress in speech representation learning. Specifically, a sequence of discrete representations derived in a self-supervised manner are predicted from the…

Computation and Language · Computer Science 2023-03-03 Rongjie Huang , Jinglin Liu , Huadai Liu , Yi Ren , Lichao Zhang , Jinzheng He , Zhou Zhao

Recent studies show that pretrained vision models can boost performance in audio downstream tasks. To enhance the performance further, an additional pretraining stage with large scale audio data is typically required to infuse audio…

Sound · Computer Science 2024-12-10 Juan Yeo , Jinkwan Jang , Kyubyung Chae , Seongkyu Mun , Taesup Kim

In this letter, we study efficient channel estimation and passive beamforming designs for a double-intelligent reflecting surface (IRS) aided single-user communication system, where a user communicates with an access point (AP) via the…

Information Theory · Computer Science 2020-08-27 Changsheng You , Beixiong Zheng , Rui Zhang

Disentangling and recovering physical attributes, such as shape and material, from a few waveform examples is a challenging inverse problem in audio signal processing, with numerous applications in musical acoustics as well as structural…

Sound · Computer Science 2020-07-21 Han Han , Vincent Lostanlen

Room Impulse Responses (RIRs) characterize acoustic environments and are crucial in multiple audio signal processing tasks. High-quality RIR estimates drive applications such as virtual microphones, sound source localization, augmented…

Sound · Computer Science 2025-04-30 Sagi Della Torre , Mirco Pezzoli , Fabio Antonacci , Sharon Gannot

Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision making. When there are tens or hundreds of covariates, it becomes…

Methodology · Statistics 2021-11-23 Qingyuan Zhao , Dylan S. Small , Ashkan Ertefaie

Bilevel optimization aims to optimize an outer objective function that depends on the solution to an inner optimization problem. It is routinely used in Machine Learning, notably for hyperparameter tuning. The conventional method to compute…

Machine Learning · Computer Science 2024-02-27 Zhenzhang Ye , Gabriel Peyré , Daniel Cremers , Pierre Ablin

Neurodevelopmental disorders such as Fragile X Syndrome (FXS) and Autism Spectrum Disorder (ASD) are characterized by disrupted cortical oscillatory activity, particularly in the alpha and gamma frequency bands. These abnormalities are…

Neurons and Cognition · Quantitative Biology 2025-11-14 Zag ElSayed , Grace Westerkamp , Jack Yanchen Liu , Ernest Pedapati

In an attempt to address the need for skilled clinicians in heart sound interpretation, recent research efforts on automating cardiac auscultation have explored deep learning approaches. The majority of these approaches have been based on…

Sound · Computer Science 2025-10-08 Rami Zewail

Sound in noise is better detected or understood if target and masking sources originate from different locations. Mammalian physiology suggests that the neurocomputational process that underlies this binaural unmasking is based on two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Jörg Encke , Mathias Dietz

Music annotation has always been one of the critical topics in the field of Music Information Retrieval (MIR). Traditional models use supervised learning for music annotation tasks. However, as supervised machine learning approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Yilun Zhao , Jia Guo

Model-based design of experiments (MBDOE) is essential for efficient parameter estimation in nonlinear dynamical systems. However, conventional adaptive MBDOE requires costly posterior inference and design optimization between each…

Machine Learning · Statistics 2026-03-25 Arno Strouwen , Sebastian Micluţa-Câmpeanu

Recently, there has been a surge in methodological development for the difference-in-differences (DiD) approach to evaluate causal effects. Standard methods in the literature rely on the parallel trends assumption to identify the average…

Methodology · Statistics 2023-10-17 Pan Zhao , Yifan Cui

Since the evolution of digital computers, the storage of data has always been in terms of discrete bits that can store values of either 1 or 0. Hence, all computer programs (such as MATLAB), convert any input continuous signal into a…

Signal Processing · Electrical Eng. & Systems 2021-05-07 Omkar Deshpande , Kharanshu Solanki , Sree Pujitha Suribhatla , Sanya Zaveri , Luv Ghodasara

Recommender systems are extensively utilised across various areas to predict user preferences for personalised experiences and enhanced user engagement and satisfaction. Traditional recommender systems, however, are complicated by…

Information Retrieval · Computer Science 2024-10-17 Jianfeng Deng , Qingfeng Chen , Debo Cheng , Jiuyong Li , Lin Liu , Xiaojing Du

Room impulse response (RIR) functions capture how the surrounding physical environment transforms the sounds heard by a listener, with implications for various applications in AR, VR, and robotics. Whereas traditional methods to estimate…

Sound · Computer Science 2022-11-28 Sagnik Majumder , Changan Chen , Ziad Al-Halah , Kristen Grauman

Given the great success of Deep Neural Networks(DNNs) and the black-box nature of it,the interpretability of these models becomes an important issue.The majority of previous research works on the post-hoc interpretation of a trained…

Machine Learning · Computer Science 2021-03-22 Haoyang Li , Xinggang Wang

Blind Image Quality Assessment (BIQA) aims to evaluate image quality in line with human perception, without reference benchmarks. Currently, deep learning BIQA methods typically depend on using features from high-level tasks for transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Xudong Li , Jingyuan Zheng , Runze Hu , Yan Zhang , Ke Li , Yunhang Shen , Xiawu Zheng , Yutao Liu , ShengChuan Zhang , Pingyang Dai , Rongrong Ji

Diffusion models have been shown to achieve natural-sounding enhancement of speech degraded by noise or reverberation. However, their simultaneous denoising and dereverberation capability has so far not been studied much, although this is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Adrian Meise , Tobias Cord-Landwehr , Reinhold Haeb-Umbach