English
Related papers

Related papers: Learning Multiscale Features Directly From Wavefor…

200 papers

Dictionary learning algorithms or supervised deep convolution networks have considerably improved the efficiency of predefined feature representations such as SIFT. We introduce a deep scattering convolution network, with predefined wavelet…

Computer Vision and Pattern Recognition · Computer Science 2015-06-02 Edouard Oyallon , Stéphane Mallat

Recently, intermediate feature maps of pre-trained convolutional neural networks have shown significant perceptual quality improvements, when they are used in the loss function for training new networks. It is believed that these features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Taimoor Tariq , Okan Tarhan Tursun , Munchurl Kim , Piotr Didyk

This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the…

Sound · Computer Science 2022-04-13 Changsheng Quan , Xiaofei Li

Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction. This is due to the difficulty of estimating the phase of…

Sound · Computer Science 2019-04-03 Hyeong-Seok Choi , Jang-Hyun Kim , Jaesung Huh , Adrian Kim , Jung-Woo Ha , Kyogu Lee

This paper addresses the reconstruction of audio signals from degraded measurements. We propose a lightweight model that combines the discrete Fourier transform with a Convolutional Autoencoder (FFT-ConvAE), which enabled our team to…

Sound · Computer Science 2025-11-14 Pu-Yun Kow , Pu-Zhao Kow

End-to-end speech recognition generally uses hand-engineered acoustic features as input and excludes the feature extraction module from its joint optimization. To extract learnable and adaptive features and mitigate information loss, we…

Sound · Computer Science 2021-06-09 Max W. Y. Lam , Jun Wang , Chao Weng , Dan Su , Dong Yu

Deploying speech enhancement (SE) systems in wearable devices, such as smart glasses, is challenging due to the limited computational resources on the device. Although deep learning methods have achieved high-quality results, their…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Heitor R. Guimarães , Ke Tan , Juan Azcarreta , Jesus Alvarez , Prabhav Agrawal , Ashutosh Pandey , Buye Xu

The key challenge of face recognition is to develop effective feature representations for reducing intra-personal variations while enlarging inter-personal differences. In this paper, we show that it can be well solved with deep learning…

Computer Vision and Pattern Recognition · Computer Science 2014-06-19 Yi Sun , Xiaogang Wang , Xiaoou Tang

This paper proposes a novel deep subspace clustering approach which uses convolutional autoencoders to transform input images into new representations lying on a union of linear subspaces. The first contribution of our work is to insert…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mohsen Kheirandishfard , Fariba Zohrizadeh , Farhad Kamangar

The SepFormer architecture shows very good results in speech separation. Like other learned-encoder models, it uses short frames, as they have been shown to obtain better performance in these cases. This results in a large number of frames…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Danilo de Oliveira , Tal Peer , Timo Gerkmann

Transformers have become central to recent advances in audio classification. However, training an audio spectrogram transformer, e.g. AST, from scratch can be resource and time-intensive. Furthermore, the complexity of transformers heavily…

Sound · Computer Science 2024-01-17 Jiu Feng , Mehmet Hamza Erol , Joon Son Chung , Arda Senocak

Most current speech enhancement models use spectrogram features that require an expensive transformation and result in phase information loss. Previous work has overcome these issues by using convolutional networks to learn long-range…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-17 Jalal Abdulbaqi , Yue Gu , Ivan Marsic

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Source separation and other audio applications have traditionally relied on the use of short-time Fourier transforms as a front-end frequency domain representation step. The unavailability of a neural network equivalent to forward and…

Sound · Computer Science 2017-11-01 Shrikant Venkataramani , Jonah Casebeer , Paris Smaragdis

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Understanding the effect of depth in deep learning is a critical problem. In this work, we utilize the Fourier analysis to empirically provide a promising mechanism to understand why feedforward deeper learning is faster. To this end, we…

Machine Learning · Computer Science 2020-12-22 Zhi-Qin John Xu , Hanxu Zhou

Deep audio classification, traditionally cast as training a deep neural network on top of mel-filterbanks in a supervised fashion, has recently benefited from two independent lines of work. The first one explores "learnable frontends",…

Sound · Computer Science 2022-03-30 Sarthak Yadav , Neil Zeghidour

We start out by demonstrating that an elementary learning task, corresponding to the training of a single linear neuron in a convolutional neural network, can be solved for feature spaces of very high dimensionality. In a second step,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Marco Loog , François Lauze

We demonstrate the use of deep learning for fast spectral deconstruction of speckle patterns. The artificial neural network can be effectively trained using numerically constructed multispectral datasets taken from a measured spectral…

Image and Video Processing · Electrical Eng. & Systems 2019-07-16 Ulas Kürüm , P. R. Wiecha , Rebecca French , Otto L. Muskens

While Deep Learning has demonstrated impressive results in applications on various data types, it continues to lag behind tree-based methods when applied to tabular data, often referred to as the last "unconquered castle" for neural…

Machine Learning · Computer Science 2026-02-27 Marius Dragoi , Florin Gogianu , Elena Burceanu