English
Related papers

Related papers: Learning Sparse Wavelet Representations

200 papers

Data is said to follow the transform (or analysis) sparsity model if it becomes sparse when acted on by a linear operator called a sparsifying transform. Several algorithms have been designed to learn such a transform directly from data,…

Machine Learning · Statistics 2019-01-30 Luke Pfister , Yoram Bresler

In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two…

Numerical Analysis · Mathematics 2018-01-03 Zichao Long , Yiping Lu , Xianzhong Ma , Bin Dong

Raw waveform acoustic modelling has recently gained interest due to neural networks' ability to learn feature extraction, and the potential for finding better representations for a given scenario than hand-crafted features. SincNet has been…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-01 Joachim Fainberg , Ondřej Klejch , Erfan Loweimi , Peter Bell , Steve Renals

Deep learning is progressively gaining popularity as a viable alternative to i-vectors for speaker recognition. Promising results have been recently obtained with Convolutional Neural Networks (CNNs) when fed by raw speech samples directly.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio

We present a novel method for predicting accurate depths from monocular images with high efficiency. This optimal efficiency is achieved by exploiting wavelet decomposition, which is integrated in a fully differentiable encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Michaël Ramamonjisoa , Michael Firman , Jamie Watson , Vincent Lepetit , Daniyar Turmukhambetov

The use of deep learning for radio modulation recognition has become prevalent in recent years. This approach automatically extracts high-dimensional features from large datasets, facilitating the accurate classification of modulation…

Machine Learning · Computer Science 2023-11-08 Tao Chen , Shilian Zheng , Kunfeng Qiu , Luxin Zhang , Qi Xuan , Xiaoniu Yang

This paper introduces a meta-learning approach for parameterized pseudo-differential operators with deep neural networks. With the help of the nonstandard wavelet form, the pseudo-differential operators can be approximated in a compressed…

Numerical Analysis · Mathematics 2020-02-26 Jordi Feliu-Faba , Yuwei Fan , Lexing Ying

Conventionally, convolutional neural networks (CNNs) process different images with the same set of filters. However, the variations in images pose a challenge to this fashion. In this paper, we propose to generate sample-specific filters…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Wei Shen , Rujie Liu

The wavelet scattering transform creates geometric invariants and deformation stability. In multiple signal domains, it has been shown to yield more discriminative representations compared to other non-learned representations and to…

Various sources have reported the WaveNet deep learning architecture being able to generate high-quality speech, but to our knowledge there haven't been studies on the interpretation or visualization of trained WaveNets. This study…

Sound · Computer Science 2018-02-26 Kanru Hua

The Easy Path Wavelet Transform is an adaptive transform for bivariate functions (in particular natural images) which has been proposed in [1]. It provides a sparse representation by finding a path in the domain of the function leveraging…

Information Theory · Computer Science 2017-02-16 Renato Budinich

Speech recognition from raw waveform involves learning the spectral decomposition of the signal in the first layer of the neural acoustic model using a convolution layer. In this work, we propose a raw waveform convolutional filter learning…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-22 Purvi Agrawal , Sriram Ganapathy

Image Representation learning via input reconstruction is a common technique in machine learning for generating representations that can be effectively utilized by arbitrary downstream tasks. A well-established approach is using…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Raoof HojatJalali , Edmondo Trentin

We introduce a fully spectral learning framework that eliminates traditional neural layers by operating entirely in the wavelet domain. The model applies learnable nonlinear transformations, including soft-thresholding and gain-phase…

Machine Learning · Computer Science 2025-07-29 Andrew Kiruluta

Convolutional Networks (ConvNets) have recently improved image recognition performance thanks to end-to-end learning of deep feed-forward models from raw pixels. Deep learning is a marked departure from the previous state of the art, the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-24 Albert Gordo , Adrien Gaidon , Florent Perronnin

Pooling is a simple but essential layer in modern deep CNN architectures for feature aggregation and extraction. Typical CNN design focuses on the conv layers and activation functions, while leaving the pooling layers with fewer options. We…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Bor-Shiun Wang , Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Lipeng Ke , Siwei Lyu

A general machine learning architecture is introduced that uses wavelet scattering coefficients of an inputted three dimensional signal as features. Solid harmonic wavelet scattering transforms of three dimensional signals were previously…

Computational Physics · Physics 2019-01-30 Xavier Brumwell , Paul Sinz , Kwang Jin Kim , Yue Qi , Matthew Hirn

Currently, most speech processing techniques use magnitude spectrograms as front-end and are therefore by default discarding part of the signal: the phase. In order to overcome this limitation, we propose an end-to-end learning method for…

Sound · Computer Science 2018-02-01 Dario Rethage , Jordi Pons , Xavier Serra

Sequential recommendation has garnered significant attention for its ability to capture dynamic preferences by mining users' historical interaction data. Given that users' complex and intertwined periodic preferences are difficult to…

Information Retrieval · Computer Science 2025-11-27 Huayang Xu , Huanhuan Yuan , Guanfeng Liu , Junhua Fang , Lei Zhao , Pengpeng Zhao

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio