English
Related papers

Related papers: Adaptive Random Fourier Features Training Stabiliz…

200 papers

In this work, a method of random parameters generation for randomized learning of a single-hidden-layer feedforward neural network is proposed. The method firstly, randomly selects the slope angles of the hidden neurons activation functions…

Machine Learning · Computer Science 2019-08-16 Grzegorz Dudek

Recent studies reveal that Convolutional Neural Networks (CNNs) are typically vulnerable to adversarial attacks, which pose a threat to security-sensitive applications. Many adversarial defense methods improve robustness at the cost of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Tao Wang , Ruixin Zhang , Xingyu Chen , Kai Zhao , Xiaolin Huang , Yuge Huang , Shaoxin Li , Jilin Li , Feiyue Huang

In continual learning, networks confront a trade-off between stability and plasticity when trained on a sequence of tasks. To bolster plasticity without sacrificing stability, we propose a novel training algorithm called LRFR. This approach…

Machine Learning · Computer Science 2023-12-15 Zhenrong Liu , Yang Li , Yi Gong , Yik-Chung Wu

Random Fourier features is a widely used, simple, and effective technique for scaling up kernel methods. The existing theoretical analysis of the approach, however, remains focused on specific learning tasks and typically gives pessimistic…

Machine Learning · Statistics 2021-02-08 Zhu Li , Jean-Francois Ton , Dino Oglic , Dino Sejdinovic

In this paper, we propose a fast surrogate leverage weighted sampling strategy to generate refined random Fourier features for kernel approximation. Compared to the current state-of-the-art method that uses the leverage weighted scheme…

Machine Learning · Computer Science 2019-11-22 Fanghui Liu , Xiaolin Huang , Yudong Chen , Jie Yang , Johan A. K. Suykens

Finite-rate-of-innovation (FRI) signals are ubiquitous in applications such as radar, ultrasound, and time of flight imaging. Due to their finite degrees of freedom, FRI signals can be sampled at sub-Nyquist rates using appropriate sampling…

Signal Processing · Electrical Eng. & Systems 2021-07-02 Satish Mulleti , Haiyang Zhang , Yonina C. Eldar

In this study, we focus on the training process and inference improvements of deep neural networks (DNNs), specifically Autoencoders (AEs) and Variational Autoencoders (VAEs), using Random Fourier Transformation (RFT). We further explore…

Machine Learning · Computer Science 2026-02-26 Ata Akbari Asanjan , Milad Memarzadeh , Bryan Matthews , Nikunj Oza

Random Forests (RF) is one of the algorithms of choice in many supervised learning applications, be it classification or regression. The appeal of such tree-ensemble methods comes from a combination of several characteristics: a remarkable…

Machine Learning · Statistics 2020-05-18 Jaouad Mourtada , Stéphane Gaïffas , Erwan Scornet

We propose rectified factor networks (RFNs) to efficiently construct very sparse, non-linear, high-dimensional representations of the input. RFN models identify rare and small events in the input, have a low interference between code units,…

Machine Learning · Computer Science 2018-01-31 Djork-Arné Clevert , Andreas Mayr , Thomas Unterthiner , Sepp Hochreiter

We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Johanna P. Müller , Bernhard Kainz

Nonlinear sparse sensing (NSS) techniques have been adopted for realizing compressive sensing (CS) in many applications such as Radar imaging and sparse channel estimation. Unlike the NSS, in this paper, we propose an adaptive sparse…

Information Theory · Computer Science 2014-07-24 Guan Gui , Li Xu , Xiao-mei Zhu , Zhang-xin Chen

A novel image matching method is proposed that utilizes learned features extracted by an off-the-shelf deep neural network to obtain a promising performance. The proposed method uses pre-trained VGG architecture as a feature extractor and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Ufuk Efe , Kutalmis Gokalp Ince , A. Aydin Alatan

Non-stationary signals are ubiquitous in real life. Many techniques have been proposed in the last decades which allow decomposing multi-component signals into simple oscillatory mono-components, like the groundbreaking Empirical Mode…

Numerical Analysis · Mathematics 2024-01-30 Giovanni Barbarino , Antonio Cicone

The distributed adaptive signal fusion (DASF) framework allows to solve spatial filtering optimization problems in a distributed and adaptive fashion over a bandwidth-constrained wireless sensor network. The DASF algorithm requires each…

Signal Processing · Electrical Eng. & Systems 2025-05-02 Cem Ates Musluoglu , Alexander Bertrand

In asymmetric retrieval systems, models with different capacities are deployed on platforms with different computational and storage resources. Despite the great progress, existing approaches still suffer from a dilemma between retrieval…

Image and Video Processing · Electrical Eng. & Systems 2024-03-04 Hui Wu , Min Wang , Wengang Zhou , Zhenbo Lu , Houqiang Li

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Purpose: To propose an alternating learning approach to learn the sampling pattern (SP) and the parameters of variational networks (VN) in accelerated parallel magnetic resonance imaging (MRI). Methods: The approach alternates between…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Marcelo V. W. Zibetti , Florian Knoll , Ravinder R. Regatte

Machine learning applied to computer vision and signal processing is achieving results comparable to the human brain on specific tasks due to the great improvements brought by the deep neural networks (DNN). The majority of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 José Augusto Stuchi , Levy Boccato , Romis Attux

The rapid proliferation of wireless devices makes robust identity authentication essential. Radio Frequency Fingerprinting (RFF) exploits device-specific, hard-to-forge physical-layer impairments for identification, and is promising for IoT…

Signal Processing · Electrical Eng. & Systems 2026-01-07 Rundong Jiang , Jun Hu , Yunqi Song , Zhiyuan Xie , Shiyou Xu

In this paper a sublinear time algorithm is presented for the reconstruction of functions that can be represented by just few out of a potentially large candidate set of Fourier basis functions in high spatial dimensions, a so-called…

Numerical Analysis · Mathematics 2020-06-24 Lutz Kämmerer , Felix Krahmer , Toni Volkmer
‹ Prev 1 4 5 6 7 8 10 Next ›