English
Related papers

Related papers: Frequency and Generalisation of Periodic Activatio…

200 papers

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation functions. Various new activation functions and improvements on…

Machine Learning · Computer Science 2019-08-27 Yang Liu , Jianpeng Zhang , Chao Gao , Jinghua Qu , Lixin Ji

Generalizability of Reinforcement Learning (RL) agents (ability to perform on environments different from the ones they have been trained on) is a key problem as agents have the tendency to overfit to their training environments. In order…

Machine Learning · Computer Science 2025-11-26 Olivier Moulin , Vincent Francois-lavet , Paul Elbers , Mark Hoogendoorn

One of the key challenges of deep learning based image retrieval remains in aggregating convolutional activations into one highly representative feature vector. Ideally, this descriptor should encode semantic, spatial and low level…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Many important tasks are defined in terms of object. To generalize across these tasks, a reinforcement learning (RL) agent needs to exploit the structure that the objects induce. Prior work has either hard-coded object-centric features,…

Machine Learning · Computer Science 2023-11-06 Wilka Carvalho , Andrew Lampinen , Kyriacos Nikiforou , Felix Hill , Murray Shanahan

It is widely believed that the success of deep networks lies in their ability to learn a meaningful representation of the features of the data. Yet, understanding when and how this feature learning improves performance remains a challenge:…

Machine Learning · Statistics 2022-10-13 Leonardo Petrini , Francesco Cagnetta , Eric Vanden-Eijnden , Matthieu Wyart

A key challenge facing deep learning is that neural networks are often not robust to shifts in the underlying data distribution. We study this problem from the perspective of the statistical concept of parameter identification.…

Machine Learning · Computer Science 2022-02-18 Kan Xu , Hamsa Bastani , Osbert Bastani

Deep reinforcement-learning methods have achieved remarkable performance on challenging control tasks. Observations of the resulting behavior give the impression that the agent has constructed a generalized representation that supports…

Machine Learning · Computer Science 2018-12-12 Sam Witty , Jun Ki Lee , Emma Tosch , Akanksha Atrey , Michael Littman , David Jensen

We provide new theoretical insights on why over-parametrization is effective in learning neural networks. For a $k$ hidden node shallow network with quadratic activation and $n$ training data points, we show as long as $ k \ge \sqrt{2n}$,…

Machine Learning · Computer Science 2018-06-18 Simon S. Du , Jason D. Lee

Understanding the effect of depth in deep learning is a critical problem. In this work, we utilize the Fourier analysis to empirically provide a promising mechanism to understand why feedforward deeper learning is faster. To this end, we…

Machine Learning · Computer Science 2020-12-22 Zhi-Qin John Xu , Hanxu Zhou

The ability to learn continually is essential in a complex and changing world. In this paper, we characterize the behavior of canonical value-based deep reinforcement learning (RL) approaches under varying degrees of non-stationarity. In…

Machine Learning · Computer Science 2023-03-15 Zaheer Abbas , Rosie Zhao , Joseph Modayil , Adam White , Marlos C. Machado

In this paper we investigate the performance of different types of rectified activation functions in convolutional neural network: standard rectified linear unit (ReLU), leaky rectified linear unit (Leaky ReLU), parametric rectified linear…

Machine Learning · Computer Science 2015-11-30 Bing Xu , Naiyan Wang , Tianqi Chen , Mu Li

Fourier-encoded implicit neural representations (INRs) have shown strong capability in modeling continuous signals from discrete samples. However, conventional Fourier feature mappings use a fixed set of frequencies over the entire spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ligen Shi , Jun Qiu , Yuhang Zheng , Zengyu Pang , Chang Liu

Using weight decay to penalize the L2 norms of weights in neural networks has been a standard training practice to regularize the complexity of networks. In this paper, we show that a family of regularizers, including weight decay, is…

Machine Learning · Computer Science 2022-06-09 Ziquan Liu , Yufei Cui , Antoni B. Chan

Feature representations derived from models pre-trained on large-scale datasets have shown their generalizability on a variety of audio analysis tasks. Despite this generalizability, however, task-specific features can outperform if…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-13 Yun-Ning Hung , Alexander Lerch

In this brief we investigate the generalization properties of a recently-proposed class of non-parametric activation functions, the kernel activation functions (KAFs). KAFs introduce additional parameters in the learning process in order to…

Machine Learning · Statistics 2019-03-29 Michele Cirillo , Simone Scardapane , Steven Van Vaerenbergh , Aurelio Uncini

Over the past few years, there has been a significant amount of research focused on studying the ReLU activation function, with the aim of achieving neural network convergence through over-parametrization. However, recent developments in…

Machine Learning · Computer Science 2023-03-30 Yeqi Gao , Sridhar Mahadevan , Zhao Song

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

Machine Learning · Computer Science 2018-06-08 Samet Oymak

Regularization is a fundamental technique to prevent over-fitting and to improve generalization performances by constraining a model's complexity. Current Deep Networks heavily rely on regularizers such as Data-Augmentation (DA) or…

Machine Learning · Computer Science 2022-04-12 Randall Balestriero , Leon Bottou , Yann LeCun

Regularization is typically understood as improving generalization by altering the landscape of local extrema to which the model eventually converges. Deep neural networks (DNNs), however, challenge this view: We show that removing…

Machine Learning · Computer Science 2019-06-03 Aditya Golatkar , Alessandro Achille , Stefano Soatto