English
Related papers

Related papers: Transformers without Normalization

200 papers

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

Machine Learning · Computer Science 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

The impressive expressive power of deep neural networks (DNNs) underlies their widespread applicability. However, while the theoretical capacity of deep architectures is high, the practical expressive power achieved through successful…

Machine Learning · Computer Science 2023-12-21 Zezhong Zhang , Feng Bao , Guannan Zhang

The big breakthrough on the ImageNet challenge in 2012 was partially due to the `dropout' technique used to avoid overfitting. Here, we introduce a new approach called `Spectral Dropout' to improve the generalization ability of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Salman Khan , Munawar Hayat , Fatih Porikli

The Transformer model has achieved state-of-the-art performance in many sequence modeling tasks. However, how to leverage model capacity with large or variable depths is still an open challenge. We present a probabilistic framework to…

Computation and Language · Computer Science 2020-10-19 Xian Li , Asa Cooper Stickland , Yuqing Tang , Xiang Kong

The layered structure of deep neural networks hinders the use of numerous analysis tools and thus the development of its interpretability. Inspired by the success of functional brain networks, we propose a novel framework for…

Machine Learning · Computer Science 2022-05-25 Ben Zhang , Zhetong Dong , Junsong Zhang , Hongwei Lin

End-to-end Transformer-based detectors (DETRs) have demonstrated strong detection performance. However, domain generalization (DG) research has primarily focused on convolutional neural network (CNN)-based detectors, while paying little…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Seongmin Hwang , Daeyoung Han , Moongu Jeon

We introduce a transformer-based neural network for the accurate classification of real and bogus transient detections in astronomical images. This network advances beyond the conventional convolutional neural network (CNN) methods, widely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Adi Inada , Masao Sako , Tatiana Acero-Cuellar , Federica Bianco

While behavior learning has made impressive progress in recent times, it lags behind computer vision and natural language processing due to its inability to leverage large, human-generated datasets. Human behaviors have wide variance,…

Machine Learning · Computer Science 2022-10-13 Nur Muhammad Mahi Shafiullah , Zichen Jeff Cui , Ariuntuya Altanzaya , Lerrel Pinto

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Salman Khan , Muzammal Naseer , Munawar Hayat , Syed Waqas Zamir , Fahad Shahbaz Khan , Mubarak Shah

Successfully training deep neural networks often requires either batch normalization, appropriate weight initialization, both of which come with their own challenges. We propose an alternative, geometrically motivated method for training.…

Machine Learning · Computer Science 2019-10-08 Aram-Alexandre Pooladian , Chris Finlay , Adam M Oberman

Dynamic graph modeling is crucial for understanding complex structures in web graphs, spanning applications in social networks, recommender systems, and more. Most existing methods primarily emphasize structural dependencies and their…

Social and Information Networks · Computer Science 2024-02-28 Yuxia Wu , Yuan Fang , Lizi Liao

We propose a novel formulation of deep networks that do not use dot-product neurons and rely on a hierarchy of voting tables instead, denoted as Convolutional Tables (CT), to enable accelerated CPU-based inference. Convolutional layers are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shay Dekel , Yosi Keller , Aharon Bar-Hillel

The Transformer architecture has become increasingly popular over the past two years, owing to its impressive performance on a number of natural language processing (NLP) tasks. However, all Transformer computations occur at the level of…

Machine Learning · Computer Science 2021-04-05 David Donahue , Vladislav Lialin , Anna Rumshisky

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input…

Machine Learning · Computer Science 2023-06-16 Zhongkai Hao , Zhengyi Wang , Hang Su , Chengyang Ying , Yinpeng Dong , Songming Liu , Ze Cheng , Jian Song , Jun Zhu

Modelling dynamical systems is an integral component for understanding the natural world. To this end, neural networks are becoming an increasingly popular candidate owing to their ability to learn complex functions from large amounts of…

Machine Learning · Computer Science 2023-03-13 Sameera Ramasinghe , Hemanth Saratchandran , Violetta Shevchenko , Simon Lucey

Deep learning using multi-layer neural networks (NNs) architecture manifests superb power in modern machine learning systems. The trained Deep Neural Networks (DNNs) are typically large. The question we would like to address is whether it…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Wei Pan , Hao Dong , Yike Guo

We introduce a yat-product-powered neural network, the Neural Matter Network (NMN), a breakthrough in deep learning that achieves non-linear pattern recognition without activation functions. Our key innovation relies on the yat-product and…

Machine Learning · Computer Science 2024-12-03 Taha Bouhsine

We introduce DeepInversion, a new method for synthesizing images from the image distribution used to train a deep neural network. We 'invert' a trained network (teacher) to synthesize class-conditional input images starting from random…

Machine Learning · Computer Science 2020-06-17 Hongxu Yin , Pavlo Molchanov , Zhizhong Li , Jose M. Alvarez , Arun Mallya , Derek Hoiem , Niraj K. Jha , Jan Kautz

With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep…

Permutation invariant neural networks are a promising tool for making predictions from sets. However, we show that existing permutation invariant architectures, Deep Sets and Set Transformer, can suffer from vanishing or exploding gradients…

Machine Learning · Computer Science 2022-07-15 Lily H. Zhang , Veronica Tozzo , John M. Higgins , Rajesh Ranganath