English
Related papers

Related papers: Reduced Softmax Unit for Deep Neural Network Accel…

200 papers

We study the influence of different activation functions in the output layer of deep neural network models for soft and hard label prediction in the learning with disagreement task. In this task, the goal is to quantify the amount of…

Computation and Language · Computer Science 2024-01-05 Peyman Hosseini , Mehran Hosseini , Sana Sabah Al-Azzawi , Marcus Liwicki , Ignacio Castro , Matthew Purver

Faster inference of deep learning models is highly demanded on edge devices and even servers, for both financial and environmental reasons. To address this issue, we propose SoftNeuro, a novel, high-performance inference framework with…

Machine Learning · Computer Science 2021-10-13 Masaki Hilaga , Yasuhiro Kuroda , Hitoshi Matsuo , Tatsuya Kawaguchi , Gabriel Ogawa , Hiroshi Miyake , Yusuke Kozawa

For Deep Neural Networks (DNNs) to become useful in safety-critical applications, such as self-driving cars and disease diagnosis, they must be stable to perturbations in input and model parameters. Characterizing the sensitivity of a DNN…

Machine Learning · Computer Science 2023-07-25 Naman Maheshwari , Nicholas Malaya , Scott Moe , Jaydeep P. Kulkarni , Sudhanva Gurumurthi

We investigate deep morphological neural networks (DMNNs). We demonstrate that despite their inherent non-linearity, "linear" activations are essential for DMNNs. To preserve their inherent sparsity, we propose architectures that constraint…

Machine Learning · Computer Science 2025-12-24 Konstantinos Fotopoulos , Petros Maragos

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Convolutional Neural Networks (CNNs) trained with the Softmax loss are widely used classification models for several vision tasks. Typically, a learnable transformation (i.e. the classifier) is placed at the end of such models returning…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Federico Pernici , Matteo Bruni , Claudio Baecchi , Alberto Del Bimbo

The quadratic computational complexity of softmax transformers has become a bottleneck in long-context scenarios. In contrast, linear attention model families provide a promising direction towards a more efficient sequential model. These…

Computation and Language · Computer Science 2026-02-04 Difan Deng , Andreas Bentzen Winje , Lukas Fehring , Marius Lindauer

To cope with the increasing demand and computational intensity of deep neural networks (DNNs), industry and academia have turned to accelerator technologies. In particular, FPGAs have been shown to provide a good balance between performance…

Hardware Architecture · Computer Science 2018-07-12 Yongming Shen , Tianchu Ji , Michael Ferdman , Peter Milder

We develop a minimax rate analysis to describe the reason that deep neural networks (DNNs) perform better than other standard methods. For nonparametric regression problems, it is well known that many standard methods attain the minimax…

Machine Learning · Statistics 2022-02-09 Masaaki Imaizumi , Kenji Fukumizu

This paper proposes a novel procedure for training an encoder-decoder based deep neural network which compresses NxM models into a single model enabling us to dynamically choose the number of encoder and decoder layers for decoding.…

Computation and Language · Computer Science 2019-08-29 Raj Dabre , Atsushi Fujita

We introduce Dynamic Deep Neural Networks (D2NN), a new type of feed-forward deep neural network that allows selective execution. Given an input, only a subset of D2NN neurons are executed, and the particular subset is determined by the…

Machine Learning · Computer Science 2018-03-06 Lanlan Liu , Jia Deng

There have been significant advancements made by large language models (LLMs) in various aspects of our daily lives. LLMs serve as a transformative force in natural language processing, finding applications in text generation, translation,…

Machine Learning · Computer Science 2023-11-28 Zhihang Li , Zhao Song , Zifan Wang , Junze Yin

The softmax function is crucial in Transformer attention, which normalizes each row of the attention scores with summation to one, achieving superior performances over other alternative functions. However, the softmax function can face a…

Computation and Language · Computer Science 2025-02-26 Chuanyang Zheng , Yihang Gao , Guoxuan Chen , Han Shi , Jing Xiong , Xiaozhe Ren , Chao Huang , Xin Jiang , Zhenguo Li , Yu Li

We propose an efficient and interpretable neural network with a novel activation function called the weighted Lehmer transform. This new activation function enables adaptive feature selection and extends to the complex domain, capturing…

Machine Learning · Computer Science 2025-01-28 Masoud Ataei , Xiaogang Wang

Learning with neural networks relies on the complexity of the representable functions, but more importantly, the particular assignment of typical parameters to functions of different complexity. Taking the number of activation regions as a…

Machine Learning · Statistics 2021-12-17 Hanna Tseran , Guido Montúfar

As Deep Learning continues to drive a variety of applications in edge and cloud data centers, there is a growing trend towards building large accelerators with several sub-accelerator cores/chiplets. This work looks at the problem of…

Hardware Architecture · Computer Science 2022-01-28 Sheng-Chun Kao , Tushar Krishna

In this paper we propose a synergistic melting of neural networks and decision trees (DT) we call neural decision trees (NDT). NDT is an architecture a la decision tree where each splitting node is an independent multilayer perceptron…

Machine Learning · Statistics 2017-03-07 Randall Balestriero

Stripes is a Deep Neural Network (DNN) accelerator that uses bit-serial computation to offer performance that is proportional to the fixed-point precision of the activation values. The fixed-point precisions are determined a priori using…

Neural and Evolutionary Computing · Computer Science 2017-06-05 Alberto Delmas , Patrick Judd , Sayeh Sharify , Andreas Moshovos

We propose DropMax, a stochastic version of softmax classifier which at each iteration drops non-target classes according to dropout probabilities adaptively decided for each instance. Specifically, we overlay binary masking variables over…

Machine Learning · Computer Science 2018-11-05 Hae Beom Lee , Juho Lee , Saehoon Kim , Eunho Yang , Sung Ju Hwang

For many biological image segmentation tasks, including topological knowledge, such as the nesting of classes, can greatly improve results. However, most `out-of-the-box' CNN models are still blind to such prior information. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Marie Piraud , Anjany Sekuboyina , Bjoern H. Menze