Hardware Architecture · Computer Science
A Quantitative Evaluation of Approximate Softmax Functions for Deep Neural Networks
Anthony Leiva-Valverde, Fabricio Elizondo-Fernández, Luis G. León-Vega, Cristina Meinhardt +1
2026-04-09
Hardware Architecture · Computer Science
Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers
Jacob R. Stevens, Rangharajan Venkatesan, Steve Dai, Brucek Khailany +1
2021-03-18
Emerging Technologies · Computer Science
Bias-Scalable Near-Memory CMOS Analog Processor for Machine Learning
Pratik Kumar, Ankita Nandi, Shantanu Chakrabartty, Chetan Singh Thakur
2023-01-05
Applied Physics · Physics
A CMOS+X Spiking Neuron With On-Chip Machine Learning
Steven Louis, Matthew Blake Abramson, Hannah Bradley, Cody Trevillian +7
2025-12-05
Machine Learning · Computer Science
BAPS: A Fine-Grained Low-Precision Scheme for Softmax in Attention via Block-Aware Precision reScaling
Zisheng Ye, Xiaoyu He, Maoyuan Song, Guoliang Qiu +9
2026-02-03
Computer Vision and Pattern Recognition · Computer Science
Rethinking Efficacy of Softmax for Lightweight Non-Local Neural Networks
Yooshin Cho, Youngsoo Kim, Hanbyel Cho, Jaesung Ahn +2
2022-07-28
Machine Learning · Computer Science
Sparse-softmax: A Simpler and Faster Alternative Softmax Transformation
Shaoshi Sun, Zhenyuan Zhang, BoCheng Huang, Pengbin Lei +3
2021-12-24
Cryptography and Security · Computer Science
Fast and Accurate Homomorphic Softmax Evaluation
Wonhee Cho, Guillaume Hanrot, Taeseong Kim, Minje Park +1
2024-10-16
Emerging Technologies · Computer Science
MRAM-based Analog Sigmoid Function for In-memory Computing
Md Hasibul Amin, Mohammed Elbtity, Mohammadreza Mohammadi, Ramtin Zand
2022-06-10
Mathematical Software · Computer Science
Softmax Optimizations for Intel Xeon Processor-based Platforms
Jacek Czaja, Michal Gallus, Tomasz Patejko, Jian Tang
2019-05-28
Machine Learning · Computer Science
BSL: Understanding and Improving Softmax Loss for Recommendation
Junkang Wu, Jiawei Chen, Jiancan Wu, Wentao Shi +2
2023-12-21
Computation and Language · Computer Science
Real-time Neural-based Input Method
Jiali Yao, Raphael Shu, Xinjian Li, Katsutoshi Ohtsuki +1
2018-10-23
Emerging Technologies · Computer Science
Approximate MRAM: High-performance and Power-efficient Computing with MRAM Chips for Error-tolerant Applications
Farah Ferdaus, B. M. S. Bahar Talukder, Md Tauhidur Rahman
2022-05-24
Hardware Architecture · Computer Science
A Cycle-Accurate Soft Error Vulnerability Analysis Framework for FPGA-based Designs
Eduardo Rhod, Behnam Ghavami, Zhenman Fang, Lesley Shannon
2023-03-23
Machine Learning · Computer Science
Softmax Bias Correction for Quantized Generative Models
Nilesh Prasad Pandey, Marios Fournarakis, Chirag Patel, Markus Nagel
2023-09-06
Emerging Technologies · Computer Science
Fuse and Mix: MACAM-Enabled Analog Activation for Energy-Efficient Neural Acceleration
Hanqing Zhu, Keren Zhu, Jiaqi Gu, Harrison Jin +3
2022-08-18