English
Related papers

Related papers: Analog Implementation of the Softmax Function

200 papers

As numerical simulations grow in size and complexity, they become increasingly resource-intensive in terms of time and energy. While specialized hardware accelerators often provide order-of-magnitude gains and are state of the art in other…

Neural and Evolutionary Computing · Computer Science 2024-12-04 Hartmut Schmidt , Andreas Grübl , José Montes , Eric Müller , Sebastian Schmitt , Johannes Schemmel

The energy efficiency of analog computing-in-memory (ACIM) accelerator for recurrent neural networks, particularly long short-term memory (LSTM) network, is limited by the high proportion of nonlinear (NL) operations typically executed…

Hardware Architecture · Computer Science 2025-12-09 Junyi Yang , Xinyu Luo , Ye Ke , Zheng Wang , Hongyang Shang , Shuai Dong , Zhengnan Fu , Xiaofeng Yang , Hongjie Liu , Arindam Basu

This paper presents a novel algorithm for the modulus operation for FPGA implementation. The proposed algorithm use only addition, subtraction, logical, and bit shift operations, avoiding the complexities and hardware costs associated with…

Cryptography and Security · Computer Science 2025-01-10 W. A. Susantha Wijesinghe

Developing dedicated mixed-signal neuromorphic computing systems optimized for real-time sensory-processing in extreme edge-computing applications requires time-consuming design, fabrication, and deployment of full-custom neuromorphic…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Fernando M. Quintana , Maryada , Pedro L. Galindo , Elisa Donati , Giacomo Indiveri , Fernando Perez-Peña

Learning distributed representations, or embeddings, that encode the relational similarity patterns among objects is a relevant task in machine learning. A popular method to learn the embedding matrices $X, Y$ is optimizing a loss function…

Machine Learning · Computer Science 2025-06-03 Lorenzo Dall'Amico , Enrico Maria Belliardo

The CMOS integrated chips at advanced technology nodes are becoming more vulnerable to various sources of faults like manufacturing imprecisions, variations, aging, etc. Additionally, the intentional fault attacks (e.g., high power…

Hardware Architecture · Computer Science 2018-07-08 Naveen Kumar Macha , Bhavana Tejaswini Repalle , Sandeep Geedipally , Rafael Rios , Mostafizur Rahman

This paper describes a multi-functional deep in-memory processor for inference applications. Deep in-memory processing is achieved by embedding pitch-matched low-SNR analog processing into a standard 6T 16KB SRAM array in 65 nm CMOS. Four…

Hardware Architecture · Computer Science 2016-10-25 Mingu Kang , Sujan Gonugondla , Ameya Patil , Naresh Shanbhag

In this paper we study multi-task oriented communication system via studying analog encoding method for multiple estimation tasks. The basic idea is to utilize the correlation among interested information required by different tasks and the…

Information Theory · Computer Science 2023-05-18 Chenmin Sha , Shidong Zhou

In this paper we describe an autotuning tool for optimization of OpenMP applications on highly multicore and multithreaded architectures. Our work was motivated by in-depth performance analysis of scientific applications and synthetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-01-17 Jakub Katarzyński , Maciej Cytowski

Cycle-accurate simulators are widely used to study systolic accelerators, yet their accuracy and usability are often limited by weak validation against real hardware and poor integration with modern ML compiler stacks. This paper presents…

Hardware Architecture · Computer Science 2026-03-25 Jingtian Dang , Ritik Raj , Changhai Man , Jianming Tong , Tushar Krishna

The logarithmic and anti-logarithmic converters are realized with the piecewise linear approximation method, which is implemented by the shift-and-add architecture. This brief utilizes the similarities of Log and Antilog functions so that…

Signal Processing · Electrical Eng. & Systems 2020-11-13 Botao Xiong , Yuanfeng Sui

We present a high-bandwidth, lightweight, and nonlinear output tracking technique for soft actuators that combines parsimonious recursive layers for forward output predictions and online optimization using Newton-Raphson. This technique…

Robotics · Computer Science 2022-05-24 Sarah Aguasvivas Manzano , Patricia Xu , Khoi Ly , Robert Shepherd , Nikolaus Correll

We present a design-scheme for ultra-low power neuromorphic hardware using emerging spin-devices. We propose device models for 'neuron', based on lateral spin valves and domain wall magnets that can operate at ultra-low terminal voltage of…

Disordered Systems and Neural Networks · Physics 2012-07-19 Mrigank Sharad , Charles Augustine , Georgios Panagopoulos , Kaushik Roy

We present an exact formula for the $\beta$-function for the soft-breaking scalar mass in an N=1 supersymmetric gauge theory, in the form of an operator acting on the anomalous dimension. In particular we give the exact form for the…

High Energy Physics - Phenomenology · Physics 2009-10-31 I. Jack , D. R. T. Jones , A. Pickering

Recent Byzantine fault-tolerant (BFT) state machine replication (SMR) protocols increasingly focus on scalability to meet the requirements of distributed ledger technology (DLT). Validating the performance of scalable BFT protocol…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-02 Christian Berger , Sadok Ben Toumia , Hans P. Reiser

In-memory computing (IMC) architecture emerges as a promising paradigm, improving the energy efficiency of multiply-and-accumulate (MAC) operations within DNNs by integrating the parallel computations within the memory arrays. Various…

Emerging Technologies · Computer Science 2024-10-28 Zeyu Yang , Qingrong Huang , Yu Qian , Kai Ni , Thomas Kämpfe , Xunzhao Yin

For assembly tasks, it is essential to firmly fix target parts and to accurately estimate their poses. Several rigid jigs for individual parts are frequently used in assembly factories to achieve precise and time-efficient product assembly.…

Robotics · Computer Science 2021-09-17 Tatsuya Sakuma , Takuya Kiyokawa , Jun Takamatsu , Takahiro Wada , Tsukasa Ogasawara

The Gumbel-Softmax is a continuous distribution over the simplex that is often used as a relaxation of discrete distributions. Because it can be readily interpreted and easily reparameterized, it enjoys widespread use. We propose a modular…

Machine Learning · Statistics 2022-08-30 Andres Potapczynski , Gabriel Loaiza-Ganem , John P. Cunningham

We demonstrate approximate storage based on NAND-like spin-orbit torque (SOT) MRAM, through "device-modeling-architecture" explorations. We experimentally achieve down to 1E-5 level selectivity. Selectivity and low-power solutions are…

Analog quantum simulation is widely considered a step on the path to fault tolerant quantum computation. If based on current noisy hardware, the accuracy of an analog simulator will degrade after just a few time steps, especially when…

Quantum Physics · Physics 2020-07-01 Nathan K. Lysne , Kevin W. Kuper , Pablo M. Poggi , Ivan H. Deutsch , Poul S. Jessen