中文
相关论文

相关论文: Analog Implementation of the Softmax Function

200 篇论文

As numerical simulations grow in size and complexity, they become increasingly resource-intensive in terms of time and energy. While specialized hardware accelerators often provide order-of-magnitude gains and are state of the art in other…

神经与进化计算 · 计算机科学 2024-12-04 Hartmut Schmidt , Andreas Grübl , José Montes , Eric Müller , Sebastian Schmitt , Johannes Schemmel

The energy efficiency of analog computing-in-memory (ACIM) accelerator for recurrent neural networks, particularly long short-term memory (LSTM) network, is limited by the high proportion of nonlinear (NL) operations typically executed…

硬件体系结构 · 计算机科学 2025-12-09 Junyi Yang , Xinyu Luo , Ye Ke , Zheng Wang , Hongyang Shang , Shuai Dong , Zhengnan Fu , Xiaofeng Yang , Hongjie Liu , Arindam Basu

This paper presents a novel algorithm for the modulus operation for FPGA implementation. The proposed algorithm use only addition, subtraction, logical, and bit shift operations, avoiding the complexities and hardware costs associated with…

密码学与安全 · 计算机科学 2025-01-10 W. A. Susantha Wijesinghe

Developing dedicated mixed-signal neuromorphic computing systems optimized for real-time sensory-processing in extreme edge-computing applications requires time-consuming design, fabrication, and deployment of full-custom neuromorphic…

神经与进化计算 · 计算机科学 2025-08-18 Fernando M. Quintana , Maryada , Pedro L. Galindo , Elisa Donati , Giacomo Indiveri , Fernando Perez-Peña

Learning distributed representations, or embeddings, that encode the relational similarity patterns among objects is a relevant task in machine learning. A popular method to learn the embedding matrices $X, Y$ is optimizing a loss function…

机器学习 · 计算机科学 2025-06-03 Lorenzo Dall'Amico , Enrico Maria Belliardo

The CMOS integrated chips at advanced technology nodes are becoming more vulnerable to various sources of faults like manufacturing imprecisions, variations, aging, etc. Additionally, the intentional fault attacks (e.g., high power…

硬件体系结构 · 计算机科学 2018-07-08 Naveen Kumar Macha , Bhavana Tejaswini Repalle , Sandeep Geedipally , Rafael Rios , Mostafizur Rahman

This paper describes a multi-functional deep in-memory processor for inference applications. Deep in-memory processing is achieved by embedding pitch-matched low-SNR analog processing into a standard 6T 16KB SRAM array in 65 nm CMOS. Four…

硬件体系结构 · 计算机科学 2016-10-25 Mingu Kang , Sujan Gonugondla , Ameya Patil , Naresh Shanbhag

In this paper we study multi-task oriented communication system via studying analog encoding method for multiple estimation tasks. The basic idea is to utilize the correlation among interested information required by different tasks and the…

信息论 · 计算机科学 2023-05-18 Chenmin Sha , Shidong Zhou

In this paper we describe an autotuning tool for optimization of OpenMP applications on highly multicore and multithreaded architectures. Our work was motivated by in-depth performance analysis of scientific applications and synthetic…

分布式、并行与集群计算 · 计算机科学 2014-01-17 Jakub Katarzyński , Maciej Cytowski

Cycle-accurate simulators are widely used to study systolic accelerators, yet their accuracy and usability are often limited by weak validation against real hardware and poor integration with modern ML compiler stacks. This paper presents…

硬件体系结构 · 计算机科学 2026-03-25 Jingtian Dang , Ritik Raj , Changhai Man , Jianming Tong , Tushar Krishna

The logarithmic and anti-logarithmic converters are realized with the piecewise linear approximation method, which is implemented by the shift-and-add architecture. This brief utilizes the similarities of Log and Antilog functions so that…

信号处理 · 电气工程与系统科学 2020-11-13 Botao Xiong , Yuanfeng Sui

We present a high-bandwidth, lightweight, and nonlinear output tracking technique for soft actuators that combines parsimonious recursive layers for forward output predictions and online optimization using Newton-Raphson. This technique…

机器人学 · 计算机科学 2022-05-24 Sarah Aguasvivas Manzano , Patricia Xu , Khoi Ly , Robert Shepherd , Nikolaus Correll

We present a design-scheme for ultra-low power neuromorphic hardware using emerging spin-devices. We propose device models for 'neuron', based on lateral spin valves and domain wall magnets that can operate at ultra-low terminal voltage of…

无序系统与神经网络 · 物理学 2012-07-19 Mrigank Sharad , Charles Augustine , Georgios Panagopoulos , Kaushik Roy

We present an exact formula for the $\beta$-function for the soft-breaking scalar mass in an N=1 supersymmetric gauge theory, in the form of an operator acting on the anomalous dimension. In particular we give the exact form for the…

高能物理 - 唯象学 · 物理学 2009-10-31 I. Jack , D. R. T. Jones , A. Pickering

Recent Byzantine fault-tolerant (BFT) state machine replication (SMR) protocols increasingly focus on scalability to meet the requirements of distributed ledger technology (DLT). Validating the performance of scalable BFT protocol…

分布式、并行与集群计算 · 计算机科学 2023-10-02 Christian Berger , Sadok Ben Toumia , Hans P. Reiser

In-memory computing (IMC) architecture emerges as a promising paradigm, improving the energy efficiency of multiply-and-accumulate (MAC) operations within DNNs by integrating the parallel computations within the memory arrays. Various…

新兴技术 · 计算机科学 2024-10-28 Zeyu Yang , Qingrong Huang , Yu Qian , Kai Ni , Thomas Kämpfe , Xunzhao Yin

For assembly tasks, it is essential to firmly fix target parts and to accurately estimate their poses. Several rigid jigs for individual parts are frequently used in assembly factories to achieve precise and time-efficient product assembly.…

机器人学 · 计算机科学 2021-09-17 Tatsuya Sakuma , Takuya Kiyokawa , Jun Takamatsu , Takahiro Wada , Tsukasa Ogasawara

The Gumbel-Softmax is a continuous distribution over the simplex that is often used as a relaxation of discrete distributions. Because it can be readily interpreted and easily reparameterized, it enjoys widespread use. We propose a modular…

机器学习 · 统计学 2022-08-30 Andres Potapczynski , Gabriel Loaiza-Ganem , John P. Cunningham

We demonstrate approximate storage based on NAND-like spin-orbit torque (SOT) MRAM, through "device-modeling-architecture" explorations. We experimentally achieve down to 1E-5 level selectivity. Selectivity and low-power solutions are…

Analog quantum simulation is widely considered a step on the path to fault tolerant quantum computation. If based on current noisy hardware, the accuracy of an analog simulator will degrade after just a few time steps, especially when…

量子物理 · 物理学 2020-07-01 Nathan K. Lysne , Kevin W. Kuper , Pablo M. Poggi , Ivan H. Deutsch , Poul S. Jessen