English
Related papers

Related papers: MemSE: Fast MSE Prediction for Noisy Memristor-Bas…

200 papers

Existing speculative decoding methods typically require additional model structure and training processes to assist the model for draft token generation. This makes the migration of acceleration methods to the new model more costly and more…

Computation and Language · Computer Science 2024-10-08 Yixuan Wang , Xianzhen Luo , Fuxuan Wei , Yijun Liu , Qingfu Zhu , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Mixture of Experts (MoE) has become a mainstream architecture for building Large Language Models (LLMs) by reducing per-token computation while enabling model scaling. It can be viewed as partitioning a large Feed-Forward Network (FFN) at…

Machine Learning · Computer Science 2025-08-27 Weilin Cai , Le Qin , Shwai He , Junwei Cui , Ang Li , Jiayi Huang

Network pruning can reduce the computation cost of deep neural network (DNN) models. However, sparse models often produce randomly-distributed weights to maintain accuracy, leading to irregular computations. Consequently, unstructured…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-19 Cong Guo , Fengchen Xue , Jingwen Leng , Yuxian Qiu , Yue Guan , Weihao Cui , Quan Chen , Minyi Guo

Non-Volatile Memory (NVM) cells are used in neuromorphic hardware to store model parameters, which are programmed as resistance states. NVMs suffer from the read disturb issue, where the programmed resistance state drifts upon repeated…

Neural and Evolutionary Computing · Computer Science 2022-01-28 Ankita Paul , Shihao Song , Twisha Titirsha , Anup Das

Symbol detection for Massive Multiple-Input Multiple-Output (MIMO) is a challenging problem for which traditional algorithms are either impractical or suffer from performance limitations. Several recently proposed learning-based approaches…

Signal Processing · Electrical Eng. & Systems 2019-06-12 Mehrdad Khani , Mohammad Alizadeh , Jakob Hoydis , Phil Fleming

Recent works demonstrated the promise of using resistive random access memory (ReRAM) as an emerging technology to perform inherently parallel analog domain in-situ matrix-vector multiplication -- the intensive and key computation in DNNs.…

Hardware Architecture · Computer Science 2021-06-18 Geng Yuan , Payman Behnam , Zhengang Li , Ali Shafiee , Sheng Lin , Xiaolong Ma , Hang Liu , Xuehai Qian , Mahdi Nazm Bojnordi , Yanzhi Wang , Caiwen Ding

Recently we find several candidates of quantum algorithms that may be implementable in near-term devices for estimating the amplitude of a given quantum state, which is a core sub- routine in various computing tasks such as the Monte Carlo…

Quantum Physics · Physics 2021-10-12 Tomoki Tanaka , Yohichi Suzuki , Shumpei Uno , Rudy Raymond , Tamiya Onodera , Naoki Yamamoto

Memristors have shown promising features for enhancing neuromorphic computing concepts and AI hardware accelerators. In this paper, we present a user-friendly software infrastructure that allows emulating a wide range of neuromorphic…

Neural and Evolutionary Computing · Computer Science 2022-07-19 Jinqi Huang , Spyros Stathopoulos , Alex Serb , Themis Prodromakis

Resistive memory is a promising alternative to SRAM, but is also an inherently unstable device that requires substantial effort to ensure correct read and write operations. To avoid the associated costs in terms of area, time and energy,…

Machine Learning · Computer Science 2024-01-12 Yannick Emonds , Kai Xi , Holger Fröning

Energy-efficient deep neural network (DNN) accelerators are prone to non-idealities that degrade DNN performance at inference time. To mitigate such degradation, existing methods typically add perturbations to the DNN weights during…

Machine Learning · Computer Science 2023-03-22 Gonçalo Mordido , Sébastien Henwood , Sarath Chandar , François Leduc-Primeau

Memristor based neural networks have great potentials in on-chip neuromorphic computing systems due to the fast computation and low-energy consumption. However, the imprecise properties of existing memristor devices generally result in…

Emerging Technologies · Computer Science 2019-06-07 Yaoyuan Wang , Shuang Wu , Ziyang Zhang , Lei Tian , Luping Shi

For Deep Neural Networks (DNNs) to become useful in safety-critical applications, such as self-driving cars and disease diagnosis, they must be stable to perturbations in input and model parameters. Characterizing the sensitivity of a DNN…

Machine Learning · Computer Science 2023-07-25 Naman Maheshwari , Nicholas Malaya , Scott Moe , Jaydeep P. Kulkarni , Sudhanva Gurumurthi

Hardware accelerator for convolution neural network (CNNs) enables real time applications of artificial intelligence technology. However, most of the accelerators only support dense CNN computations or suffers complex control to support…

Hardware Architecture · Computer Science 2022-05-06 Kuo-Wei Chang , Tian-Sheuan Chang

Memristor-based computer architectures are becoming more attractive as a possible choice of hardware for the implementation of neural networks. However, at present, memristor technologies are susceptible to a variety of failure modes, a…

Computational Physics · Physics 2022-02-21 Kyle N. Edwards , Xiao Shen

Deep Neural Networks (DNN) are computationally intensive to train. It consists of a large number of multidimensional dot products between many weights and input vectors. However, there can be significant similarity among input vectors. If…

Hardware Architecture · Computer Science 2022-11-04 Vahid Janfaza , Kevin Weston , Moein Razavi , Shantanu Mandal , Farabi Mahmud , Alex Hilty , Abdullah Muzahid

Differential dynamic microscopy (DDM) typically relies on movies containing hundreds or thousands of frames to accurately quantify motion in soft matter systems. Using movies much shorter in duration produces noisier and less accurate…

Soft Condensed Matter · Physics 2024-11-05 Gildardo Martinez , Justin Siu , Steven Dang , Dylan Gage , Emma Kao , Juan Carlos Avila , Ruilin You , Ryan McGorty

Pitch estimation is an essential step of many speech processing algorithms, including speech coding, synthesis, and enhancement. Recently, pitch estimators based on deep neural networks (DNNs) have have been outperforming well-established…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Krishna Subramani , Jean-Marc Valin , Jan Buethe , Paris Smaragdis , Mike Goodwin

Memristor crossbar arrays have emerged as a key component for next-generation non-volatile memories, artificial neural networks, and analog in-memory computing (IMC) systems. By minimizing data transfer between the processor and memory,…

Emerging Technologies · Computer Science 2026-01-16 Shah Zayed Riam , Zhenlin Pei , Kyle Mooney , Chenyun Pan , Na Gong , Jinhui Wang

Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as…

Emerging Technologies · Computer Science 2022-06-22 Gouhei Tanaka , Ryosho Nakane

Emerging technologies present opportunities for system designers to meet the challenges presented by competing trends of big data analytics and limitations on CMOS scaling. Specifically, memristors are an emerging high-density technology…

Emerging Technologies · Computer Science 2016-01-21 Yang Liu , Chris Dwyer , Alvin R. Lebeck
‹ Prev 1 8 9 10 Next ›