English
Related papers

Related papers: LRMP: Layer Replication with Mixed Precision for S…

200 papers

The problem of distance metric learning is mostly considered from the perspective of learning an embedding space, where the distances between pairs of examples are in correspondence with a similarity metric. With the rise and success of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Accurate and reliable Magnetic Resonance Imaging (MRI) analysis is particularly important for adaptive radiotherapy, a recent medical advance capable of improving cancer diagnosis and treatment. Recent studies have shown that IVIM-NET, a…

Hardware Architecture · Computer Science 2024-07-09 Zehuan Zhang , Matej Genci , Hongxiang Fan , Andreas Wetscherek , Wayne Luk

Neuromorphic architectures, which incorporate parallel and in-memory processing, are crucial for accelerating artificial neural network (ANN) computations. This work presents a novel memristor-based multi-layer neural network (memristive…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapat , Manobendra Nath Mondal , Susmita Sur-Kolay

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuqiang Liu , C. Liu

Low precision deep neural network (DNN) training is one of the most effective techniques for boosting DNNs' training efficiency, as it trims down the training cost from the finest bit level. While existing works mostly fix the model…

Machine Learning · Computer Science 2022-03-16 Zhongzhi Yu , Yonggan Fu , Shang Wu , Mengquan Li , Haoran You , Yingyan Lin

The success of Deep Artificial Neural Networks (DNNs) in many domains created a rich body of research concerned with hardware accelerators for compute-intensive DNN operators. However, implementing such operators efficiently with complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-27 Dennis Rieber , Axel Acosta , Holger Fröning

Analog In-Memory Computing (AIMC) is an emerging technology for fast and energy-efficient Deep Learning (DL) inference. However, a certain amount of digital post-processing is required to deal with circuit mismatches and non-idealities…

Hardware Architecture · Computer Science 2024-07-10 Elena Ferro , Athanasios Vasilopoulos , Corey Lammie , Manuel Le Gallo , Luca Benini , Irem Boybat , Abu Sebastian

Map Space Exploration is the problem of finding optimized mappings of a Deep Neural Network (DNN) model on an accelerator. It is known to be extremely computationally expensive, and there has been active research looking at both heuristics…

Machine Learning · Computer Science 2022-10-10 Sheng-Chun Kao , Angshuman Parashar , Po-An Tsai , Tushar Krishna

Hardware accelerators such as GPUs are required for real-time, low-latency inference with Deep Neural Networks (DNN). However, due to the inherent limits to the parallelism they can exploit, DNNs often under-utilize the capacity of today's…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Aditya Dhakal , Sameer G. Kulkarni , K. K. Ramakrishnan

As CMOS scaling reaches its technological limits, a radical departure from traditional von Neumann systems, which involve separate processing and memory units, is needed in order to significantly extend the performance of today's computers.…

The massive interest in deep neural networks (DNNs) for both computer vision and natural language processing has been sparked by the growth in computational power. However, this led to an increase in the memory footprint, to a point where…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly

Computing-in-Memory (CiM) architectures based on emerging non-volatile memory (NVM) devices have demonstrated great potential for deep neural network (DNN) acceleration thanks to their high energy efficiency. However, NVM devices suffer…

Hardware Architecture · Computer Science 2022-07-26 Zheyu Yan , Xiaobo Sharon Hu , Yiyu Shi

Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional…

Machine Learning · Computer Science 2021-05-04 Ishwar Venugopal , Jessica Töllich , Michael Fairbank , Ansgar Scherp

Thanks to their parallel and sparse activity features, recurrent neural networks (RNNs) are well-suited for hardware implementation in low-power neuromorphic hardware. However, mapping rate-based RNNs to hardware-compatible spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-07-19 Gauthier Boeshertz , Giacomo Indiveri , Manu Nair , Alpha Renner

The need to execute Deep Neural Networks (DNNs) at low latency and low power at the edge has spurred the development of new heterogeneous Systems-on-Chips (SoCs) encapsulating a diverse set of hardware accelerators. How to optimally map a…

Spiking Neural Networks (SNNs) have emerged as a biologically inspired alternative to conventional deep networks, offering event-driven and energy-efficient computation. However, their throughput remains constrained by the serial update of…

Neural and Evolutionary Computing · Computer Science 2026-03-16 Hongyang Shang , Shuai Dong , Yahan Yang , Junyi Yang , Peng Zhou , Arindam Basu

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

Multi-Layer Perceptrons (MLP) are powerful tools for representing complex, non-linear relationships, making them essential for diverse machine learning and AI applications. Efficient hardware implementation of MLPs can be achieved through…

Hardware Architecture · Computer Science 2024-10-15 Maedeh Ghaderi , Arvin Delavari , Faraz Ghoreishy , Sattar Mirzakuchaki

This paper presents methods to accelerate recurrent neural network based language models (RNNLMs) for online speech recognition systems. Firstly, a lossy compression of the past hidden layer outputs (history vector) with caching is…

Computation and Language · Computer Science 2018-01-31 Kyungmin Lee , Chiyoun Park , Namhoon Kim , Jaewon Lee

Implicit Neural Representations (INRs) have emerged as promising surrogates for large 3D scientific simulations due to their ability to continuously model spatial and conditional fields, yet they face a critical fidelity-speed dilemma: deep…

Machine Learning · Computer Science 2026-03-25 Tianyu Xiong , Skylar Wurster , Han-Wei Shen