English
Related papers

Related papers: FATE: Fast and Accurate Timing Error Prediction Fr…

200 papers

Deep neural network (DNN) latency characterization is a time-consuming process and adds significant cost to Neural Architecture Search (NAS) processes when searching for efficient convolutional neural networks for embedded vision…

Machine Learning · Computer Science 2022-05-26 Saad Abbasi , Alexander Wong , Mohammad Javad Shafiee

In component shape optimization, the component properties are often evaluated by computationally expensive simulations. Such optimization becomes unfeasible when it is focused on a global search requiring thousands of simulations to be…

Computational Engineering, Finance, and Science · Computer Science 2025-12-08 Lucie Kubíčková , Onřej Gebouský , Jan Haidl , Martin Isoz

Low-latency, energy-efficient deep neural networks (DNNs) inference are critical for edge applications, where traditional cloud-based deployment suffers from high latency and security risks. Field-Programmable Gate Arrays (FPGAs) offer a…

Hardware Architecture · Computer Science 2025-06-10 Zeyu Guo

Real-time energy forecasting on edge devices represents a major challenge for smart grid optimization and intelligent buildings. We present LAD-BNet (Lag-Aware Dual-Branch Network), an innovative neural architecture optimized for edge…

Machine Learning · Computer Science 2025-12-09 Jean-Philippe Lignier

The rapidly-changing deep learning landscape presents a unique opportunity for building inference accelerators optimized for specific datacenter-scale workloads. We propose Full-stack Accelerator Search Technique (FAST), a hardware…

Machine Learning · Computer Science 2022-02-02 Dan Zhang , Safeen Huda , Ebrahim Songhori , Kartik Prabhu , Quoc Le , Anna Goldie , Azalia Mirhoseini

Modern deep neural networks must demonstrate state-of-the-art accuracy while exhibiting low latency and energy consumption. As such, neural architecture search (NAS) algorithms take these two constraints into account when generating a new…

Machine Learning · Computer Science 2022-05-26 Saad Abbasi , Alexander Wong , Mohammad Javad Shafiee

Real-time Deep Neural Network (DNN) inference with low-latency requirement has become increasingly important for numerous applications in both cloud computing (e.g., Apple's Siri) and edge computing (e.g., Google/Waymo's driverless car).…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Weiwen Jiang , Edwin H. -M. Sha , Xinyi Zhang , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream approach to address this issue by making a trade-off between…

Computation and Language · Computer Science 2023-05-23 Yiming Chen , Simin Chen , Zexin Li , Wei Yang , Cong Liu , Robby T. Tan , Haizhou Li

Hardware accelerators are being increasingly deployed to boost the performance and energy efficiency of deep neural network (DNN) inference. In this paper we propose Thundervolt, a new framework that enables aggressive voltage underscaling…

Neural and Evolutionary Computing · Computer Science 2018-03-14 Jeff Zhang , Kartheek Rangineni , Zahra Ghodsi , Siddharth Garg

Deformable Attention Transformers (DAT) have shown remarkable performance in computer vision tasks by adaptively focusing on informative image regions. However, their data-dependent sampling mechanism introduces irregular memory access…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Wendong Mao , Mingfan Zhao , Jianfeng Guan , Qiwei Dong , Zhongfeng Wang

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

The ability to perform pixel-wise semantic segmentation in real-time is of paramount importance in mobile applications. Recent deep neural networks aimed at this task have the disadvantage of requiring a large number of floating point…

Computer Vision and Pattern Recognition · Computer Science 2016-06-08 Adam Paszke , Abhishek Chaurasia , Sangpil Kim , Eugenio Culurciello

Memory optimization for deep neural network (DNN) inference gains high relevance with the emergence of TinyML, which refers to the deployment of DNN inference tasks on tiny, low-power microcontrollers. Applications such as audio keyword…

Machine Learning · Computer Science 2023-04-03 Rafael Stahl , Daniel Mueller-Gritschneder , Ulf Schlichtmann

The use of low numerical precision is a fundamental optimization included in modern accelerators for Deep Neural Networks (DNNs). The number of bits of the numerical representation is set to the minimum precision that is able to retain…

Signal Processing · Electrical Eng. & Systems 2019-11-12 Franyell Silfa , Jose-Maria Arnau , Antonio Gonzàlez

Embedded deep learning platforms have witnessed two simultaneous improvements. First, the accuracy of convolutional neural networks (CNNs) has been significantly improved through the use of automated neural-architecture search (NAS)…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Lile Cai , Anne-Maelle Barneche , Arthur Herbout , Chuan Sheng Foo , Jie Lin , Vijay Ramaseshan Chandrasekhar , Mohamed M. Sabry

Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generally require substantial computational resources, leading to…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Shuai Wang , Dehao Zhang , Ammar Belatreche , Yichen Xiao , Hongyu Qing , Wenjie We , Malu Zhang , Yang Yang

Despite their tremendous success and versatility, Deep Neural Networks (DNNs) such as Large Language Models (LLMs) suffer from inference inefficiency and rely on advanced computational infrastructure. To address these challenges and make…

Machine Learning · Computer Science 2025-05-05 Mohsen Dehghankar , Mahdi Erfanian , Abolfazl Asudeh

The energy and latency of an accelerator running a deep neural network (DNN) depend on how the computation and data movement are scheduled in the accelerator (i.e., mapping), and picking an optimal mapping is essential to achieve…

Hardware Architecture · Computer Science 2026-05-05 Michael Gilbert , Tanner Andrulis , Vivienne Sze , Joel S. Emer

In recent years, there has been tremendous advances in hardware acceleration of deep neural networks. However, most of the research has focused on optimizing accelerator microarchitecture for higher performance and energy efficiency on a…

Machine Learning · Computer Science 2019-12-12 Sam Likun Xi , Yuan Yao , Kshitij Bhardwaj , Paul Whatmough , Gu-Yeon Wei , David Brooks

Due to the vast testing space, the increasing demand for effective and efficient testing of deep neural networks (DNNs) has led to the development of various DNN test case prioritization techniques. However, the fact that DNNs can deliver…

Software Engineering · Computer Science 2024-09-17 Jialuo Chen , Jingyi Wang , Xiyue Zhang , Youcheng Sun , Marta Kwiatkowska , Jiming Chen , Peng Cheng