中文
相关论文

相关论文: Hardware Accelerator and Neural Network Co-Optimiz…

200 篇论文

Modern hardware design trends have shifted towards specialized hardware acceleration for computationally intensive tasks like machine learning and computer vision. While these complex workloads can be accelerated by commercial GPUs,…

硬件体系结构 · 计算机科学 2021-08-06 Caleb Terrill , Fred Chu

HardWare-aware Neural Architecture Search (HW-NAS) has recently gained tremendous attention by automating the design of DNNs deployed in more resource-constrained daily life devices. Despite its promising performance, developing optimal…

机器学习 · 计算机科学 2025-03-31 Chaojian Li , Zhongzhi Yu , Yonggan Fu , Yongan Zhang , Yang Zhao , Haoran You , Qixuan Yu , Yue Wang , Yingyan Celine Lin

Model quantization is a widely used technique to compress and accelerate deep neural network (DNN) inference. Emergent DNN hardware accelerators begin to support mixed precision (1-8 bits) to further improve the computation efficiency,…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Kuan Wang , Zhijian Liu , Yujun Lin , Ji Lin , Song Han

In view of the performance limitations of fully-decoupled designs for neural architectures and accelerators, hardware-software co-design has been emerging to fully reap the benefits of flexible design spaces and optimize neural network…

硬件体系结构 · 计算机科学 2022-03-29 Bingqian Lu , Zheyu Yan , Yiyu Shi , Shaolei Ren

Hardware and neural architecture co-search that automatically generates Artificial Intelligence (AI) solutions from a given dataset is promising to promote AI democratization; however, the amount of time that is required by current…

机器学习 · 计算机科学 2020-07-20 Weiwen Jiang , Lei Yang , Sakyasingha Dasgupta , Jingtong Hu , Yiyu Shi

Deep Neural Networks (DNNs) excel in learning hierarchical representations from raw data, such as images, audio, and text. To compute these DNN models with high performance and energy efficiency, these models are usually deployed onto…

The recent breakthroughs and prohibitive complexities of Deep Neural Networks (DNNs) have excited extensive interest in domain-specific DNN accelerators, among which optical DNN accelerators are particularly promising thanks to their…

机器学习 · 计算机科学 2021-08-18 Mengquan Li , Zhongzhi Yu , Yongan Zhang , Yonggan Fu , Yingyan Lin

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

机器学习 · 计算机科学 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Neural architecture search (NAS) has been very successful at outperforming human-designed convolutional neural networks (CNN) in accuracy, and when hardware information is present, latency as well. However, NAS-designed CNNs typically have…

信号处理 · 电气工程与系统科学 2020-03-09 Mohamed S. Abdelfattah , Łukasz Dudziak , Thomas Chau , Royson Lee , Hyeji Kim , Nicholas D. Lane

Deep neural networks (DNNs) offer plenty of challenges in executing efficient computation at edge nodes, primarily due to the huge hardware resource demands. The article proposes HYDRA, hybrid data multiplexing, and runtime layer…

硬件体系结构 · 计算机科学 2026-03-31 Sonu Kumar , Komal Gupta , Gopal Raut , Mukul Lokhande , Santosh Kumar Vishvakarma

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

硬件体系结构 · 计算机科学 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

As machine learning applications continue to evolve, the demand for efficient hardware accelerators, specifically tailored for deep neural networks (DNNs), becomes increasingly vital. In this paper, we propose a configurable memory…

硬件体系结构 · 计算机科学 2024-04-25 Oliver Bause , Paul Palomero Bernardo , Oliver Bringmann

Deep neural networks (DNNs) have been shown to outperform conventional machine learning algorithms across a wide range of applications, e.g., image recognition, object detection, robotics, and natural language processing. However, the high…

分布式、并行与集群计算 · 计算机科学 2020-04-23 Ye Yu , Yingmin Li , Shuai Che , Niraj K. Jha , Weifeng Zhang

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

机器学习 · 计算机科学 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

High quality AI solutions require joint optimization of AI algorithms, such as deep neural networks (DNNs), and their hardware accelerators. To improve the overall solution quality as well as to boost the design productivity, efficient…

硬件体系结构 · 计算机科学 2020-10-16 Cong Hao , Yao Chen , Xiaofan Zhang , Yuhong Li , Jinjun Xiong , Wen-mei Hwu , Deming Chen

As machine learning (ML) algorithms get deployed in an ever-increasing number of applications, these algorithms need to achieve better trade-offs between high accuracy, high throughput and low latency. This paper introduces NASH, a novel…

机器学习 · 计算机科学 2024-03-12 Mengfei Ji , Yuchun Chang , Baolin Zhang , Zaid Al-Ars

Lightweight models are essential for real-time speech enhancement applications. In recent years, there has been a growing trend toward developing increasingly compact models for speech enhancement. In this paper, we propose an…

音频与语音处理 · 电气工程与系统科学 2026-02-03 Xiaobin Rong , Leyan Yang , Dahan Wang , Yuxiang Hu , Changbao Zhu , Kai Chen , Jing Lu

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

机器学习 · 计算机科学 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

Audio fingerprinting systems must efficiently and robustly identify query snippets in an extensive database. To this end, state-of-the-art systems use deep learning to generate compact audio fingerprints. These systems deploy indexing…

音频与语音处理 · 电气工程与系统科学 2023-01-20 Anup Singh , Kris Demuynck , Vipul Arora

Designing low-latency and high-efficiency hybrid networks for a variety of low-cost commodity edge devices is both costly and tedious, leading to the adoption of hardware-aware neural architecture search (NAS) for finding optimal…

机器学习 · 计算机科学 2024-08-29 Hung-Yueh Chiang , Diana Marculescu