English
Related papers

Related papers: HAPI: Hardware-Aware Progressive Inference

200 papers

Since Convolutional Neural Networks (ConvNets) are able to simultaneously learn features and classifiers to discriminate different categories of activities, recent works have employed ConvNets approaches to perform human activity…

Computer Vision and Pattern Recognition · Computer Science 2018-11-19 Artur Jordao , Ricardo Kloss , William Robson Schwartz

Automatic algorithm-hardware co-design for DNN has shown great success in improving the performance of DNNs on FPGAs. However, this process remains challenging due to the intractable search space of neural network architectures and hardware…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Zhen Dong , Yizhao Gao , Qijing Huang , John Wawrzynek , Hayden K. H. So , Kurt Keutzer

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Andreas Bytyn , René Ahlsdorf , Rainer Leupers , Gerd Ascheid

Deep neural networks have proven to be particularly effective in visual and audio recognition tasks. Existing models tend to be computationally expensive and memory intensive, however, and so methods for hardware-oriented approximation have…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Erwei Wang , James J. Davis , Ruizhe Zhao , Ho-Cheung Ng , Xinyu Niu , Wayne Luk , Peter Y. K. Cheung , George A. Constantinides

Deep Neural Networks (DNNs) have drawn attention because of their outstanding performance on various tasks. However, deploying full-fledged DNNs in resource-constrained devices (edge, mobile, IoT) is difficult due to their large size. To…

Machine Learning · Computer Science 2023-09-19 Divya J. Bajpai , Vivek K. Trivedi , Sohan L. Yadav , Manjesh K. Hanawal

Among hardware accelerators for deep-learning inference, data flow implementations offer low latency and high throughput capabilities. In these architectures, each neuron is mapped to a dedicated hardware unit, making them well-suited for…

Machine Learning · Computer Science 2026-03-10 Tobias Habermann , Michael Mecik , Zhenyu Wang , César David Vera , Martin Kumm , Mario Garrido

Recently, the demand of low-power deep-learning hardware for industrial applications has been increasing. Most existing artificial intelligence (AI) chips have evolved to rely on new chip technologies rather than on radically new hardware…

Machine Learning · Computer Science 2020-02-14 Byungik Ahn

Early exiting allows instances to exit at different layers according to the estimation of difficulty. Previous works usually adopt heuristic metrics such as the entropy of internal outputs to measure instance difficulty, which suffers from…

Computation and Language · Computer Science 2022-03-04 Tianxiang Sun , Xiangyang Liu , Wei Zhu , Zhichao Geng , Lingling Wu , Yilong He , Yuan Ni , Guotong Xie , Xuanjing Huang , Xipeng Qiu

Deep neural networks (DNNs) have made significant progress in recognizing visual elements and generating descriptive text in image-captioning tasks. However, their improved performance comes from increased computational burden and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

We implement a differentiable Neural Architecture Search (NAS) method inspired by FBNet for discovering neural networks that are heavily optimized for a particular target device. The FBNet NAS method discovers a neural network from a given…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Sai Vineeth Kalluru Srinivas , Harideep Nair , Vinay Vidyasagar

By adding exiting layers to the deep learning networks, early exit can terminate the inference earlier with accurate results. The passive decision-making of whether to exit or continue the next layer has to go through every pre-placed…

Machine Learning · Computer Science 2022-12-29 Xiangjie Li , Chenfei Lou , Zhengping Zhu , Yuchi Chen , Yingtao Shen , Yehan Ma , An Zou

Deploying deep learning models in time-critical applications with limited computational resources, for instance in edge computing systems and IoT networks, is a challenging task that often relies on dynamic inference methods such as early…

Machine Learning · Computer Science 2022-06-30 Arian Bakhtiarnia , Qi Zhang , Alexandros Iosifidis

Convolutional Neural Networks (CNNs) have demonstrated their effectiveness in numerous vision tasks. However, their high processing requirements necessitate efficient hardware acceleration to meet the application's performance targets. In…

Hardware Architecture · Computer Science 2024-03-29 Petros Toupas , Zhewen Yu , Christos-Savvas Bouganis , Dimitrios Tzovaras

Convolutional neural networks (CNNs) are used in numerous real-world applications such as vision-based autonomous driving and video content analysis. To run CNN inference on various target devices, hardware-aware neural architecture search…

Machine Learning · Computer Science 2021-11-04 Bingqian Lu , Jianyi Yang , Weiwen Jiang , Yiyu Shi , Shaolei Ren

Deep convolutional neural networks (CNNs) are the current state-of-the-art for digital analysis of histopathological images. The large size of whole-slide microscopy images (WSIs) requires advanced memory handling to read, display and…

Machine Learning · Computer Science 2020-11-13 André Pedersen , Marit Valla , Anna M. Bofin , Javier Pérez de Frutos , Ingerid Reinertsen , Erik Smistad

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Both Convolutional Neural Networks (CNNs) and Transformers have shown great success in semantic segmentation tasks. Efforts have been made to integrate CNNs with Transformer models to capture both local and global context interactions.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Guoan Xu , Wenjing Jia , Tao Wu , Ligeng Chen , Guangwei Gao

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by CNNs calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-06 Kamel Abdelouahab , Maxime Pelcat , Jocelyn Serot , François Berry

Today, artificial neural networks are the state of the art for solving a variety of complex tasks, especially in image classification. Such architectures consist of a sequence of stacked layers with the aim of extracting useful information…

Machine Learning · Computer Science 2023-01-31 Simone Sarti , Eugenio Lomurno , Matteo Matteucci