English
Related papers

Related papers: Performance tuning for deep learning on a many-cor…

200 papers

Lightweight design, as a key approach to mitigate disparity between computational requirements of deep learning models and hardware performance, plays a pivotal role in advancing application of deep learning technologies on mobile and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hanhua Long , Wenbin Bi , Jian Sun

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Though CNNs are highly parallel workloads, in the absence of efficient on-chip memory reuse techniques, an accelerator for them quickly becomes memory bound. In this paper, we propose a CNN accelerator design for inference that is able to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-26 Kingshuk Majumder , Shubham Nema , Uday Bondhugula

The rising use of deep learning and other big-data algorithms has led to an increasing demand for hardware platforms that are computationally powerful, yet energy-efficient. Due to the amount of data parallelism in these algorithms,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-08 Biresh Kumar Joardar , Ryan Gary Kim , Janardhan Rao Doppa , Partha Pratim Pande , Diana Marculescu , Radu Marculescu

Deep convolutional neural networks (CNNs) obtain outstanding results in tasks that require human-level understanding of data, like image or speech recognition. However, their computational load is significant, motivating the development of…

Neural and Evolutionary Computing · Computer Science 2019-11-28 Paolo Meloni , Alessandro Capotondi , Gianfranco Deriu , Michele Brian , Francesco Conti , Davide Rossi , Luigi Raffo , Luca Benini

With the success of deep learning techniques in a broad range of application domains, many deep learning software frameworks have been developed and are being updated frequently to adapt to new hardware features and software libraries,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Pengfei Xu , Shaohuai Shi , Xiaowen Chu

Encoding-decoding CNNs play a central role in data-driven noise reduction and can be found within numerous deep-learning algorithms. However, the development of these CNN architectures is often done in ad-hoc fashion and theoretical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Luis A. Zavala-Mondragón , Peter H. N. de With , Fons van der Sommen

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Convolutional neural networks (CNNs) require a large number of multiply-accumulate (MAC) operations. To meet real-time constraints, they often need to be executed on specialized accelerators composed of an on-chip memory and a processing…

Hardware Architecture · Computer Science 2026-03-24 Benjamin Husson , Mohammed Belcaïd , Thomas Carle , Claire Pagetti

The dominant approach for many NLP tasks are recurrent neural networks, in particular LSTMs, and convolutional neural networks. However, these architectures are rather shallow in comparison to the deep convolutional networks which have…

Computation and Language · Computer Science 2017-01-30 Alexis Conneau , Holger Schwenk , Loïc Barrault , Yann Lecun

Deep learning refers to the shining branch of machine learning that is based on learning levels of representations. Convolutional Neural Networks (CNN) is one kind of deep neural network. It can study concurrently. In this article, we gave…

Computer Vision and Pattern Recognition · Computer Science 2015-06-05 Tianyi Liu , Shuangsang Fang , Yuehui Zhao , Peng Wang , Jun Zhang

Supervised learning of Convolutional Neural Networks (CNNs), also known as supervised Deep Learning, is a computationally demanding process. To find the most suitable parameters of a network for a given application, numerous training…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-01 Andre Viebke , Sabri Pllana

In this paper, we propose different alternatives for convolutional neural networks (CNNs) segmentation, addressing inference processes on computing architectures composed by multiple Edge TPUs. Specifically, we compare the inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-04 Jorge Villarrubia , Luis Costero , Francisco D. Igual , Katzalin Olcoz

Recently, the demand of low-power deep-learning hardware for industrial applications has been increasing. Most existing artificial intelligence (AI) chips have evolved to rely on new chip technologies rather than on radically new hardware…

Machine Learning · Computer Science 2020-02-14 Byungik Ahn

As the rapidly evolving field of machine learning continues to produce incredibly useful tools and models, the potential for quantum computing to provide speed up for machine learning algorithms is becoming increasingly desirable. In…

Quantum Physics · Physics 2024-04-02 Anthony M. Smaldone , Gregory W. Kyro , Victor S. Batista

Sub-10cm diameter nano-drones are gaining momentum thanks to their applicability in scenarios prevented to bigger flying drones, such as in narrow environments and close to humans. However, their tiny form factor also brings their major…

Convolutional Neural Networks (CNNs) are the state of the art solution for many computer vision problems, and many researchers have explored optimized implementations. Most implementations heuristically block the computation to deal with…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-15 Xuan Yang , Jing Pu , Blaine Burton Rister , Nikhil Bhagdikar , Stephen Richardson , Shahar Kvatinsky , Jonathan Ragan-Kelley , Ardavan Pedram , Mark Horowitz

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang