English
Related papers

Related papers: Applying the Roofline model for Deep Learning perf…

200 papers

In this paper, we design a novel scheduling and resource allocation algorithm for a smart mobile edge computing (MEC) assisted radio access network. Different from previous energy efficiency (EE) based or the average age of information…

Signal Processing · Electrical Eng. & Systems 2020-11-03 Abolfazl Zakeri , Mohammad Parvini , Mohammad Reza Javan , Nader Mokari , Eduard A Jorswieck

Optimizing deep learning models is generally performed in two steps: (i) high-level graph optimizations such as kernel fusion and (ii) low level kernel optimizations such as those found in vendor libraries. This approach often leaves…

Machine Learning · Computer Science 2021-03-08 Pratik Fegade , Tianqi Chen , Phillip B. Gibbons , Todd C. Mowry

Autonomous construction of deep neural network (DNNs) is desired for data streams because it potentially offers two advantages: proper model's capacity and quick reaction to drift and shift. While the self-organizing mechanism of DNNs…

Machine Learning · Computer Science 2020-01-10 Mahardhika Pratama , Choiru Za'in , Andri Ashfahani , Yew Soon Ong , Weiping Ding

We show how deep learning methods can be applied in the context of crowdsourcing and unsupervised ensemble learning. First, we prove that the popular model of Dawid and Skene, which assumes that all classifiers are conditionally…

Machine Learning · Statistics 2017-04-24 Uri Shaham , Xiuyuan Cheng , Omer Dror , Ariel Jaffe , Boaz Nadler , Joseph Chang , Yuval Kluger

A machine learning (ML) design framework is proposed for dynamically adjusting clock frequency based on propagation delay of individual instructions. A Random Forest model is trained to classify propagation delays in real-time, utilizing…

Hardware Architecture · Computer Science 2020-06-16 Arash Fouman Ajirlou , Inna Partin-Vaisband

In this paper, we study an application of deep learning to uplink multiuser detection (MUD) for non-orthogonal multiple access (NOMA) scheme based on Welch bound equality spread multiple access (WSMA). Several non-cooperating users, each…

Information Theory · Computer Science 2020-11-25 Krishna Chitti , Joao Vieira , Behrooz Makki

In this work a novel, automated process for constructing and initializing deep feed-forward neural networks based on decision trees is presented. The proposed algorithm maps a collection of decision trees trained on the data into a…

Machine Learning · Computer Science 2018-07-04 K. D. Humbird , J. L. Peterson , R. G. McClarren

Computing-in-memory (CIM) is an emerging computing paradigm, offering noteworthy potential for accelerating neural networks with high parallelism, low latency, and energy efficiency compared to conventional von Neumann architectures.…

Neural and Evolutionary Computing · Computer Science 2024-09-30 Kam Chi Loong , Shihao Han , Sishuo Liu , Ning Lin , Zhongrui Wang

Large Deep Neural Networks (DNNs) are the backbone of today's artificial intelligence due to their ability to make accurate predictions when being trained on huge datasets. With advancing technologies, such as the Internet of Things,…

Machine Learning · Computer Science 2023-07-14 Mark Deutel , Philipp Woller , Christopher Mutschler , Jürgen Teich

Most deep learning models are limited to specific datasets or tasks because of network structures using fixed layers. In this paper, we discuss the differences between existing neural networks and real human neurons, propose association…

Artificial Intelligence · Computer Science 2023-01-31 Seokjun Kim , Jaeeun Jang , Hyeoncheol Kim

Deep learning has been a successful model which can effectively represent several features of input space and remarkably improve image recognition performance on the deep architectures. In our research, an adaptive structural learning…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Shin Kamada , Takumi Ichimura

Implementing Deep Neural Networks (DNNs) on resource-constrained edge devices is a challenging task that requires tailored hardware accelerator architectures and a clear understanding of their performance characteristics when executing the…

Cutting-edge embedded system applications, such as self-driving cars and unmanned drone software, are reliant on integrated CPU/GPU platforms for their DNNs-driven workload, such as perception and other highly parallel components. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-20 Soroush Bateni , Zhendong Wang , Yuankun Zhu , Yang Hu , Cong Liu

Cooperative beamforming across access points (APs) and fronthaul quantization strategies are essential for cloud radio access network (C-RAN) systems. The nonconvexity of the C-RAN optimization problems, which is stemmed from per-AP power…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Daesung Yu , Hoon Lee , Seok-Hwan Park , Seung-Eun Hong

The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, developing optimized DL models…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Nayan Moni Baishya , B. R. Manoj , Prabin K. Bora

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Bichen Wu

Accurate performance prediction is essential for optimizing scientific applications on modern high-performance computing (HPC) architectures. Widely used performance models primarily focus on cache and memory bandwidth, which is suitable…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Xuanzhengbo Ren , Yuta Kawai , Tetsuya Hoshino , Hirofumi Tomita , Takahiro Katagiri , Daichi Mukunoki , Seiya Nishizawa

As deep learning models continue to increase in size, the memory requirements for training have surged. While high-level techniques like offloading, recomputation, and compression can alleviate memory pressure, they also introduce…

Machine Learning · Computer Science 2023-10-31 Huiyao Shu , Ang Wang , Ziji Shi , Hanyu Zhao , Yong Li , Lu Lu

Miniaturized autonomous unmanned aerial vehicles (UAVs) are gaining popularity due to their small size, enabling new tasks such as indoor navigation or people monitoring. Nonetheless, their size and simple electronics pose severe challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Matteo Risso , Francesco Daghero , Beatrice Alessandra Motetti , Daniele Jahier Pagliari , Enrico Macii , Massimo Poncino , Alessio Burrello

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores