English
Related papers

Related papers: Device Placement Optimization with Reinforcement L…

200 papers

Distributed execution of deep learning training involves a dynamic interplay between hardware accelerator architecture and device placement strategy. This is the first work to explore the co-optimization of determining the optimal…

Machine Learning · Computer Science 2024-07-19 Irene Wang , Jakub Tarnawski , Amar Phanishayee , Divya Mahajan

Designing deep learning models for highly-constrained hardware would allow imbuing many edge devices with intelligence. Microcontrollers (MCUs) are an attractive platform for building smart devices due to their low cost, wide availability,…

Machine Learning · Computer Science 2020-03-04 Edgar Liberis , Nicholas D. Lane

Access to parallel and distributed computation has enabled researchers and developers to improve algorithms and performance in many applications. Recent research has focused on next generation special purpose systems with multiple kinds of…

Machine Learning · Computer Science 2019-06-11 Tegg Taekyong Sung , Valliappa Chockalingam , Alex Yahja , Bo Ryu

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Fabian Kreß , El Mahdi El Annabi , Tim Hotfilter , Julian Hoefer , Tanja Harbaum , Juergen Becker

As the number of edge devices with computing resources (e.g., embedded GPUs, mobile phones, and laptops) increases, recent studies demonstrate that it can be beneficial to collaboratively run convolutional neural network (CNN) inference on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Xueyu Hou , Yongjie Guan , Tao Han , Ning Zhang

Event processing is the cornerstone of the dynamic and responsive Internet of Things (IoT). Recent approaches in this area are based on representational state transfer (REST) principles, which allow event processing tasks to be placed at…

Machine Learning · Computer Science 2021-12-08 A. Mazayev , F. Al-Tam , N. Correia

Parameter-efficient transfer learning (PETL) aims to adapt pre-trained models to new downstream tasks while minimizing the number of fine-tuned parameters. Adapters, a popular approach in PETL, inject additional capacity into existing…

Machine Learning · Computer Science 2024-10-22 Aleksandra I. Nowak , Otniel-Bogdan Mercea , Anurag Arnab , Jonas Pfeiffer , Yann Dauphin , Utku Evci

In manufacturing, capacity planning is the process of allocating production resources in accordance with variable demand. The current industry practice in semiconductor manufacturing typically applies heuristic rules to prioritize actions,…

Machine Learning · Computer Science 2025-09-22 Philipp Andelfinger , Jieyi Bi , Qiuyu Zhu , Jianan Zhou , Bo Zhang , Fei Fei Zhang , Chew Wye Chan , Boon Ping Gan , Wentong Cai , Jie Zhang

Efficient probabilistic inference by variable elimination in graphical models requires an optimal elimination order. However, finding an optimal order is a challenging combinatorial optimisation problem for models with a large number of…

Artificial Intelligence · Computer Science 2025-03-13 Sagad Hamid , Tanya Braun

Place classification is a fundamental ability that a robot should possess to carry out effective human-robot interactions. It is a nontrivial classification problem which has attracted many research. In recent years, there is a high…

Robotics · Computer Science 2015-06-15 Yiyi Liao , Sarath Kodagoda , Yue Wang , Lei Shi , Yong Liu

In modern digital circuit back-end design, designers heavily rely on electronic-design-automoation (EDA) tool to close timing. However, the heuristic algorithms used in the place and route tool usually does not result in optimal solution.…

Machine Learning · Computer Science 2018-01-10 Karthik Airani , Rohit Guttal

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-21 Weijia Chen , Yuedong Xu , Xiaofeng Wu

For deep neural network accelerators, memory movement is both energetically expensive and can bound computation. Therefore, optimal mapping of tensors to memory hierarchies is critical to performance. The growing complexity of neural…

Optimizing the execution time of tensor program, e.g., a convolution, involves finding its optimal configuration. Searching the configuration space exhaustively is typically infeasible in practice. In line with recent research using TVM, we…

Machine Learning · Statistics 2019-11-28 Jakub M. Tomczak , Romain Lepert , Auke Wiggers

Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing them asynchronously through a central parameter server. Due…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Zhuojin Li , Wumo Yan , Marco Paolieri , Leana Golubchik

Chiplet-based systems, integrating various silicon dies manufactured at different integrated circuit technology nodes on a carrier interposer, have garnered significant attention in recent years due to their cost-effectiveness and…

Machine Learning · Computer Science 2024-04-09 Zhihui Deng , Yuanyuan Duan , Leilai Shao , Xiaolei Zhu

Machine learning inference is increasingly being executed locally on mobile and embedded platforms, due to the clear advantages in latency, privacy and connectivity. In this paper, we present approaches for online resource management in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Lei Xun , Long Tran-Thanh , Bashir M Al-Hashimi , Geoff V. Merrett

The ever increasing memory requirements of several applications has led to increased demands which might not be met by embedded devices. Constraining the usage of memory in such cases is of paramount importance. It is important that such…

Programming Languages · Computer Science 2022-08-09 Shalini Jain , Yashas Andaluri , S. VenkataKeerthy , Ramakrishna Upadrasta

Optimal sensor placement enhances the efficiency of a variety of applications for monitoring dynamical systems. It has been established that deterministic solutions to the sensor placement problem are insufficient due to the many…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Amin Jabini , Erik A. Johnson

In order to improve system performance efficiently, a number of systems choose to equip multi-core and many-core processors (such as GPUs). Due to their discrete memory these heterogeneous architectures comprise a distributed system within…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-27 Hao Wu , Daniel Lohmann , Wolfgang Schröder-Preikschat