English
Related papers

Related papers: On-device Training: A First Overview on Existing S…

200 papers

Deep Learning (DL) has recently achieved tremendous success. A variety of DL frameworks and platforms play a key role to catalyze such progress. However, the differences in architecture designs and implementations of existing frameworks and…

Machine Learning · Computer Science 2019-09-17 Qianyu Guo , Sen Chen , Xiaofei Xie , Lei Ma , Qiang Hu , Hongtao Liu , Yang Liu , Jianjun Zhao , Xiaohong Li

Recently, Deep Neural Networks (DNNs) have emerged as the dominant model across various AI applications. In the era of IoT and mobile systems, the efficient deployment of DNNs on embedded platforms is vital to enable the development of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Stylianos I. Venieris , Alexandros Kouris , Christos-Savvas Bouganis

The advent of large language models (LLMs) revolutionized natural language processing applications, and running LLMs on edge devices has become increasingly attractive for reasons including reduced latency, data localization, and…

Computation and Language · Computer Science 2024-09-17 Jiajun Xu , Zhiyuan Li , Wei Chen , Qun Wang , Xin Gao , Qi Cai , Ziyuan Ling

The rapidly-advancing technology of deep learning (DL) into the world of the Internet of Things (IoT) has not fully entered in the fields of m-Health yet. Among the main reasons are the high computational demands of DL algorithms and the…

Machine Learning · Computer Science 2020-03-16 Engin Türetken , Jérôme Van Zaen , Ricard Delgado-Gonzalo

Real-time on-device continual learning is needed for new applications such as home robots, user personalization on smartphones, and augmented/virtual reality headsets. However, this setting poses unique challenges: embedded devices have…

Machine Learning · Computer Science 2022-07-18 Tyler L. Hayes , Christopher Kanan

Personal mobile sensing is fast permeating our daily lives to enable activity monitoring, healthcare and rehabilitation. Combined with deep learning, these applications have achieved significant success in recent years. Different from…

Machine Learning · Computer Science 2020-02-18 Yu Zhang , Tao Gu , Xi Zhang

The unprecedented requirements of the Internet of Things (IoT) have made fine-grained optimization of spectrum resources an urgent necessity. Thus, designing techniques able to extract knowledge from the spectrum in real time and select the…

Networking and Internet Architecture · Computer Science 2020-09-09 Francesco Restuccia , Tommaso Melodia

Deep learning (DL) techniques are on the rise in the software engineering research community. More and more approaches have been developed on top of DL models, also due to the unprecedented amount of software-related data that can be used…

Software Engineering · Computer Science 2021-03-23 Alejandro Mazuera-Rozo , Anamaria Mojica-Hanke , Mario Linares-Vásquez , Gabriele Bavota

This paper reviews machine learning applications and approaches to detection, classification and control of intelligent materials and structures with embedded distributed computation elements. The purpose of this survey is to identify…

Machine Learning · Computer Science 2016-06-14 Dana Hughes , Nikolaus Correll

In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and…

Machine Learning · Computer Science 2024-05-27 Madison Threadgill , Andreas Gerstlauer

Deep learning (DL) has become a key component of modern software. In the "big model" era, the rich features of DL-based software substantially rely on powerful DL models, e.g., BERT, GPT-3, and the recently emerging GPT-4, which are trained…

Software Engineering · Computer Science 2023-05-01 Xuanzhe Liu , Diandian Gu , Zhenpeng Chen , Jinfeng Wen , Zili Zhang , Yun Ma , Haoyu Wang , Xin Jin

Since 2006, deep learning (DL) has become a rapidly growing research direction, redefining state-of-the-art performances in a wide range of areas such as object recognition, image segmentation, speech recognition and machine translation. In…

Machine Learning · Computer Science 2016-12-23 Rui Zhao , Ruqiang Yan , Zhenghua Chen , Kezhi Mao , Peng Wang , Robert X. Gao

The rapid uptake of mobile devices and the rising popularity of mobile applications and services pose unprecedented demands on mobile and wireless networking infrastructure. Upcoming 5G systems are evolving to support exploding mobile…

Networking and Internet Architecture · Computer Science 2019-01-31 Chaoyun Zhang , Paul Patras , Hamed Haddadi

Wireless embedded edge devices are ubiquitous in our daily lives, enabling them to gather immense data via onboard sensors and mobile applications. This offers an amazing opportunity to train machine learning (ML) models in the realm of…

Information Theory · Computer Science 2023-12-15 Varun Laxman Muttepawar , Arjun Mehra , Zubair Shaban , Ranjitha Prasad , Harshan Jagadeesh

In recent years, Web services are becoming more and more intelligent (e.g., in understanding user preferences) thanks to the integration of components that rely on Machine Learning (ML). Before users can interact (inference phase) with an…

Software Engineering · Computer Science 2022-11-11 Luciano Baresi , Giovanni Quattrocchi

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Deep learning (DL) is becoming increasingly popular in several application domains and has made several new application features involving computer vision, speech recognition and synthesis, self-driving automobiles, drug design, etc.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-17 K. R. Jayaram , Vinod Muthusamy , Parijat Dube , Vatche Ishakian , Chen Wang , Benjamin Herta , Scott Boag , Diana Arroyo , Asser Tantawi , Archit Verma , Falk Pollok , Rania Khalaf

The ever-growing complexity of optical communication systems and networks demands sophisticated methodologies to extract meaningful insights from vast amounts of heterogeneous data. Machine learning (ML) and deep learning (DL) have emerged…

Signal Processing · Electrical Eng. & Systems 2024-12-25 M. A. Amirabadi , S. A. Nezamalhosseini , M. H. Kahaei , Lawrence R. Chen

Deep learning (DL) along with never-ending advancements in computational processing and cloud technologies have bestowed us powerful analyzing tools and techniques in the past decade and enabled us to use and apply them in various fields of…

Machine Learning · Computer Science 2023-02-23 Farzan Shenavarmasouleh , Farid Ghareh Mohammadi , Khaled M. Rasheed , Hamid R. Arabnia

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han