English
Related papers

Related papers: Dynamic Tsetlin Machine Accelerators for On-Chip T…

200 papers

We introduce the Differentiable Weightless Neural Network (DWN), a model based on interconnected lookup tables. Training of DWNs is enabled by a novel Extended Finite Difference technique for approximate differentiation of binary values. We…

Future machine learning (ML) powered applications, such as autonomous driving and augmented reality, involve training and inference tasks with timeliness requirements and are communication and computation intensive, which demands for the…

Networking and Internet Architecture · Computer Science 2020-09-24 Yuxuan Sun , Wenqi Shi , Xiufeng Huang , Sheng Zhou , Zhisheng Niu

Distributed inference is a popular approach for efficient DNN inference at the edge. However, traditional Static and Dynamic DNNs are not distribution-friendly, causing system reliability and adaptability issues. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Lei Xun , Mingyu Hu , Hengrui Zhao , Amit Kumar Singh , Jonathon Hare , Geoff V. Merrett

Many emerging AI applications request distributed machine learning (ML) among edge systems (e.g., IoT devices and PCs at the edge of the Internet), where data cannot be uploaded to a central venue for model training, due to their large…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-19 Hanpeng Hu , Dan Wang , Chuan Wu

This paper presents, NeuroTrainer, an intelligent memory module with in-memory accelerators that forms the building block of a scalable architecture for energy efficient training for deep neural networks. The proposed architecture is based…

Hardware Architecture · Computer Science 2017-10-13 Duckhwan Kim , Taesik Na , Sudhakar Yalamanchili , Saibal Mukhopadhyay

We propose a distributed system based on lowpower embedded FPGAs designed for edge computing applications focused on exploring distributing scheduling optimizations for Deep Learning (DL) workloads to obtain the best performance regarding…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-31 Hans Johnson , Tianyang Fang , Alejandro Perez-Vicente , Jafar Saniie

Large Language Models (LLMs) deployed on edge devices, known as edge LLMs, need to continuously fine-tune their model parameters from user-generated data under limited resource constraints. However, most existing learning methods are not…

Machine Learning · Computer Science 2024-11-14 Ruiyang Qin , Pengyu Ren , Zheyu Yan , Liu Liu , Dancheng Liu , Amir Nassereldine , Jinjun Xiong , Kai Ni , Sharon Hu , Yiyu Shi

Edge computing has gained significant traction in recent years, promising enhanced efficiency by integrating artificial intelligence capabilities at the edge. While the focus has primarily been on the deployment and inference of Machine…

Machine Learning · Computer Science 2024-10-14 Aymen Rayane Khouas , Mohamed Reda Bouadjenek , Hakim Hacid , Sunil Aryal

Distributed Machine Learning (DML) on resource-constrained edge devices holds immense potential for real-world applications. However, achieving fast convergence in DML in these heterogeneous environments remains a significant challenge.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-10 Advik Raj Basani , Siddharth Chaitra Vivek , Advaith Krishna , Arnab K. Paul

With the popularity of Internet of Things (IoT), edge computing and cloud computing, more and more stream analytics applications are being developed including real-time trend prediction and object detection on top of IoT sensing data. One…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Xin Wang , Azim Khan , Jianwu Wang , Aryya Gangopadhyay , Carl E. Busart , Jade Freeman

Split Learning (SL) recently emerged as an efficient paradigm for distributed Machine Learning (ML) suitable for the Internet Of Things (IoT)-Cloud systems. However, deploying SL on resource-constrained edge IoT platforms poses a…

Machine Learning · Computer Science 2025-02-14 Romina Soledad Molina , Vukan Ninkovic , Dejan Vukobratovic , Maria Liz Crespo , Marco Zennaro

In recent years, non-intrusive load monitoring (NILM) technology has attracted much attention in the related research field by virtue of its unique advantage of utilizing single meter data to achieve accurate decomposition of device-level…

Signal Processing · Electrical Eng. & Systems 2025-04-24 Hangxu Liu , Yaojie Sun , Yu Wang

Advances in deep neural networks (DNNs) are transforming science and technology. However, the increasing computational demands of the most powerful DNNs limit deployment on low-power devices, such as smartphones and sensors -- and this…

This paper proposes a machine learning-assisted channel estimation approach for massive MIMO systems, leveraging DNNs to outperform traditional LS and MMSE methods. In 5G and beyond, accurate channel estimation mitigates pilot contamination…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Haoran He

Nowadays, deep neural networks (DNNs) are the core enablers for many emerging edge AI applications. Conventional approaches to training DNNs are generally implemented at central servers or cloud centers for centralized learning, which is…

Networking and Internet Architecture · Computer Science 2020-03-24 Deyin Liu , Xu Chen , Zhi Zhou , Qing Ling

Recurrent neural networks (RNNs) have shown significant improvements in recent years for speech enhancement. However, the model complexity and inference time cost of RNNs are much higher than deep feed-forward neural networks (DNNs).…

Sound · Computer Science 2020-11-12 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen , Leichao Song

Metaverse and Digital Twin (DT) have attracted much academic and industrial attraction to approach the future digital world. This paper introduces the advantages of deep reinforcement learning (DRL) in assisting Metaverse system-based…

Information Theory · Computer Science 2025-06-04 Tam Ninh Thi-Thanh , Trinh Van Chien , Hung Tran , Nguyen Hoai Son , Van Nhan Vo

State-of-the-art named entity recognition (NER) systems have been improving continuously using neural architectures over the past several years. However, many tasks including NER require large sets of annotated data to achieve such…

Machine Learning · Computer Science 2020-01-22 Parminder Bhatia , Kristjan Arumae , Busra Celikkaya

In the last decade, data-driven algorithms outperformed traditional optimization-based algorithms in many research areas, such as computer vision, natural language processing, etc. However, extensive data usages bring a new challenge or…

Machine Learning · Computer Science 2021-12-02 Shih-Chun Lin , Chia-Hung Lin

On-chip DNN inference and training at the Extreme-Edge (TinyML) impose strict latency, throughput, accuracy and flexibility requirements. Heterogeneous clusters are promising solutions to meet the challenge, combining the flexibility of…

Hardware Architecture · Computer Science 2023-04-03 Angelo Garofalo , Yvan Tortorella , Matteo Perotti , Luca Valente , Alessandro Nadalini , Luca Benini , Davide Rossi , Francesco Conti