English
Related papers

Related papers: An FPGA Architecture for Online Learning using the…

200 papers

One of the most applied learning in virtual spaces is using E-Learning systems. Some E-Learning methodologies has been introduced, but the main subject is the most positive feedback from E-Learning systems. In this paper, we introduce a new…

Computers and Society · Computer Science 2010-03-17 Amin Daneshmand Malayeri , Jalal Abdollahi

The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes to new and recurring patterns. However, training deep neural…

Machine Learning · Computer Science 2022-10-18 Quang Pham , Chenghao Liu , Doyen Sahoo , Steven C. H. Hoi

Innovations in neural architectures have fostered significant breakthroughs in language modeling and computer vision. Unfortunately, novel architectures often result in challenging hyper-parameter choices and training instability if the…

Machine Learning · Computer Science 2021-11-25 Chen Zhu , Renkun Ni , Zheng Xu , Kezhi Kong , W. Ronny Huang , Tom Goldstein

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering…

Machine Learning · Computer Science 2022-12-22 Swapnil Sayan Saha , Sandeep Singh Sandha , Mani Srivastava

Matrix multiplication is the bedrock in Deep Learning inference application. When it comes to hardware acceleration on edge computing devices, matrix multiplication often takes up a great majority of the time. To achieve better performance…

Machine Learning · Computer Science 2021-10-12 Yuyang Zhang , Dik Hin Leung , Min Guo , Yijia Xiao , Haoyue Liu , Yunfei Li , Jiyuan Zhang , Guan Wang , Zhen Chen

Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Jesus L. Lobo , Javier Del Ser , Albert Bifet , Nikola Kasabov

For power grid operations, a large body of research focuses on using generation redispatching, load shedding or demand side management flexibilities. However, a less costly and potentially more flexible option would be grid topology…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Antoine Marot , Benjamin Donnot , Camilo Romero , Luca Veyrin-Forrer , Marvin Lerousseau , Balthazar Donon , Isabelle Guyon

Data-driven functions for operation and management often require measurements collected through monitoring for model training and prediction. The number of data sources can be very large, which requires a significant communication and…

Machine Learning · Computer Science 2020-10-29 Xiaoxuan Wang , Forough Shahab Samani , Rolf Stadler

In this paper, we apply a new promising tool for pattern classification, namely, the Tsetlin Machine (TM), to the field of disease forecasting. The TM is interpretable because it is based on manipulating expressions in propositional logic,…

Machine Learning · Computer Science 2019-06-25 K. Darshana Abeyrathna , Ole-Christoffer Granmo , Xuan Zhang , Morten Goodwin

Almost in every heavily computation-dependent application, from 6G communication systems to autonomous driving platforms, a large portion of computing should be near to the client side. Edge computing (AI at Edge) in mobile devices is one…

Hardware Architecture · Computer Science 2024-07-29 Seyed Nima Omidsajedi , Rekha Reddy , Jianming Yi , Jan Herbst , Christoph Lipps , Hans Dieter Schotten

Machine learning algorithms have become indispensable in today's world. They support and accelerate the way we make decisions based on the data at hand. This acceleration means that data structures that were valid at one moment could no…

Machine Learning · Computer Science 2025-02-11 Cedric Kulbach , Lucas Cazzonelli , Hoang-Anh Ngo , Minh-Huong Le-Nguyen , Albert Bifet

A central capability of intelligent systems is the ability to continuously build upon previous experiences to speed up and enhance learning of new tasks. Two distinct research paradigms have studied this question. Meta-learning views this…

Machine Learning · Computer Science 2019-07-05 Chelsea Finn , Aravind Rajeswaran , Sham Kakade , Sergey Levine

Traditional federated learning (FL) methods have limited support for clients with varying computational and communication abilities, leading to inefficiencies and potential inaccuracies in model training. This limitation hinders the…

Machine Learning · Computer Science 2024-06-17 Jong-Ik Park , Carlee Joe-Wong

While hardware-software co-design has significantly improved the efficiency of neural network inference, modeling the training phase remains a critical yet underexplored challenge. Training workloads impose distinct constraints,…

Machine Learning · Computer Science 2026-03-17 Jérémy Morlier , Robin Geens , Stef Cuyckens , Arne Symons , Marian Verhelst , Vincent Gripon , Mathieu Léonardon

In recent years, machine learning has been adopted to complex networks, but most existing works concern about the structural properties. To use machine learning to detect phase transitions and accurately identify the critical transition…

Physics and Society · Physics 2020-01-08 Qi Ni , Ming Tang , Ying Liu , Ying-Cheng Lai

In the realm of high-frequency data streams, achieving real-time learning within varying memory constraints is paramount. This paper presents Ferret, a comprehensive framework designed to enhance online accuracy of Online Continual Learning…

Machine Learning · Computer Science 2025-03-18 Yuhao Zhou , Yuxin Tian , Jindi Lv , Mingjia Shi , Yuanxi Li , Qing Ye , Shuhao Zhang , Jiancheng Lv

Accelerated edge devices, like Nvidia's Jetson with 1000+ CUDA cores, are increasingly used for DNN training and federated learning, rather than just for inferencing workloads. A unique feature of these compact devices is their fine-grained…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-22 Prashanthi S. K. , Saisamarth Taluri , Beautlin S , Lakshya Karwa , Yogesh Simmhan

This study addresses the challenge of online learning in contexts where agents accumulate disparate data, face resource constraints, and use different local algorithms. This paper introduces the Switched Online Learning Algorithm (SOLA),…

Machine Learning · Computer Science 2023-12-12 Darshan Gadginmath , Shivanshu Tripathi , Fabio Pasqualetti

New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains. The growing applications of machine learning…

Deep learning models are considered to be state-of-the-art in many offline machine learning tasks. However, many of the techniques developed are not suitable for online learning tasks. The problem of using deep learning models with…

Machine Learning · Computer Science 2019-05-28 Guy Uziel