English
Related papers

Related papers: POET: Training Neural Networks on Tiny Devices wit…

200 papers

Balancing exploration and exploitation is a core challenge in sequential decision-making and black-box optimization. We introduce POETS ($\textbf{Po}$licy $\textbf{E}$nsembles for $\textbf{T}$hompson $\textbf{S}$ampling), a novel framework…

Machine Learning · Computer Science 2026-05-11 Nicolas Menet , Andreas Krause , Abbas Rahimi

Nowadays, as edge devices such as smartphones become prevalent, there are increasing demands for personalized services. However, traditional personalization methods are not suitable for edge devices because retraining or finetuning is…

Machine Learning · Computer Science 2021-03-30 Jangho Kim , Simyung Chang , Sungrack Yun , Nojun Kwak

Neural Networks (NN), although successfully applied to several Artificial Intelligence tasks, are often unnecessarily over-parametrised. In edge/fog computing, this might make their training prohibitive on resource-constrained devices,…

Machine Learning · Computer Science 2022-01-20 Lorenzo Valerio , Franco Maria Nardini , Andrea Passarella , Raffaele Perego

Recent advancements in machine learning (ML) have enabled its deployment on resource-constrained edge devices, fostering innovative applications such as intelligent environmental sensing. However, these devices, particularly…

Machine Learning · Computer Science 2025-04-15 Yi Hu , Jinhang Zuo , Eddie Zhang , Bob Iannucci , Carlee Joe-Wong

Recent studies on automatic neural architectures search have demonstrated significant performance, competitive to or even better than hand-crafted neural architectures. However, most of the existing network architecture tend to use…

Machine Learning · Computer Science 2020-06-12 Peiye Liu , Bo Wu , Huadong Ma , Mingoo Seok

While pre-trained language models (e.g., BERT) have achieved impressive results on different natural language processing tasks, they have large numbers of parameters and suffer from big computational and memory costs, which make them…

Computation and Language · Computer Science 2021-06-01 Jin Xu , Xu Tan , Renqian Luo , Kaitao Song , Jian Li , Tao Qin , Tie-Yan Liu

Fine-tuning large-scale Transformers has led to the explosion of many AI applications across Natural Language Processing and Computer Vision tasks. However, fine-tuning all pre-trained model parameters becomes impractical as the model size…

Machine Learning · Computer Science 2024-10-07 John Nguyen , Sid Wang , Ke Li , Carole-Jean Wu

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing…

Information Theory · Computer Science 2020-03-03 Kai Yang , Yuanming Shi , Wei Yu , Zhi Ding

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer…

Computation and Language · Computer Science 2020-02-11 Zhenzhong Lan , Mingda Chen , Sebastian Goodman , Kevin Gimpel , Piyush Sharma , Radu Soricut

Recently, pre-trained language representation flourishes as the mainstay of the natural language understanding community, e.g., BERT. These pre-trained language representations can create state-of-the-art results on a wide range of…

Machine Learning · Computer Science 2019-12-24 Fu-Ming Guo , Sijia Liu , Finlay S. Mungall , Xue Lin , Yanzhi Wang

State-of-the-art visual generative AI tools hold immense potential to assist users in the early ideation stages of creative tasks -- offering the ability to generate (rather than search for) novel and unprecedented (instead of existing)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Evans Xu Han , Alice Qian Zhang , Haiyi Zhu , Hong Shen , Paul Pu Liang , Jane Hsieh

Parameter-efficient fine-tuning (PEFT) of pre-trained language models (PLMs) has emerged as a highly successful approach, with training only a small number of parameters without sacrificing performance and becoming the de-facto learning…

Computation and Language · Computer Science 2023-10-20 Baohao Liao , Shaomu Tan , Christof Monz

In this paper, we consider partitioned edge learning (PARTEL), which implements parameter-server training, a well known distributed learning method, in a wireless network. Thereby, PARTEL leverages distributed computation resources at edge…

Information Theory · Computer Science 2021-03-19 Dingzhu Wen , Ki-Jun Jeon , Mehdi Bennis , Kaibin Huang

Training wide and deep neural networks (DNNs) require large amounts of storage resources such as memory because the intermediate activation data must be saved in the memory during forward propagation and then restored for backward…

Artificial Intelligence · Computer Science 2021-11-19 Sian Jin , Chengming Zhang , Xintong Jiang , Yunhe Feng , Hui Guan , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

Training on the Edge enables neural networks to learn continuously from new data after deployment on memory-constrained edge devices. Previous work is mostly concerned with reducing the number of model parameters which is only beneficial…

Machine Learning · Computer Science 2021-11-01 Abdelrahman Hosny , Marina Neseem , Sherief Reda

An increasing number of artificial intelligence (AI) applications involve the execution of deep neural networks (DNNs) on edge devices. Many practical reasons motivate the need to update the DNN model on the edge device post-deployment,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Bo Chen , Ali Bakhshi , Gustavo Batista , Brian Ng , Tat-Jun Chin

This paper investigates the energy savings that near-subthreshold processors can obtain in edge AI applications and proposes strategies to improve them while maintaining the accuracy of the application. The selected processors deploy…

Machine Learning · Computer Science 2023-04-20 Zichao Shen , Neil Howard , Jose Nunez-Yanez

Deploying machine learning models on compute-constrained devices has become a key building block of modern IoT applications. In this work, we present a compression scheme for boosted decision trees, addressing the growing need for…

Machine Learning · Computer Science 2026-03-04 Nina Herrmann , Jan Stenkamp , Benjamin Karic , Stefan Oehmcke , Fabian Gieseke

Neural networks have long strived to emulate the learning capabilities of the human brain. While deep neural networks (DNNs) draw inspiration from the brain in neuron design, their training methods diverge from biological foundations.…

Neural and Evolutionary Computing · Computer Science 2026-02-24 Joseph Bingham , Saman Zonouz , Dvir Aran

The pre-trained language models like BERT, though powerful in many natural language processing tasks, are both computation and memory expensive. To alleviate this problem, one approach is to compress them for specific tasks before…

Computation and Language · Computer Science 2020-10-12 Lu Hou , Zhiqi Huang , Lifeng Shang , Xin Jiang , Xiao Chen , Qun Liu