English
Related papers

Related papers: MobileTL: On-device Transfer Learning with Inverte…

200 papers

Molecular-orbital-based machine learning (MOB-ML) provides a general framework for the prediction of accurate correlation energies at the cost of obtaining molecular orbitals. We demonstrate the importance of preserving physical…

Chemical Physics · Physics 2021-03-17 Tamara Husch , Jiace Sun , Lixue Cheng , Sebastian J. R. Lee , Thomas F. Miller

Mobile edge computing (MEC) is essential for next-generation mobile network applications that prioritize various performance metrics, including delays and energy consumption. However, conventional single-objective scheduling solutions…

Networking and Internet Architecture · Computer Science 2023-07-28 Ning Yang , Junrui Wen , Meng Zhang , Ming Tang

Large language models (LLMs) have demonstrated exceptional performance across a variety of tasks. However, their substantial scale leads to significant computational resource consumption during inference, resulting in high costs.…

Machine Learning · Computer Science 2025-06-13 Zhaode Wang , Jingbang Yang , Xinyu Qian , Shiwen Xing , Xiaotang Jiang , Chengfei Lv , Shengyu Zhang

Federated learning (FL) over heterogeneous IoT edge devices faces coupled system-modality-data heterogeneity: the lower-cost device carries both fewer sensors and less computational power, so the slowest device (straggler) produces the most…

Networking and Internet Architecture · Computer Science 2026-04-07 Beining Wu , Zihao Ding , Jun Huang

Backprojection networks have achieved promising super-resolution performance for nature images but not well be explored in the remote sensing image super-resolution (RSISR) field due to the high computation costs. In this paper, we propose…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Jinglei Hao , Wukai Li , Binglu Wang , Shunzhou Wang , Yuting Lu , Ning Li , Yongqiang Zhao

Transfer learning (TL) from pretrained deep models is a standard practice in modern medical image classification (MIC). However, what levels of features to be reused are problem-dependent, and uniformly finetuning all layers of pretrained…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Le Peng , Hengyue Liang , Gaoxiang Luo , Taihui Li , Ju Sun

When pre-trained models become rapidly larger, the cost of fine-tuning on downstream tasks steadily increases, too. To economically fine-tune these models, parameter-efficient transfer learning (PETL) is proposed, which only tunes a tiny…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Minghao Fu , Ke Zhu , Jianxin Wu

Computation offloading has become a popular solution to support computationally intensive and latency-sensitive applications by transferring computing tasks to mobile edge servers (MESs) for execution, which is known as mobile/multi-access…

Signal Processing · Electrical Eng. & Systems 2023-09-06 Ruihuai Liang , Bo Yang , Zhiwen Yu , Xuelin Cao , Derrick Wing Kwan Ng , Chau Yuen

Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) can expand the coverage of mobile edge computing (MEC) services by reflecting and transmitting signals simultaneously, enabling full-space coverage.…

Emerging Technologies · Computer Science 2025-03-07 Dongdong Yang , Bin Li , Dusit Niyato

Resource constraints have restricted several EdgeAI applications to machine learning inference approaches, where models are trained on the cloud and deployed to the edge device. This poses challenges such as bandwidth, latency, and privacy…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Atah Nuh Mih , Hung Cao , Asfia Kawnine , Monica Wachowicz

In this paper, we propose a novel offloading learning approach to compromise energy consumption and latency in multi-tier network with mobile edge computing. In order to solve this integer programming problem, instead of using conventional…

Information Theory · Computer Science 2019-12-10 Shuhan Zhu , Wei Xu , Lisheng Fan , Kezhi Wang , George K. Karagiannidis

As mobile devices increasingly become focal points for advanced applications, edge computing presents a viable solution to their inherent computational limitations, particularly in deploying large language models (LLMs). However, despite…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Chang Liu , Jun Zhao

Fine-tuning pre-trained language models for multiple tasks tends to be expensive in terms of storage. To mitigate this, parameter-efficient transfer learning (PETL) methods have been proposed to address this issue, but they still require a…

Computation and Language · Computer Science 2023-06-13 Guangtao Zeng , Peiyuan Zhang , Wei Lu

Current multimodal large lanauge models possess strong perceptual and reasoning capabilities, however high computational and memory requirements make them difficult to deploy directly on on-device environments. While small-parameter models…

Federated learning has emerged recently as a promising solution for distributing machine learning tasks through modern networks of mobile devices. Recent studies have obtained lower bounds on the expected decrease in model loss that is…

Iterative learning to infer approaches have become popular solvers for inverse problems. However, their memory requirements during training grow linearly with model depth, limiting in practice model expressiveness. In this work, we propose…

Machine Learning · Computer Science 2019-11-26 Patrick Putzky , Max Welling

Finetuning can be used to tackle domain-specific tasks by transferring knowledge. Previous studies on finetuning focused on adapting only the weights of a task-specific classifier or re-optimizing all layers of the pre-trained model using…

Machine Learning · Computer Science 2023-01-18 Basel Barakat , Qiang Huang

Transformer-based large language models (LLMs) have demonstrated impressive capabilities in a variety of natural language processing (NLP) tasks. Nonetheless, it is challenging to deploy and fine-tune LLMs on mobile edge devices with…

Machine Learning · Computer Science 2023-11-23 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Jiming Chen

The rapid growth in mobile broadband usage and increasing subscribers have made it crucial to ensure reliable network performance. As mobile networks grow more complex, especially during peak hours, manual collection of Key Performance…

Networking and Internet Architecture · Computer Science 2024-10-08 Nooruddin Noonari , Daniel Corujo , Rui L. Aguiar , Francisco J. Ferrao

The success of large-scale pre-trained models has established fine-tuning as a standard method for achieving significant improvements in downstream tasks. However, fine-tuning the entire parameter set of a pre-trained model is costly.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yijin Huang , Pujin Cheng , Roger Tam , Xiaoying Tang