English
Related papers

Related papers: Lightweight and Scalable Transfer Learning Framewo…

200 papers

Supervised neural approaches are hindered by their dependence on large, meticulously annotated datasets, a requirement that is particularly cumbersome for sequential tasks. The quality of annotations tends to deteriorate with the transition…

Recently, Magnetic Resonance Fingerprinting (MRF) was proposed as a quantitative imaging technique for the simultaneous acquisition of tissue parameters such as relaxation times $T_1$ and $T_2$. Although the acquisition is highly…

Image and Video Processing · Electrical Eng. & Systems 2019-07-23 Elisabeth Hoppe , Florian Thamm , Gregor Körzdörfer , Christopher Syben , Franziska Schirrmacher , Mathias Nittka , Josef Pfeuffer , Heiko Meyer , Andreas Maier

Understanding the internal representations of large language models (LLMs) is a central challenge in interpretability research. Existing feature interpretability methods often rely on strong assumptions about the structure of…

Machine Learning · Computer Science 2025-09-30 Yifan Luo , Zhennan Zhou , Bin Dong

Interest in deploying Deep Neural Network (DNN) inference on edge devices has resulted in an explosion of the number and types of hardware platforms to use. While the high-level programming interface, such as TensorFlow, can be readily…

Mathematical Software · Computer Science 2023-03-09 Upasana Sridhar , Nicholai Tukanov , Elliott Binder , Tze Meng Low , Scott McMillan , Martin D. Schatz

Vision-language models (VLMs) like CLIP have demonstrated remarkable applicability across a variety of downstream tasks, including zero-shot image classification. Recently, the use of prompts or adapters for efficient transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Yongjin Yang , Jongwoo Ko , Se-Young Yun

Transformer-based large language model (LLM) inference serving is now the backbone of many cloud services. LLM inference consists of a prefill phase and a decode phase. However, existing LLM deployment practices often overlook the distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Cunchen Hu , Heyang Huang , Liangliang Xu , Xusheng Chen , Jiang Xu , Shuang Chen , Hao Feng , Chenxi Wang , Sa Wang , Yungang Bao , Ninghui Sun , Yizhou Shan

Transfer learning is a powerful way to adapt existing deep learning models to new emerging use-cases in remote sensing. Starting from a neural network already trained for semantic segmentation, we propose to modify its label space to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Gaston Lenczner , Adrien Chan-Hon-Tong , Nicola Luminari , Bertrand Le Saux

Foundational Models are an emerging widely used technique of GenAI. These models are distinguished by their scalability and the ease with which they can be adapted through the exploitation of Transfer Learning. The availability of high…

Machine Learning · Computer Science 2025-05-13 M. Germán-Morales , A. J. Rivera-Rivas , M. J. del Jesus Díaz , C. J. Carmona

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model relations between elements of a sequence in parallel…

Machine Learning · Computer Science 2025-02-20 Jaemu Heo , Eldor Fozilov , Hyunmin Song , Taehwan Kim

While current machine learning models have impressive performance over a wide range of applications, their large size and complexity render them unsuitable for tasks such as remote monitoring on edge devices with limited storage and…

Machine Learning · Computer Science 2020-02-13 Chi Zhang , Yong Sheng Soh , Ling Feng , Tianyi Zhou , Qianxiao Li

Purpose: To present a fully open-source framework for quasi-real-time streaming and cloud-based processing of low-field (LF) MRI data, addressing the growing computational demands of advanced reconstruction and post-processing pipelines in…

Multi-instance learning is common for computer vision tasks, especially in biomedical image processing. Traditional methods for multi-instance learning focus on designing feature aggregation methods and multi-instance classifiers, where the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yanlun Tu , Houchao Lei , Wei Long , Yang Yang

Renewable energy integration into microgrids has become a key approach to addressing global energy issues such as climate change and resource scarcity. However, the variability of renewable sources and the rising occurrence of High Impact…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Mohammad Hossein Nejati Amiri , Fawaz Annaz , Mario De Oliveira , Florimond Gueniat

Partial discharge originates from microscopic insulation imperfections in high-voltage apparatus and is widely considered a critical marker of incipient deterioration. Conventional partial discharge detection methods are typically…

Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations:…

Computation and Language · Computer Science 2025-08-21 Jiaming Leng , Yunying Bi , Chuan Qin , Bing Yin , Yanyong Zhang , Chao Wang

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Disaggregation has emerged as a powerful strategy for optimizing large language model (LLM) inference by separating compute-intensive prefill and memory-bound decode phases across specialized GPUs. This separation improves utilization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Yiwei Jiang , Sangeeta Chowdhary , Nathaniel Morris , Rutwik Jain , Srilatha Manne , Sam Bayliss

Scalable, high-fidelity quantum-state readout remains a central challenge in the development of large-scale superconducting quantum processors. Conventional dispersive readout architectures depend on bulky isolators and external amplifiers,…

Quantum Physics · Physics 2026-02-17 Leon Bello , Boris Mesits , Michael Hatridge , Hakan E. Türeci

The distributed inference paradigm enables the computation workload to be distributed across multiple devices, facilitating the implementations of deep learning based intelligent services on extremely resource-constrained Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-21 Li Wang , Liang Li , Lianming Xu , Xian Peng , Aiguo Fei

Message passing is the core of most graph models such as Graph Convolutional Network (GCN) and Label Propagation (LP), which usually require a large number of clean labeled data to smooth out the neighborhood over the graph. However, the…

Machine Learning · Computer Science 2021-10-29 Wentao Zhang , Yexin Wang , Zhenbang You , Meng Cao , Ping Huang , Jiulong Shan , Zhi Yang , Bin Cui