English
Related papers

Related papers: Quantized-Tinyllava: a new multimodal foundation m…

200 papers

Quantum machine learning (QML) can complement the growing trend of using learned models for a myriad of classification tasks, from image recognition to natural speech processing. A quantum advantage arises due to the intractability of…

Quantum Physics · Physics 2021-03-11 William M Watkins , Samuel Yen-Chi Chen , Shinjae Yoo

Federated Learning is a promising approach for learning from user data while preserving data privacy. However, the high requirements of the model training process make it difficult for clients with limited memory or bandwidth to…

Cryptography and Security · Computer Science 2024-01-18 Minh K. Quan , Dinh C. Nguyen , Van-Dinh Nguyen , Mayuri Wijayasundara , Sujeeva Setunge , Pubudu N. Pathirana

In private federated learning (FL), a server aggregates differentially private updates from a large number of clients in order to train a machine learning model. The main challenge in this setting is balancing privacy with both…

Machine Learning · Computer Science 2023-08-11 Chuan Guo , Kamalika Chaudhuri , Pierre Stock , Mike Rabbat

Federated Learning (FL) enables collaborative model building among a large number of participants without the need for explicit data sharing. But this approach shows vulnerabilities when privacy inference attacks are applied to it. In…

Machine Learning · Computer Science 2022-10-26 Pretom Roy Ovi , Emon Dey , Nirmalya Roy , Aryya Gangopadhyay

To address data locality and privacy restrictions, Federated Learning (FL) has recently been adopted to fine-tune large language models (LLMs), enabling improved performance on various downstream tasks without requiring aggregated data.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-11 Han Liu , Ruoyao Wen , Srijith Nair , Jia Liu , Wenjing Lou , Chongjie Zhang , William Yeoh , Yevgeniy Vorobeychik , Ning Zhang

Accurate load forecasting is crucial for energy management, infrastructure planning, and demand-supply balancing. Smart meter data availability has led to the demand for sensor-based load forecasting. Conventional ML allows training a…

Machine Learning · Computer Science 2025-07-08 Asif Iqbal , Prosanta Gope , Biplab Sikdar

Quantum learning models hold the potential to bring computational advantages over the classical realm. As powerful quantum servers become available on the cloud, ensuring the protection of clients' private data becomes crucial. By…

Quantum Physics · Physics 2025-03-19 Weikang Li , Dong-Ling Deng

With the rise of large language models, service providers offer language models as a service, enabling users to fine-tune customized models via uploaded private datasets. However, this raises concerns about sensitive data leakage. Prior…

Cryptography and Security · Computer Science 2026-01-22 Yi Liu , Weixiang Han , Chengjun Cai , Xingliang Yuan , Cong Wang

Low-bit post-training quantization (PTQ) is a pivotal technique for deploying Vision-Language Models (VLMs) on resource-constrained devices. However, existing PTQ methods often degrade VLMs' accuracy due to the heterogeneous activation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yi Zhong , Haotong Qin , Xindong Zhang , Lei Zhang , Guolei Sun

Mobile devices and the immense amount and variety of data they generate are key enablers of machine learning (ML)-based applications. Traditional ML techniques have shifted toward new paradigms such as federated (FL) and split learning (SL)…

Machine Learning · Computer Science 2022-07-06 Pranvera Kortoçi , Yilei Liang , Pengyuan Zhou , Lik-Hang Lee , Abbas Mehrabi , Pan Hui , Sasu Tarkoma , Jon Crowcroft

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Revealing latent structure in data is an active field of research, having introduced exciting technologies such as variational autoencoders and adversarial networks, and is essential to push machine learning towards unsupervised knowledge…

Machine Learning · Computer Science 2019-10-25 Daniel C. Castro , Jeremy Tan , Bernhard Kainz , Ender Konukoglu , Ben Glocker

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba

Deploying foundation models (FMs) on uncrewed aerial vehicles (UAVs) promises broad ``low-altitude economy'' applications. Split federated learning (SFL)-based fine-tuning leverages distributed data while keeping raw data local and reduces…

Information Theory · Computer Science 2025-11-20 Zizhen Zhou , Ying-Chang Liang , Yanyu Cheng , Wei Yang Bryan Lim

To enable the pre-trained models to be fine-tuned with local data on edge devices without sharing data with the cloud, we design an efficient split fine-tuning (SFT) framework for edge and cloud collaborative learning. We propose three…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-01 Shaohuai Shi , Qing Yang , Yang Xiang , Shuhan Qi , Xuan Wang

Quantum federated learning (QFL) has recently emerged as a promising paradigm for privacy-preserving collaborative learning, yet most existing studies focus on horizontal federated learning and ignore the vertical federated learning (VFL),…

Quantum Physics · Physics 2026-03-24 Hao Luo , Zhiyuan Zhai , Qianli Zhou , Jun Qi , Yong Deng , Xin Wang

Designing an effective representation learning method for multimodal sentiment analysis tasks is a crucial research direction. The challenge lies in learning both shared and private information in a complete modal representation, which is…

Computation and Language · Computer Science 2024-03-20 Songning Lai , Jiakang Li , Guinan Guo , Xifeng Hu , Yulong Li , Yuan Tan , Zichen Song , Yutong Liu , Zhaoxia Ren , Chun Wan , Danmin Miao , Zhi Liu

Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yefei He , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Privacy-sensitive users require deploying large language models (LLMs) within their own infrastructure (on-premises) to safeguard private data and enable customization. However, vulnerabilities in local environments can lead to unauthorized…

Machine Learning · Computer Science 2025-10-08 Hanbo Huang , Yihan Li , Bowen Jiang , Bo Jiang , Lin Liu , Ruoyu Sun , Zhuotao Liu , Shiyu Liang

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath