中文
相关论文

相关论文: Open-Source LLM-Driven Federated Transformer for P…

200 篇论文

Large language models (LLMs) have demonstrated remarkable capacities on various tasks, and integrating the capacities of LLMs into the Internet of Things (IoT) applications has drawn much research attention recently. Due to security…

人工智能 · 计算机科学 2024-10-08 Bin Xiao , Burak Kantarci , Jiawen Kang , Dusit Niyato , Mohsen Guizani

Large language models (LLMs) show amazing performance on many domain-specific tasks after fine-tuning with some appropriate data. However, many domain-specific data are privately distributed across multiple owners. Thus, this dilemma raises…

机器学习 · 计算机科学 2024-06-26 Feijie Wu , Zitao Li , Yaliang Li , Bolin Ding , Jing Gao

With the promotion of chatgpt to the public, Large language models indeed showcase remarkable common sense, reasoning, and planning skills, frequently providing insightful guidance. These capabilities hold significant promise for their…

人工智能 · 计算机科学 2023-09-14 Siyao Zhang , Daocheng Fu , Zhao Zhang , Bin Yu , Pinlong Cai

Federated Learning (FL) is a distributed machine learning technique that preserves data privacy by sharing only the trained parameters instead of the client data. This makes FL ideal for highly dynamic, heterogeneous, and time-critical…

机器学习 · 计算机科学 2025-10-30 Kasun Eranda Wijethilake , Adnan Mahmood , Quan Z. Sheng

Traffic prediction aims to forecast future traffic conditions using historical traffic data, serving a crucial role in urban computing and transportation management. While transfer learning and federated learning have been employed to…

机器学习 · 计算机科学 2026-02-03 Zhihao Zeng , Ziquan Fang , Yuting Huang , Lu Chen , Yunjun Gao

Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clients may not be…

机器学习 · 计算机科学 2022-06-27 Farzan Farnia , Amirhossein Reisizadeh , Ramtin Pedarsani , Ali Jadbabaie

The integration of Internet of Things (IoT) technology in various domains has led to operational advancements, but it has also introduced new vulnerabilities to cybersecurity threats, as evidenced by recent widespread cyberattacks on IoT…

密码学与安全 · 计算机科学 2025-01-06 Alaeddine Diaf , Abdelaziz Amara Korba , Nour Elislem Karabadji , Yacine Ghamri-Doudane

With the blowout development of pre-trained models (PTMs), the efficient tuning of these models for diverse downstream applications has emerged as a pivotal research concern. Although recent investigations into prompt tuning have provided…

机器学习 · 计算机科学 2023-10-06 Zihao Lin , Yan Sun , Yifan Shi , Xueqian Wang , Lifu Huang , Li Shen , Dacheng Tao

This study proposes a universal flow field prediction framework based on knowledge transfer from large language model (LLM), addressing the high computational costs of traditional computational fluid dynamics (CFD) methods and the limited…

机器学习 · 计算机科学 2025-06-11 Weihao Zou , Weibing Feng , Pin Wu

The FAPL-DM-BC solution is a new FL-based privacy, security, and scalability solution for the Internet of Vehicles (IoV). It leverages Federated Adaptive Privacy-Aware Learning (FAPL) and Dynamic Masking (DM) to learn and adaptively change…

密码学与安全 · 计算机科学 2025-01-03 Sathwik Narkedimilli , Amballa Venkata Sriram , Sujith Makam , MSVPJ Sathvik , Sai Prashanth Mallellu

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

机器学习 · 计算机科学 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu

Pre-trained Language Models (PLMs) have demonstrated impressive performance in various NLP tasks. However, traditional fine-tuning methods for leveraging PLMs for downstream tasks entail significant computational overhead. Prompt-tuning has…

机器学习 · 计算机科学 2025-07-29 Ali Shakeri , Wei Emma Zhang , Amin Beheshti , Weitong Chen , Jian Yang , Lishan Yang

By adapting Large Language Models (LLMs) to domain-specific tasks or enriching them with domain-specific knowledge, we can fully harness the capabilities of LLMs. Nonetheless, a gap persists in achieving simultaneous mutual enhancement…

计算与语言 · 计算机科学 2026-04-24 Tao Fan , Yan Kang , Guoqiang Ma , Lixin Fan , Shuoling Liu , Kai Chen , Qiang Yang

Vehicle-to-everything (V2X) networks support a variety of safety, entertainment, and commercial applications. This is realized by applying the principles of the Internet of Vehicles (IoV) to facilitate connectivity among vehicles and…

网络与互联网体系结构 · 计算机科学 2024-10-15 Aly Sabri Abdalla , Ahmad Al-Kabbany , Ehab F. Badran , Vuk Marojevic

Efficiently enhancing the reasoning capabilities of large language models (LLMs) in federated learning environments remains challenging, particularly when balancing performance gains with strict computational, communication, and privacy…

计算与语言 · 计算机科学 2025-08-15 Chuan Li , Qianyi Zhao , Fengran Mo , Cen Chen

Multimodal Large Language Models (LLMs) are pivotal in revolutionizing customer support and operations by integrating multiple modalities such as text, images, and audio. Federated Prompt Learning (FPL) is a recently proposed approach that…

机器学习 · 计算机科学 2025-02-14 Linh Tran , Wei Sun , Stacy Patterson , Ana Milanova

Data today is decentralized, generated and stored across devices and institutions where privacy, ownership, and regulation prevent centralization. This motivates the need to train generative models directly from distributed data locally…

机器学习 · 计算机科学 2025-09-26 Zifan Wang , Anqi Dong , Mahmoud Selim , Michael M. Zavlanos , Karl H. Johansson

Pre-trained large language models (LLMs) have become a cornerstone of modern natural language processing, with their capabilities extending across a wide range of applications and languages. However, the fine-tuning of multilingual LLMs,…

计算与语言 · 计算机科学 2025-07-08 Wanru Zhao , Yihong Chen , Royson Lee , Xinchi Qiu , Yan Gao , Hongxiang Fan , Nicholas D. Lane

LLMs have demonstrated great capabilities in various NLP tasks. Different entities can further improve the performance of those LLMs on their specific downstream tasks by fine-tuning LLMs. When several entities have similar interested…

机器学习 · 计算机科学 2023-09-04 Weirui Kuang , Bingchen Qian , Zitao Li , Daoyuan Chen , Dawei Gao , Xuchen Pan , Yuexiang Xie , Yaliang Li , Bolin Ding , Jingren Zhou

The Vision Language Model (VLM) excels in aligning vision and language representations, and prompt learning has emerged as a key technique for adapting such models to downstream tasks. However, the application of prompt learning with VLM in…

机器学习 · 计算机科学 2025-09-19 Zhihao Wang , Wenke Huang , Tian Chen , Zekun Shi , Guancheng Wan , Yu Qiao , Bin Yang , Jian Wang , Bing Li , Mang Ye