中文
相关论文

相关论文: Multi-Modal Multi-Task Federated Foundation Models…

200 篇论文

Multimodal Federated Learning (MFL) lies at the intersection of two pivotal research areas: leveraging complementary information from multiple modalities to improve downstream inference performance and enabling distributed training to…

机器学习 · 计算机科学 2025-05-29 Yuanzhe Peng , Jieming Bian , Lei Wang , Yin Huang , Jie Xu

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

机器学习 · 计算机科学 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

This scoping review examines the broad applications, risks, and ethical challenges associated with Extended Reality (XR) technologies, including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), within the context of…

人机交互 · 计算机科学 2024-11-08 Panagiotis Kourtesis

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

图像与视频处理 · 电气工程与系统科学 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

Extended Reality (XR), encompassing Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR), is a transformative technology bridging the physical and virtual world and it has diverse potential which will be ubiquitous in the…

人机交互 · 计算机科学 2025-04-23 Baichuan Zeng

3D object detection models trained in one server plays an important role in autonomous driving, robotics manipulation, and augmented reality scenarios. However, most existing methods face severe privacy concern when deployed on a…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Suyan Dai , Chenxi Liu , Fazeng Li , Peican Lin

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, however,…

机器学习 · 计算机科学 2024-04-30 Zhaopeng Peng , Xiaoliang Fan , Yufan Chen , Zheng Wang , Shirui Pan , Chenglu Wen , Ruisheng Zhang , Cheng Wang

Federated Learning (FL) is an evolving paradigm that enables multiple parties to collaboratively train models without sharing raw data. Among its variants, Vertical Federated Learning (VFL) is particularly relevant in real-world,…

机器学习 · 计算机科学 2024-10-24 Zhaomin Wu , Junyi Hou , Yiqun Diao , Bingsheng He

The Metaverse is deemed the next evolution of the Internet and has received much attention recently. Metaverse applications via mobile augmented reality (MAR) require rapid and accurate object detection to mix digital data with the real…

机器学习 · 计算机科学 2023-11-08 Xinyu Zhou , Jun Zhao

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated…

机器学习 · 计算机科学 2026-05-08 Zhiwei Li , Guodong Long , Chunxu Zhang , Honglei Zhang , Jing Jiang , Chengqi Zhang

Multimodal Large Language Models (MLLMs) enhance collaboration in Extended Reality (XR) environments by enabling flexible object and animation creation through the combination of natural language and visual inputs. However, visual data…

密码学与安全 · 计算机科学 2026-04-21 Jiangong Chen , Mingyu Zhu , Bin Li

In-vehicle emotion recognition underpins adaptive driver-assistance systems and, ultimately, occupant safety. However, practical deployment is hindered by (i) modality fragility - poor lighting and occlusions degrade vision-based methods;…

机器学习 · 计算机科学 2025-07-23 Baran Can Gül , Suraksha Nadig , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

With the rapid development of imaging sensor technology in the field of remote sensing, multi-modal remote sensing data fusion has emerged as a crucial research direction for land cover classification tasks. While diffusion models have made…

计算机视觉与模式识别 · 计算机科学 2024-01-08 DaiXun Li , Weiying Xie , ZiXuan Wang , YiBing Lu , Yunsong Li , Leyuan Fang

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

机器学习 · 计算机科学 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

Foundation models have shown great success in natural language processing, computer vision, and multimodal tasks. FMs have a large number of model parameters, thus requiring a substantial amount of data to help optimize the model during the…

机器学习 · 计算机科学 2023-12-27 Panlong Wu , Kangshuo Li , Ting Wang , Fangxin Wang

As extended reality (XR) systems become increasingly immersive and sensor-rich, they enable the collection of behavioral signals such as eye and body telemetry. These signals support personalized and responsive experiences and may also…

人机交互 · 计算机科学 2025-10-21 Azim Ibragimov , Ethan Wilson , Kevin R. B. Butler , Eakta Jain

Retrieval-Augmented Generation (RAG) empowers LLMs with external knowledge, making cross-institutional domain-specific knowledge base integration a highly promising deployment paradigm. Despite this potential, strict privacy regulations…

密码学与安全 · 计算机科学 2026-05-26 Chenxin Mao , Shangyu Liu , Zhenzhe Zheng , Fan Wu , Jie Wu , Guihai Chen

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

机器学习 · 计算机科学 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Text-to-Image (T2I) models have demonstrated their versatility in a wide range of applications. However, adaptation of T2I models to specialized tasks is often limited by the availability of task-specific data due to privacy concerns. On…

机器学习 · 计算机科学 2025-10-15 Ningxin He , Yang Liu , Wei Sun , Xiaozhou Ye , Ye Ouyang , Tiegang Gao , Zehui Zhang

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

机器学习 · 计算机科学 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober