English
Related papers

Related papers: PrivFedTalk: Privacy-Aware Federated Diffusion wit…

200 papers

The growing development of artificial intelligence based solutions, together with privacy legislation, has driven the rise of the so-called privacy preserving machine learning architectures, such as federated learning. While federated…

Cryptography and Security · Computer Science 2026-05-05 Judith Sáinz-Pardo Díaz , Álvaro López García

Sensor data collected by Internet of Things (IoT) devices can reveal sensitive personal information about individuals, raising significant privacy concerns when shared with semi-trusted service providers, as they may extract this…

Cryptography and Security · Computer Science 2025-08-06 Xin Yang , Omid Ardakanian

The proliferation of Internet of Things devices and advances in communication technology have unleashed an explosion of personal data, amplifying privacy concerns amid stringent regulations like GDPR and CCPA. Federated Learning offers a…

Machine Learning · Computer Science 2025-03-04 Fan Wan , Yuchen Li , Xueqi Qiu , Rui Sun , Leyuan Zhang , Xingyu Miao , Tianyu Zhang , Haoran Duan , Yang Long

Diffusion models have revolutionized the field of talking head generation, yet still face challenges in expressiveness, controllability, and stability in long-time generation. In this research, we propose an EmotiveTalk framework to address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Haotian Wang , Yuzhe Weng , Yueyan Li , Zilu Guo , Jun Du , Shutong Niu , Jiefeng Ma , Shan He , Xiaoyan Wu , Qiming Hu , Bing Yin , Cong Liu , Qingfeng Liu

While recent advances in deep neural networks have made it possible to render high-quality images, generating photo-realistic and personalized talking head remains challenging. With given audio, the key to tackling this task is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Shunyu Yao , RuiZhe Zhong , Yichao Yan , Guangtao Zhai , Xiaokang Yang

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Federated learning (FL) allows clients to collaboratively train a global model without sharing their local data with a server. However, clients' contributions to the server can still leak sensitive information. Differential privacy (DP)…

Machine Learning · Computer Science 2025-02-18 Jie Xu , Karthikeyan Saravanan , Rogier van Dalen , Haaris Mehmood , David Tuckey , Mete Ozay

Federated learning (FL) has emerged as a collaborative approach that allows multiple clients to jointly learn a machine learning model without sharing their private data. The concern about privacy leakage, albeit demonstrated under specific…

Cryptography and Security · Computer Science 2024-06-04 Hanlin Gu , Jiahuan Luo , Yan Kang , Yuan Yao , Gongxi Zhu , Bowen Li , Lixin Fan , Qiang Yang

To protect privacy and meet legal regulations, federated learning (FL) has gained significant attention for training speech-to-text (S2T) systems, including automatic speech recognition (ASR) and speech translation (ST). However, the…

Computation and Language · Computer Science 2025-01-22 Yichao Du , Zhirui Zhang , Linan Yue , Xu Huang , Yuqing Zhang , Tong Xu , Linli Xu , Enhong Chen

Talking face generation (TFG) aims to animate a target identity's face to create realistic talking videos. Personalized TFG is a variant that emphasizes the perceptual identity similarity of the synthesized result (from the perspective of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhenhui Ye , Tianyun Zhong , Yi Ren , Ziyue Jiang , Jiawei Huang , Rongjie Huang , Jinglin Liu , Jinzheng He , Chen Zhang , Zehan Wang , Xize Chen , Xiang Yin , Zhou Zhao

The task of audio-driven portrait animation involves generating a talking head video using an identity image and an audio track of speech. While many existing approaches focus on lip synchronization and video quality, few tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Jian Zhang , Weijian Mai , Zhijun Zhang

Federated Learning(FL) is popular as a privacy-preserving machine learning paradigm for generating a single model on decentralized data. However, statistical heterogeneity poses a significant challenge for FL. As a subfield of FL,…

Machine Learning · Computer Science 2024-10-22 Keting Yin , Jiayi Mao

Federated learning enables collaborative training of machine learning models under strict privacy restrictions and federated text-to-speech aims to synthesize natural speech of multiple users with a few audio training samples stored in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Ziyue Jiang , Yi Ren , Ming Lei , Zhou Zhao

With the rapid advancement of diffusion models, talking face generation has made remarkable progress. However, existing diffusion-based methods still require task-specific fine-tuning and large-scale audiovisual datasets, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hao Wu , Xiangyang Luo , Hao Wang , Jiawei Zhang , Yi Zhang , Jinwei Wang

The increasing demand for privacy-preserving data analytics in various domains necessitates solutions for synthetic data generation that rigorously uphold privacy standards. We introduce the DP-FedTabDiff framework, a novel integration of…

Machine Learning · Computer Science 2025-09-01 Timur Sattarov , Marco Schreyer , Damian Borth

With the rapid development of the Internet of Things (IoT), AI model training on private data such as human sensing data is highly desired. Federated learning (FL) has emerged as a privacy-preserving distributed training framework for this…

Machine Learning · Computer Science 2026-01-27 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Yinfeng Cao

Federated learning is an emerging learning paradigm where multiple clients collaboratively train a machine learning model in a privacy-preserving manner. Personalized federated learning extends this paradigm to overcome heterogeneity across…

Machine Learning · Computer Science 2023-04-19 Hongxia Li , Zhongyi Cai , Jingya Wang , Jiangnan Tang , Weiping Ding , Chin-Teng Lin , Ye Shi

Federated learning (FL) emerges as a decentralized learning framework which trains models from multiple distributed clients without sharing their data to preserve privacy. Recently, large-scale pre-trained models (e.g., Vision Transformer)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Fu-En Yang , Chien-Yi Wang , Yu-Chiang Frank Wang

Federated learning (FL) enables distributed clients to collaboratively train a global model using local private data. Nevertheless, recent studies show that conventional FL algorithms still exhibit deficiencies in privacy protection, and…

Cryptography and Security · Computer Science 2026-03-31 Ruiyang Wang , Rong Pan , Zhengan Yao

Decentralized Federated Learning (DFL) enables collaborative model training without a central server, but it remains vulnerable to privacy leakage because shared model updates can expose sensitive information through inversion,…

Cryptography and Security · Computer Science 2025-12-09 Fardin Jalil Piran , Zhiling Chen , Yang Zhang , Qianyu Zhou , Jiong Tang , Farhad Imani