English
Related papers

Related papers: DAGER: Exact Gradient Inversion for Large Language…

200 papers

We study the problem of inverting a deep generative model with ReLU activations. Inversion corresponds to finding a latent code vector that explains observed measurements as much as possible. In most prior works this is performed by…

Machine Learning · Computer Science 2019-06-20 Qi Lei , Ajil Jalal , Inderjit S. Dhillon , Alexandros G. Dimakis

Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data…

Machine Learning · Computer Science 2022-03-21 Liam Fowl , Jonas Geiping , Wojtek Czaja , Micah Goldblum , Tom Goldstein

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

Machine Learning · Computer Science 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Neural Architecture Representation Learning aims to transform network models into feature representations for predicting network attributes, playing a crucial role in deploying and designing networks for real-world applications. Recently,…

Machine Learning · Computer Science 2025-06-10 Haizhao Jing , Haokui Zhang , Zhenhao Shang , Rong Xiao , Peng Wang , Yanning Zhang

Federated Learning (FL) is a distributed learning paradigm that enhances users privacy by eliminating the need for clients to share raw, private data with the server. Despite the success, recent studies expose the vulnerability of FL to…

Machine Learning · Computer Science 2023-12-15 Jing Wu , Munawar Hayat , Mingyi Zhou , Mehrtash Harandi

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

Machine Learning · Statistics 2018-06-15 Atsushi Nitanda , Taiji Suzuki

Recent advances in machine learning (ML) and computer vision tools have enabled applications in a wide variety of arenas such as financial analytics, medical diagnostics, and even within the Department of Defense. However, their widespread…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Shashank Manjunath , Aitzaz Nathaniel , Jeff Druce , Stan German

Recently, Graph Neural Networks (GNNs) have become state-of-the-art algorithms for analyzing non-euclidean graph data. However, to realize efficient GNN training is challenging, especially on large graphs. The reasons are many-folded: 1)…

Machine Learning · Computer Science 2022-08-17 Zhe Zhou , Cong Li , Xuechao Wei , Xiaoyang Wang , Guangyu Sun

Deep neural networks have been demonstrated to be vulnerable to adversarial attacks, where small perturbations intentionally added to the original inputs can fool the classifier. In this paper, we propose a defense method, Featurized…

Machine Learning · Computer Science 2018-10-02 Ruying Bao , Sihang Liang , Qingcan Wang

\ac{fl} proposed a distributed \ac{ml} framework where every distributed worker owns a complete copy of global model and their own data. The training is occurred locally, which assures no direct transmission of training data. However, the…

Cryptography and Security · Computer Science 2021-11-08 Jia Qian , Hiba Nassar , Lars Kai Hansen

Federated learning (FL) enables collaborative model training among multiple clients without the need to expose raw data. Its ability to safeguard privacy, at the heart of FL, has recently been a hot-button debate topic. To elaborate,…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Fuyi Wang , Cen Chen , Jianying Zhou

Recent works on personalized text-to-image generation usually learn to bind a special token with specific subjects or styles of a few given images by tuning its embedding through gradient descent. It is natural to question whether we can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Inferring the structure of directed acyclic graphs (DAGs) from data is a central challenge in causal discovery, particularly in modern high-dimensional settings where large-scale interventional data are increasingly available. While…

We introduce LADDER (Learning through Autonomous Difficulty-Driven Example Recursion), a framework which enables Large Language Models to autonomously improve their problem-solving capabilities through self-guided learning by recursively…

Machine Learning · Computer Science 2025-03-06 Toby Simonds , Akira Yoshiyama

Distributed machine learning training and inference is common today because today's large models require more memory and compute than can be provided by a single GPU. Distributed models are generally produced by programmers who take a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-14 Zhanghan Wang , Ding Ding , Hang Zhu , Haibin Lin , Aurojit Panda

With increasing appealing to privacy issues in face recognition, federated learning has emerged as one of the most prevalent approaches to study the unconstrained face recognition problem with private decentralized data. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Yifan Niu , Weihong Deng

We introduce novel communication strategies in synchronous distributed Deep Learning consisting of decentralized gradient reduction orchestration and computational graph-aware grouping of gradient tensors. These new techniques produce an…

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Antonia Creswell , Anil A Bharath

In semiconductor manufacturing, the wafer dicing process is central yet vulnerable to defects that significantly impair yield - the proportion of defect-free chips. Deep neural networks are the current state of the art in (semi-)automated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Zhining Hu , Tobias Schlosser , Michael Friedrich , André Luiz Vieira e Silva , Frederik Beuth , Danny Kowerko

Federated Learning (FL) enables collaborative training of machine learning models across distributed clients without sharing raw data, ostensibly preserving data privacy. Nevertheless, recent studies have revealed critical vulnerabilities…

Machine Learning · Computer Science 2025-09-08 Francesco Diana , André Nusser , Chuan Xu , Giovanni Neglia