English
Related papers

Related papers: Information Leakage of Sentence Embeddings via Gen…

200 papers

Gradient inversion attacks on federated learning systems reconstruct client training data from exchanged gradient information. To defend against such attacks, a variety of defense mechanisms were proposed. However, they usually lead to an…

Machine Learning · Computer Science 2022-11-24 Daniel Scheliga , Patrick Mäder , Marco Seeland

Implicit discourse relations bind smaller linguistic units into coherent texts. Automatic sense prediction for implicit relations is hard, because it requires understanding the semantics of the linked arguments. Furthermore, annotated…

Computation and Language · Computer Science 2022-10-21 Murali Raghu Babu Balusu , Yangfeng Ji , Jacob Eisenstein

Machine Learning (ML) already has been integrated into all kinds of systems, helping developers to solve problems with even higher accuracy than human beings. However, when integrating ML models into a system, developers may accidentally…

Cryptography and Security · Computer Science 2019-08-07 Mingtian Tan , Zhe Zhou

Word embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words in a concise, objective…

Computation and Language · Computer Science 2021-01-26 Masahiro Kaneko , Danushka Bollegala

A central tenet of Federated learning (FL), which trains models without centralizing user data, is privacy. However, previous work has shown that the gradient updates used in FL can leak user information. While the most industrial uses of…

Machine Learning · Computer Science 2023-06-01 Liam Fowl , Jonas Geiping , Steven Reich , Yuxin Wen , Wojtek Czaja , Micah Goldblum , Tom Goldstein

Federated learning (FL) facilitates collaborative model training among multiple clients without raw data exposure. However, recent studies have shown that clients' private training data can be reconstructed from shared gradients in FL, a…

Cryptography and Security · Computer Science 2025-02-06 Jiacheng Du , Jiahui Hu , Zhibo Wang , Peng Sun , Neil Zhenqiang Gong , Kui Ren , Chun Chen

Sentence and word embeddings encode structural and semantic information in a distributed manner. Part of the information encoded -- particularly lexical information -- can be seen as continuous, whereas other -- like structural information…

Computation and Language · Computer Science 2023-12-19 Vivi Nastase , Paola Merlo

Dense vector representations for sentences made significant progress in recent years as can be seen on sentence similarity tasks. Real-world phrase retrieval applications, on the other hand, still encounter challenges for effective use of…

Computation and Language · Computer Science 2024-05-14 Eyal Orbach , Lev Haikin , Nelly David , Avi Faizakof

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

Machine Learning · Computer Science 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

The goal of Event Argument Extraction (EAE) is to find the role of each entity mention for a given event trigger word. It has been shown in the previous works that the syntactic structures of the sentences are helpful for the deep learning…

Computation and Language · Computer Science 2020-10-27 Amir Pouran Ben Veyseh , Tuan Ngo Nguyen , Thien Huu Nguyen

Collaborative machine learning and related techniques such as federated learning allow multiple participants, each with his own training dataset, to build a joint model by training locally and periodically exchanging model updates. We…

Cryptography and Security · Computer Science 2018-11-02 Luca Melis , Congzheng Song , Emiliano De Cristofaro , Vitaly Shmatikov

Graph Neural Networks (GNNs), which generalize traditional deep neural networks on graph data, have achieved state-of-the-art performance on several graph analytical tasks. We focus on how trained GNN models could leak information about the…

Machine Learning · Computer Science 2021-12-21 Iyiola E. Olatunji , Wolfgang Nejdl , Megha Khosla

Contextual word representations generated by language models (LMs) learn spurious associations present in the training corpora. Recent findings reveal that adversaries can exploit these associations to reverse-engineer the private…

Computation and Language · Computer Science 2021-12-08 Geetanjali Bihani

In the era of deep learning, a user often leverages a third-party machine learning tool to train a deep neural network (DNN) classifier and then deploys the classifier as an end-user software product or a cloud service. In an information…

Cryptography and Security · Computer Science 2020-10-27 Jinyuan Jia , Binghui Wang , Neil Zhenqiang Gong

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Federated learning is a decentralized learning paradigm introduced to preserve privacy of client data. Despite this, prior work has shown that an attacker at the server can still reconstruct the private training data using only the client…

Cryptography and Security · Computer Science 2024-03-28 Joshua C. Zhao , Ahaan Dabholkar , Atul Sharma , Saurabh Bagchi

We propose Gradient Inversion Transcript (GIT), a novel generative approach for reconstructing training data from leaked gradients. GIT employs a generative attack model, whose architecture is tailored to align with the structure of the…

Machine Learning · Computer Science 2025-05-27 Xinping Chen , Chen Liu

Model inversion (MI) attacks aim to infer and reconstruct private training data by abusing access to a model. MI attacks have raised concerns about the leaking of sensitive information (e.g. private face images used in training a face…

Machine Learning · Computer Science 2023-06-16 Ngoc-Bao Nguyen , Keshigeyan Chandrasegaran , Milad Abdollahzadeh , Ngai-Man Cheung

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by incorporating external knowledge bases, but this may expose them to extraction attacks, leading to potential copyright and privacy risks. However, existing…

Cryptography and Security · Computer Science 2025-10-01 Yuhao Wang , Wenjie Qu , Shengfang Zhai , Yanze Jiang , Zichen Liu , Yue Liu , Yinpeng Dong , Jiaheng Zhang