中文
相关论文

相关论文: Reconstructing training data from document underst…

200 篇论文

Individuals are gaining more control of their personal data through recent data privacy laws such the General Data Protection Regulation and the California Consumer Privacy Act. One aspect of these laws is the ability to request a business…

In this paper we develop state-of-the-art privacy attacks against Large Language Models (LLMs), where an adversary with some access to the model tries to learn something about the underlying training data. Our headline results are new…

密码学与安全 · 计算机科学 2024-07-16 Jeffrey G. Wang , Jason Wang , Marvin Li , Seth Neel

Despite the impressive capabilities of Multimodal Large Language Models (MLLMs) in integrating text and image modalities, challenges remain in accurately interpreting detailed visual elements. Vision detection models excel at recognizing…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Qirui Jiao , Daoyuan Chen , Yilun Huang , Yaliang Li , Ying Shen

The ability to understand and answer questions over documents can be useful in many business and practical applications. However, documents often contain lengthy and diverse multimodal contents such as texts, figures, and tables, which are…

The LLM unlearning technique has recently been introduced to comply with data regulations and address the safety and ethical concerns of LLMs by removing the undesired data-model influence. However, state-of-the-art unlearning methods face…

机器学习 · 计算机科学 2025-05-28 Chongyu Fan , Jinghan Jia , Yihua Zhang , Anil Ramakrishna , Mingyi Hong , Sijia Liu

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

机器学习 · 计算机科学 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

密码学与安全 · 计算机科学 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Deep neural network architectures are considered to be robust to random perturbations. Nevertheless, it was shown that they could be severely vulnerable to slight but carefully crafted perturbations of the input, termed as adversarial…

机器学习 · 计算机科学 2021-02-16 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

This review paper takes a comprehensive look at malicious attacks against FL, categorizing them from new perspectives on attack origins and targets, and providing insights into their methodology and impact. In this survey, we focus on…

机器学习 · 计算机科学 2024-01-10 Xianghua Xie , Chen Hu , Hanchi Ren , Jingjing Deng

Background: When using deep learning models, there are many possible vulnerabilities and some of the most worrying are the adversarial inputs, which can cause wrong decisions with minor perturbations. Therefore, it becomes necessary to…

软件工程 · 计算机科学 2024-01-12 Francisco Durán López , Silverio Martínez-Fernández , Michael Felderer , Xavier Franch

Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process…

人工智能 · 计算机科学 2025-04-08 Hao Du , Shang Liu , Lele Zheng , Yang Cao , Atsuyoshi Nakamura , Lei Chen

Adversarial attacks and defenses have gained increasing interest on computer vision systems in recent years, but as of today, most investigations are limited to images. However, many artificial intelligence models actually handle…

计算机视觉与模式识别 · 计算机科学 2023-05-03 Timothée Fronteau , Arnaud Paran , Aymen Shabou

The essence of deep learning is to exploit data to train a deep neural network (DNN) model. This work explores the reverse process of generating data from a model, attempting to reveal the relationship between the data and the model. We…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Philipp Benz , Chaoning Zhang , Tooba Imtiaz , In-So Kweon

The right to erasure requires removal of a user's information from data held by organizations, with rigorous interpretations extending to downstream products such as learned models. Retraining from scratch with the particular user's data…

机器学习 · 计算机科学 2022-02-11 Neil G. Marchant , Benjamin I. P. Rubinstein , Scott Alfeld

While Large Language Models (LLMs) have achieved remarkable success in code generation, they often struggle with the deep, long-horizon reasoning required for complex software engineering. We attribute this limitation to the nature of…

This paper introduces a deep learning model tailored for document information analysis, emphasizing document classification, entity relation extraction, and document visual question answering. The proposed model leverages transformer-based…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Tofik Ali , Partha Pratim Roy

Large Language Models (LLMs) are known for their expensive and time-consuming training. Thus, oftentimes, LLMs are fine-tuned to address a specific task, given the pretrained weights of a pre-trained LLM considered a foundation model. In…

计算与语言 · 计算机科学 2025-12-05 Eshed Gal , Moshe Eliasof , Javier Turek , Uri Ascher , Eran Treister , Eldad Haber

Recently, the practical needs of ``the right to be forgotten'' in federated learning gave birth to a paradigm known as federated unlearning, which enables the server to forget personal data upon the client's removal request. Existing…

密码学与安全 · 计算机科学 2025-01-22 Jian Chen , Zehui Lin , Wanyu Lin , Wenlong Shi , Xiaoyan Yin , Di Wang

Unstructured data, especially text, continues to grow rapidly in various domains. In particular, in the financial sphere, there is a wealth of accumulated unstructured financial data, such as the textual disclosure documents that companies…

计算与语言 · 计算机科学 2024-04-18 Bolun "Namir" Xia , Vipula D. Rawte , Mohammed J. Zaki , Aparna Gupta

Model inversion (MI) attacks aim to infer and reconstruct private training data by abusing access to a model. MI attacks have raised concerns about the leaking of sensitive information (e.g. private face images used in training a face…

机器学习 · 计算机科学 2023-06-16 Ngoc-Bao Nguyen , Keshigeyan Chandrasegaran , Milad Abdollahzadeh , Ngai-Man Cheung