中文
相关论文

相关论文: Auditing Data Provenance in Text-Generation Models

200 篇论文

Question answer generation using Natural Language Processing models is ubiquitous in the world around us. It is used in many use cases such as the building of chat bots, suggestive prompts in google search and also as a way of navigating…

计算与语言 · 计算机科学 2023-11-28 Shashidhar Reddy Javaji , Haoran Hu , Sai Sameer Vennam , Vijaya Gajanan Buddhavarapu

Auditing Data Provenance (ADP), i.e., auditing if a certain piece of data has been used to train a machine learning model, is an important problem in data provenance. The feasibility of the task has been demonstrated by existing auditing…

密码学与安全 · 计算机科学 2022-09-07 Xin Mu , Ming Pang , Feida Zhu

In this study, we take a departure and explore an explainability-driven strategy to data auditing, where actionable insights into the data at hand are discovered through the eyes of quantitative explainability on the behaviour of a dummy…

计算机视觉与模式识别 · 计算机科学 2021-06-18 Alexander Wong , Adam Dorfman , Paul McInnis , Hayden Gunraj

Deep neural networks (DNN) are quickly becoming the de facto standard modeling method for many natural language generation (NLG) tasks. In order for such models to truly be useful, they must be capable of correctly generating utterances for…

计算与语言 · 计算机科学 2019-11-11 Chris Kedzie , Kathleen McKeown

Ensuring data quality in large tabular datasets is a critical challenge, typically addressed through data wrangling tasks. Traditional statistical methods, though efficient, cannot often understand the semantic context and deep learning…

机器学习 · 计算机科学 2025-02-25 Ashlesha Akella , Krishnasuri Narayanam

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine unlearning, i.e. having a model forget about some of its training data, has become increasingly more important as privacy legislation promotes variants of the right-to-be-forgotten. In the context of deep learning, approaches for…

机器学习 · 计算机科学 2022-02-22 Anvith Thudi , Hengrui Jia , Ilia Shumailov , Nicolas Papernot

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

计算与语言 · 计算机科学 2017-11-28 Ziang Xie

Document understanding models have recently demonstrated remarkable performance by leveraging extensive collections of user documents. However, since documents often contain large amounts of personal data, their usage can pose a threat to…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Lei Kang , Mohamed Ali Souibgui , Fei Yang , Lluis Gomez , Ernest Valveny , Dimosthenis Karatzas

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

计算与语言 · 计算机科学 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

As Large Language Models (LLMs) become increasingly prevalent, their generated outputs are proliferating across the web, risking a future where machine-generated content dilutes human-authored text. Since online data is the primary resource…

计算与语言 · 计算机科学 2025-09-23 George Drayson , Emine Yilmaz , Vasileios Lampos

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual…

计算与语言 · 计算机科学 2024-04-03 Ying Zhou , Ben He , Le Sun

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

机器学习 · 计算机科学 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

Recent trends in natural language processing using pretraining have shifted focus towards pretraining and fine-tuning approaches for text generation. Often the focus has been on task-agnostic approaches that generalize the language modeling…

计算与语言 · 计算机科学 2020-04-24 Shashi Narayan , Gonçalo Simoes , Ji Ma , Hannah Craighead , Ryan Mcdonald

Text Generation aims to produce plausible and readable text in a human language from input data. The resurgence of deep learning has greatly advanced this field, in particular, with the help of neural generation models based on pre-trained…

计算与语言 · 计算机科学 2022-05-17 Junyi Li , Tianyi Tang , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

机器学习 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

The last decade has witnessed the proliferation of Deep Learning models in many applications, achieving unrivaled levels of predictive performance. Unfortunately, the black-box nature of Deep Learning models has posed unanswered questions…

机器学习 · 计算机科学 2020-03-26 Alejandro Barredo-Arrieta , Javier Del Ser

Neural language models are increasingly deployed into APIs and websites that allow a user to pass in a prompt and receive generated text. Many of these systems do not reveal generation parameters. In this paper, we present methods to…

机器学习 · 计算机科学 2023-09-12 Daphne Ippolito , Nicholas Carlini , Katherine Lee , Milad Nasr , Yun William Yu

Text-to-image diffusion models are pushing the boundaries of what generative AI can achieve in our lives. Beyond their ability to generate general images, new personalization techniques have been proposed to customize the pre-trained base…

计算机与社会 · 计算机科学 2024-10-15 Boheng Li , Yanhao Wei , Yankai Fu , Zhenting Wang , Yiming Li , Jie Zhang , Run Wang , Tianwei Zhang

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

应用统计 · 统计学 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe