English
Related papers

Related papers: Data Redaction from Conditional Generative Models

200 papers

Open domain response generation has achieved remarkable progress in recent years, but sometimes yields short and uninformative responses. We propose a new paradigm for response generation, that is response generation by editing, which…

Computation and Language · Computer Science 2018-11-19 Yu Wu , Furu Wei , Shaohan Huang , Yunli Wang , Zhoujun Li , Ming Zhou

Current large-scale auto-regressive language models display impressive fluency and can generate convincing text. In this work we start by asking the question: Can the generations of these models be reliably distinguished from real text by…

Computation and Language · Computer Science 2020-12-22 Anton Bakhtin , Yuntian Deng , Sam Gross , Myle Ott , Marc'Aurelio Ranzato , Arthur Szlam

Knowledge editing methods (KEs) can update language models' obsolete or inaccurate knowledge learned from pre-training. However, KEs can be used for malicious applications, e.g., inserting misinformation and toxic content. Knowing whether a…

Computation and Language · Computer Science 2025-02-11 Paul Youssef , Zhixue Zhao , Christin Seifert , Jörg Schlötterer

Text-to-image generative models can produce photo-realistic images for an extremely broad range of concepts, and their usage has proliferated widely among the general public. On the flip side, these models have numerous drawbacks, including…

Machine Learning · Computer Science 2023-10-10 Minh Pham , Kelly O. Marshall , Niv Cohen , Govind Mittal , Chinmay Hegde

We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative…

Machine Learning · Computer Science 2015-02-11 Yujia Li , Kevin Swersky , Richard Zemel

The rapid progress in generative models has resulted in impressive leaps in generation quality, blurring the lines between synthetic and real data. Web-scale datasets are now prone to the inevitable contamination by synthetic data, directly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Damien Ferbach , Quentin Bertrand , Avishek Joey Bose , Gauthier Gidel

Recent advances in Deep Learning and probabilistic modeling have led to strong improvements in generative models for images. On the one hand, Generative Adversarial Networks (GANs) have contributed a highly effective adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Yang He , Bernt Schiele , Mario Fritz

Large-scale generative models have achieved remarkable advancements in various visual tasks, yet their application to shadow removal in images remains challenging. These models often generate diverse, realistic details without adequate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xinjie Li , Yang Zhao , Dong Wang , Yuan Chen , Li Cao , Xiaoping Liu

Generative models for source code are an interesting structured prediction problem, requiring to reason about both hard syntactic and semantic constraints as well as about natural, likely programs. We present a novel model for this problem…

Machine Learning · Computer Science 2019-04-18 Marc Brockschmidt , Miltiadis Allamanis , Alexander L. Gaunt , Oleksandr Polozov

Recent advancements in natural language generation has raised serious concerns. High-performance language models are widely used for language generation tasks because they are able to produce fluent and meaningful sentences. These models…

Computation and Language · Computer Science 2020-10-06 Saurabh Gupta , Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

For a fixed parameter size, the capabilities of large models are primarily determined by the quality and quantity of its training data. Consequently, training datasets now grow faster than the rate at which new data is indexed on the web,…

Machine Learning · Computer Science 2025-09-12 Minqi Jiang , João G. M. Araújo , Will Ellsworth , Sian Gooding , Edward Grefenstette

Learning to generate fluent natural language from structured data with neural networks has become an common approach for NLG. This problem can be challenging when the form of the structured data varies between examples. This paper presents…

Computation and Language · Computer Science 2018-10-12 Sebastian Gehrmann , Falcon Z. Dai , Henry Elder , Alexander M. Rush

Enormous online textual information provides intriguing opportunities for understandings of social and economic semantics. In this paper, we propose a novel text regression model based on a conditional generative adversarial network (GAN),…

Computation and Language · Computer Science 2019-04-25 Tao Li , Xudong Liu , Shihan Su

Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase…

Computation and Language · Computer Science 2023-11-28 Haotian Luo , Yixin Liu , Peidong Liu , Xianggen Liu

Procedural content generation via machine learning (PCGML) is typically framed as the task of fitting a generative model to full-scale examples of a desired content distribution. This approach presents a fundamental tension: the more design…

Machine Learning · Computer Science 2018-09-13 Isaac Karth , Adam M. Smith

Deep Neural Networks are prone to learning and relying on spurious correlations in the training data, which, for high-risk applications, can have fatal consequences. Various approaches to suppress model reliance on harmful features have…

Machine Learning · Computer Science 2024-04-16 Dilyara Bareeva , Maximilian Dreyer , Frederik Pahde , Wojciech Samek , Sebastian Lapuschkin

Recent breakthroughs in diffusion models have exhibited exceptional image-generation capabilities. However, studies show that some outputs are merely replications of training data. Such replications present potential legal challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuxin Wen , Yuchen Liu , Chen Chen , Lingjuan Lyu

We introduce a simple and efficient method, called Auxiliary Tuning, for adapting a pre-trained Language Model to a novel task; we demonstrate this approach on the task of conditional text generation. Our approach supplements the original…

Computation and Language · Computer Science 2020-07-01 Yoel Zeldes , Dan Padnos , Or Sharir , Barak Peleg

Deep neural networks (DNN) are quickly becoming the de facto standard modeling method for many natural language generation (NLG) tasks. In order for such models to truly be useful, they must be capable of correctly generating utterances for…

Computation and Language · Computer Science 2019-11-11 Chris Kedzie , Kathleen McKeown

The recent emergence of machine-learning based generative models for speech suggests a significant reduction in bit rate for speech codecs is possible. However, the performance of generative models deteriorates significantly with the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 W. Bastiaan Kleijn , Andrew Storus , Michael Chinen , Tom Denton , Felicia S. C. Lim , Alejandro Luebs , Jan Skoglund , Hengchin Yeh