English
Related papers

Related papers: Detecting egregious responses in neural sequence-t…

200 papers

Sequences have become first class citizens in supervised learning thanks to the resurgence of recurrent neural networks. Many complex tasks that require mapping from or to a sequence of observations can now be formulated with the…

Machine Learning · Statistics 2016-02-25 Oriol Vinyals , Samy Bengio , Manjunath Kudlur

The generation of adversarial inputs has become a crucial issue in establishing the robustness and trustworthiness of deep neural nets, especially when they are used in safety-critical application domains such as autonomous vehicles and…

Machine Learning · Computer Science 2024-01-03 Tooba Khan , Kumar Madhukar , Subodh Vishnu Sharma

We find that language models have difficulties generating fallacious and deceptive reasoning. When asked to generate deceptive outputs, language models tend to leak honest counterparts but believe them to be false. Exploiting this…

Computation and Language · Computer Science 2025-05-26 Yue Zhou , Henry Peng Zou , Barbara Di Eugenio , Yang Zhang

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini

Controllable text generation is an appealing but challenging task, which allows users to specify particular attributes of the generated outputs. In this paper, we propose a controllable dialogue generation model to steer response generation…

Computation and Language · Computer Science 2022-10-24 Zhe Hu , Zhiwei Cao , Hou Pong Chan , Jiachen Liu , Xinyan Xiao , Jinsong Su , Hua Wu

Natural language generation (NLG) is one of the most impactful fields in NLP, and recent years have witnessed its evolution brought about by large language models (LLMs). As the key instrument for writing assistance applications, they are…

Computation and Language · Computer Science 2023-06-07 Minghui Zhang , Alex Sokolov , Weixin Cai , Si-Qing Chen

Generating qualitative responses has always been a challenge for human-computer dialogue systems. Existing dialogue systems generally derive from either retrieval-based or generative-based approaches, both of which have their own pros and…

Computation and Language · Computer Science 2020-05-01 Jiayi Zhang , Chongyang Tao , Zhenjing Xu , Qiaojing Xie , Wei Chen , Rui Yan

We present a method to learn automaton models that are more robust to input modifications. It iteratively aligns sequences to a learned model, modifies the sequences to their aligned versions, and re-learns the model. Automaton learning…

Machine Learning · Computer Science 2022-06-17 Dennis Mouwen , Sicco Verwer , Azqa Nadeem

Machine learning models are vulnerable to maliciously crafted Adversarial Examples (AEs). Training a machine learning model with AEs improves its robustness and stability against adversarial attacks. It is essential to develop models that…

Computation and Language · Computer Science 2024-03-19 Javad Rafiei Asl , Mohammad H. Rafiei , Manar Alohaly , Daniel Takabi

We introduce a new family of prompt injection attacks, termed Neural Exec. Unlike known attacks that rely on handcrafted strings (e.g., "Ignore previous instructions and..."), we show that it is possible to conceptualize the creation of…

Cryptography and Security · Computer Science 2024-05-03 Dario Pasquini , Martin Strohmeier , Carmela Troncoso

In this paper, drawing intuition from the Turing test, we propose using adversarial training for open-domain dialogue generation: the system is trained to produce sequences that are indistinguishable from human-generated dialogue…

Computation and Language · Computer Science 2017-09-26 Jiwei Li , Will Monroe , Tianlin Shi , Sébastien Jean , Alan Ritter , Dan Jurafsky

Querying the knowledge base (KB) has long been a challenge in the end-to-end task-oriented dialogue system. Previous sequence-to-sequence (Seq2Seq) dialogue generation work treats the KB query as an attention over the entire KB, without the…

Computation and Language · Computer Science 2019-09-19 Libo Qin , Yijia Liu , Wanxiang Che , Haoyang Wen , Yangming Li , Ting Liu

Deep generative models are known to produce undesirable samples such as harmful content. Traditional mitigation methods include re-training from scratch, filtering, or editing; however, these are either computationally expensive or can be…

Machine Learning · Computer Science 2024-02-22 Zhifeng Kong , Kamalika Chaudhuri

Large language models have achieved remarkable capabilities, but aligning their outputs with human values and preferences remains a significant challenge. Existing alignment methods primarily focus on positive examples while overlooking the…

Computation and Language · Computer Science 2024-10-17 Shiqi Qiao , Ning Xv , Biao Liu , Xin Geng

Recurrent neural network models with an attention mechanism have proven to be extremely effective on a wide variety of sequence-to-sequence problems. However, the fact that soft attention mechanisms perform a pass over the entire input…

Machine Learning · Computer Science 2017-07-03 Colin Raffel , Minh-Thang Luong , Peter J. Liu , Ron J. Weiss , Douglas Eck

Generating persona consistent dialogue response is important for developing an intelligent conversational agent. Recent works typically fine-tune large-scale pre-trained models on this task by concatenating persona texts and dialogue…

Computation and Language · Computer Science 2023-05-23 Liang Chen , Hongru Wang , Yang Deng , Wai-Chung Kwan , Zezhong Wang , Kam-Fai Wong

In this paper, we conduct the first study on spurious correlations for open-domain response generation models based on a corpus CGDIALOG curated in our work. The cur rent models indeed suffer from spurious correlations and have a tendency…

Computation and Language · Computer Science 2023-03-06 Tao Feng , Lizhen Qu , Gholamreza Haffari

Ensuring the safety and alignment of Large Language Models is a significant challenge with their growing integration into critical applications and societal functions. While prior research has primarily focused on jailbreak attacks, less…

Machine Learning · Computer Science 2026-04-28 Jiawei Chen , Zhengwei Fang , Yu Tian , Jiawei Du , Chao Yu , Zhaoxia Yin , Hang Su

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

Cryptography and Security · Computer Science 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang