English
Related papers

Related papers: Learn What NOT to Learn: Towards Generative Safety…

200 papers

In the Text-to-speech(TTS) task, the latent diffusion model has excellent fidelity and generalization, but its expensive resource consumption and slow inference speed have always been a challenging. This paper proposes Discrete Diffusion…

Sound · Computer Science 2023-09-14 Zhichao Wu , Qiulin Li , Sixing Liu , Qun Yang

Along with the development of systems for natural language understanding and generation, dialog systems have been widely adopted for language learning and practicing. Many current educational dialog systems perform chitchat, where the…

Computation and Language · Computer Science 2023-04-13 Kun Qian , Ryan Shea , Yu Li , Luke Kutszik Fryer , Zhou Yu

NSFW (Not Safe for Work) content, in the context of a dialogue, can have severe side effects on users in open-domain dialogue systems. However, research on detecting NSFW language, especially sexually explicit content, within a dialogue…

Computation and Language · Computer Science 2024-03-22 Huachuan Qiu , Shuai Zhang , Hongliang He , Anqi Li , Zhenzhong Lan

Large language models are increasingly used for creative writing and engagement content, raising safety concerns about the outputs. Therefore, casting humor generation as a testbed, this work evaluates how funniness optimization in modern…

Computation and Language · Computer Science 2025-10-22 Atharvan Dogra , Soumya Suvra Ghosal , Ameet Deshpande , Ashwin Kalyan , Dinesh Manocha

Large language models (LLMs) often inherit biases from vast amounts of training corpora. Traditional debiasing methods, while effective to some extent, do not completely eliminate memorized biases and toxicity in LLMs. In this paper, we…

Computation and Language · Computer Science 2024-07-25 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Large Language Models (LLMs) are known to be vulnerable to jailbreak attacks. An important observation is that, while different types of jailbreak attacks can generate significantly different queries, they mostly result in similar responses…

Cryptography and Security · Computer Science 2025-05-21 Zhexin Zhang , Junxiao Yang , Yida Lu , Pei Ke , Shiyao Cui , Chujie Zheng , Hongning Wang , Minlie Huang

Knowledge-grounded dialogue generation aims to mitigate the issue of text degeneration by incorporating external knowledge to supplement the context. However, the model often fails to internalize this information into responses in a…

Computation and Language · Computer Science 2023-10-18 Chenxu Yang , Zheng Lin , Lanrui Wang , Chong Tian , Liang Pang , Jiangnan Li , Qirong Ho , Yanan Cao , Weiping Wang

NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an…

Computation and Language · Computer Science 2020-10-07 Tianlu Wang , Xuezhi Wang , Yao Qin , Ben Packer , Kang Li , Jilin Chen , Alex Beutel , Ed Chi

The proliferation of social media platforms has led to an increase in the spread of hate speech, particularly targeting vulnerable communities. Unfortunately, existing methods for automatically identifying and blocking toxic language rely…

Computation and Language · Computer Science 2025-02-24 Shiza Ali , Jeremy Blackburn , Gianluca Stringhini

This paper reports on progress towards building an online language learning tool to provide learners with conversational experience by using dialog systems as conversation practice partners. Our system can adapt to users' language…

Computation and Language · Computer Science 2022-08-02 Yu Li , Chun-Yen Chen , Dian Yu , Sam Davidson , Ryan Hou , Xun Yuan , Yinghua Tan , Derek Pham , Zhou Yu

With the prevalence of text-to-image generative models, their safety becomes a critical concern. adversarial testing techniques have been developed to probe whether such models can be prompted to produce Not-Safe-For-Work (NSFW) content.…

Computation and Language · Computer Science 2024-02-20 Yi Liu , Guowei Yang , Gelei Deng , Feiyue Chen , Yuqi Chen , Ling Shi , Tianwei Zhang , Yang Liu

An outstanding challenge for the widespread deployment of robotic systems like autonomous vehicles is ensuring safe interaction with humans without sacrificing performance. Existing safety methods often neglect the robot's ability to learn…

Robotics · Computer Science 2023-11-03 Haimin Hu , Zixu Zhang , Kensuke Nakamura , Andrea Bajcsy , Jaime F. Fisac

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing…

Computation and Language · Computer Science 2019-02-28 Bang Liu , Mingjun Zhao , Di Niu , Kunfeng Lai , Yancheng He , Haojie Wei , Yu Xu

While communication strategies of Large Language Models (LLMs) are crucial for human-LLM interactions, they can also be weaponized to elicit private information, yet such stealthy attacks remain under-explored. This paper introduces the…

Human-Computer Interaction · Computer Science 2025-11-18 Shuning Zhang , Jiaqi Bai , Linzhi Wang , Shixuan Li , Xin Yi , Hewu Li

We introduce ANTIDOTE, a new class of objectives for learning under noisy labels which are defined in terms of a relaxation over an information-divergence neighborhood. Using convex duality, we provide a reformulation as an adversarial…

Machine Learning · Computer Science 2025-08-12 Jeremiah Birrell , Reza Ebrahimi

Training multimodal generative models on large, uncurated datasets can result in users being exposed to harmful, unsafe and controversial or culturally-inappropriate outputs. While model editing has been proposed to remove or filter…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jordan Vice , Naveed Akhtar , Mubarak Shah , Richard Hartley , Ajmal Mian

Recent advances in one-step generative frameworks, such as flow map models, have significantly improved the efficiency of image generation by learning direct noise-to-data mappings in a single forward pass. However, machine unlearning for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hyundo Choi , Junhyeong An , Jinseong Park , Jaewoong Choi

Recently, parallel text generation has received widespread attention due to its success in generation efficiency. Although many advanced techniques are proposed to improve its generation quality, they still need the help of an…

Computation and Language · Computer Science 2022-04-06 Yu Bao , Hao Zhou , Shujian Huang , Dongqi Wang , Lihua Qian , Xinyu Dai , Jiajun Chen , Lei Li

Neural dialogue models have been widely adopted in various chatbot applications because of their good performance in simulating and generalizing human conversations. However, there exists a dark side of these models -- due to the…

Computation and Language · Computer Science 2019-09-30 Haochen Liu , Tyler Derr , Zitao Liu , Jiliang Tang

After demonstrating significant success in image synthesis, Generative Adversarial Network (GAN) models have likewise made significant progress in the field of speech synthesis, leveraging their capacity to adapt the precise distribution of…

Sound · Computer Science 2025-04-21 Sandipan Dhar , Md. Tousin Akhter , Nanda Dulal Jana , Swagatam Das