English
Related papers

Related papers: Towards Red Teaming in Multimodal and Multilingual…

200 papers

Deploying large language models (LMs) can pose hazards from harmful outputs such as toxic or false text. Prior work has introduced automated tools that elicit harmful outputs to identify these risks. While this is a valuable step toward…

Computation and Language · Computer Science 2023-10-12 Stephen Casper , Jason Lin , Joe Kwon , Gatlen Culp , Dylan Hadfield-Menell

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Red teaming is a common strategy for identifying weaknesses in generative language models (LMs), where adversarial prompts are produced that trigger an LM to generate unsafe responses. Red teaming is instrumental for both model alignment…

Computation and Language · Computer Science 2024-01-31 Nevan Wichers , Carson Denison , Ahmad Beirami

Machine translation is a popular test bed for research in neural sequence-to-sequence models but despite much recent research, there is still a lack of understanding of these models. Practitioners report performance degradation with large…

Computation and Language · Computer Science 2018-08-14 Myle Ott , Michael Auli , David Grangier , Marc'Aurelio Ranzato

We propose iteratively prompting a large language model to self-correct a translation, with inspiration from their strong language understanding and translation capability as well as a human-like translation approach. Interestingly,…

Computation and Language · Computer Science 2024-05-03 Pinzhen Chen , Zhicheng Guo , Barry Haddow , Kenneth Heafield

Machine Translation is the challenging problem for Indian languages. Every day we can see some machine translators being developed, but getting a high quality automatic translation is still a very distant dream . The correct translated…

Computation and Language · Computer Science 2014-07-11 Pooja Gupta , Nisheeth Joshi , Iti Mathur

For the past 60 years, Research in machine translation is going on. For the development in this field, a lot of new techniques are being developed each day. As a result, we have witnessed development of many automatic machine translators. A…

Computation and Language · Computer Science 2013-07-25 Nisheeth Joshi , Hemant Darbari , Iti Mathur

Massively multilingual models for neural machine translation (NMT) are theoretically attractive, but often underperform bilingual models and deliver poor zero-shot translations. In this paper, we explore ways to improve them. We argue that…

Computation and Language · Computer Science 2020-04-27 Biao Zhang , Philip Williams , Ivan Titov , Rico Sennrich

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael

Multilingual Neural Machine Translation (NMT) enables one model to serve all translation directions, including ones that are unseen during training, i.e. zero-shot translation. Despite being theoretically attractive, current models often…

Computation and Language · Computer Science 2022-01-20 Yilin Yang , Akiko Eriguchi , Alexandre Muzio , Prasad Tadepalli , Stefan Lee , Hany Hassan

Multilingual semantic parsing aims to leverage the knowledge from the high-resource languages to improve low-resource semantic parsing, yet commonly suffers from the data imbalance problem. Prior works propose to utilize the translations by…

Computation and Language · Computer Science 2023-05-23 Zhuang Li , Lizhen Qu , Philip R. Cohen , Raj V. Tumuluri , Gholamreza Haffari

The rise of Large Language Models (LLMs) has redefined Machine Translation (MT), enabling context-aware and fluent translations across hundreds of languages and textual domains. Despite their remarkable capabilities, LLMs often exhibit…

The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently…

Computation and Language · Computer Science 2025-03-06 Alberto Purpura , Sahil Wadhwa , Jesse Zymet , Akshay Gupta , Andy Luo , Melissa Kazemi Rad , Swapnil Shinde , Mohammad Shahed Sorower

In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant progress has been achieved, especially recently with neural…

Computation and Language · Computer Science 2018-10-09 Karin Sim Smith , Lucia Specia

As large language models (LLMs) are increasingly deployed as black-box components in real-world applications, red teaming has become essential for identifying potential risks. It tests LLMs with adversarial prompts to uncover…

Machine Learning · Computer Science 2026-03-25 Jiale Ding , Xiang Zheng , Yutao Wu , Cong Wang , Wei-Bin Lee , Ling Pan , Xingjun Ma , Yu-Gang Jiang

Machine learning is an important tool for decision making, but its ethical and responsible application requires rigorous vetting of its interpretability and utility: an understudied problem, particularly for natural language processing…

Artificial Intelligence · Computer Science 2019-06-11 Shi Feng , Jordan Boyd-Graber

Machine Translation (MT) and automatic MT evaluation have improved dramatically in recent years, enabling numerous novel applications. Automatic evaluation techniques have evolved from producing scalar quality scores to precisely locating…

Computation and Language · Computer Science 2026-03-23 Stefano Perrella , Eric Morales Agostinho , Hugo Zaragoza

Current speech translation systems, while having achieved impressive accuracies, are rather static in their behavior and do not adapt to real-world situations in ways human interpreters do. In order to improve their practical usefulness and…

Computation and Language · Computer Science 2025-08-12 Matthias Sperber , Maureen de Seyssel , Jiajun Bao , Matthias Paulik

A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. To date, systems aimed at complementing the skills of people have employed models…

Artificial Intelligence · Computer Science 2020-05-05 Bryan Wilder , Eric Horvitz , Ece Kamar

Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machine translation (NMT) has achieved great success and has…

Computation and Language · Computer Science 2021-01-01 Zhixing Tan , Shuo Wang , Zonghan Yang , Gang Chen , Xuancheng Huang , Maosong Sun , Yang Liu