English
Related papers

Related papers: Multilingual Blending: LLM Safety Alignment Evalua…

200 papers

Large Language Models (LLMs) are susceptible to malicious influence by cyber attackers through intrusions such as adversarial, backdoor, and embedding inversion attacks. In response, the burgeoning field of LLM Security aims to study and…

Computation and Language · Computer Science 2024-12-17 Yiyi Chen , Russa Biswas , Heather Lent , Johannes Bjerva

Massively Multilingual Language Models (MMLMs) have recently gained popularity due to their surprising effectiveness in cross-lingual transfer. While there has been much work in evaluating these models for their performance on a variety of…

Computation and Language · Computer Science 2022-10-25 Kabir Ahuja , Sunayana Sitaram , Sandipan Dandapat , Monojit Choudhury

As large language models (LLMs) are deployed globally, it is crucial that their responses are calibrated across languages to accurately convey uncertainty and limitations. Prior work shows that LLMs are linguistically overconfident in…

Computation and Language · Computer Science 2025-08-11 Neil Rathi , Dan Jurafsky , Kaitlyn Zhou

Large language models (LLMs) are transforming the ways the general public accesses and consumes information. Their influence is particularly pronounced in pivotal sectors like healthcare, where lay individuals are increasingly appropriating…

Computation and Language · Computer Science 2023-10-24 Yiqiao Jin , Mohit Chandra , Gaurav Verma , Yibo Hu , Munmun De Choudhury , Srijan Kumar

Large Language Model (LLMs) such as ChatGPT that exhibit generative AI capabilities are facing accelerated adoption and innovation. The increased presence of Generative AI (GAI) inevitably raises concerns about the risks and safety…

Computers and Society · Computer Science 2024-07-29 Jaymari Chua , Yun Li , Shiyi Yang , Chen Wang , Lina Yao

Current large language models (LLMs) generally show a significant performance gap in alignment between English and other languages. To bridge this gap, existing research typically leverages the model's responses in English as a reference to…

Computation and Language · Computer Science 2025-09-16 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

Computation and Language · Computer Science 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

With the ubiquity of Large Language Models (LLMs), guardrails have become crucial to detect and defend against toxic content. However, with the increasing pervasiveness of LLMs in multilingual scenarios, their effectiveness in handling…

Computation and Language · Computer Science 2024-10-30 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Large Language Models (LLMs) exhibit significant disparities in performance across languages, primarily benefiting high-resource languages while marginalizing underrepresented ones. Continual Pretraining (CPT) has emerged as a promising…

Computation and Language · Computer Science 2025-10-09 Zihao Li , Shaoxiong Ji , Hengyu Luo , Jörg Tiedemann

Multilingualism is incredibly common around the world, leading to many important theoretical and practical questions about how children learn multiple languages at once. For example, does multilingual acquisition lead to delays in learning?…

Computation and Language · Computer Science 2026-05-08 Linda Zeng , Steven Y. Feng , Michael C. Frank

Code-mixing and code-switching (CSW) remain challenging phenomena for large language models (LLMs). Despite recent advances in multilingual modeling, LLMs often struggle in mixed-language settings, exhibiting systematic degradation in…

Computation and Language · Computer Science 2026-05-12 Himanshu Gupta , Pratik Jayarao , Chaitanya Dwivedi , Neeraj Varshney

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

Computation and Language · Computer Science 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

Safety fine-tuning helps align Large Language Models (LLMs) with human preferences for their safe deployment. To better understand the underlying factors that make models safe via safety fine-tuning, we design a synthetic data generation…

Machine Learning · Computer Science 2024-08-22 Samyak Jain , Ekdeep Singh Lubana , Kemal Oksuz , Tom Joy , Philip H. S. Torr , Amartya Sanyal , Puneet K. Dokania

Large Language Models (LLMs) are increasingly deployed in real-world applications where users engage in extended, mixed-topic conversations that depend on prior context. Yet, their reliability under realistic multi-turn interactions remains…

Computation and Language · Computer Science 2026-03-03 Jiyoon Myung

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable…

Computation and Language · Computer Science 2024-11-06 Zhexin Zhang , Yida Lu , Jingyuan Ma , Di Zhang , Rui Li , Pei Ke , Hao Sun , Lei Sha , Zhifang Sui , Hongning Wang , Minlie Huang

Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, while studies on risks associated with cross biases are limited to immediate context preferences. Cross-language…

Computation and Language · Computer Science 2025-08-07 Qianying Liu , Katrina Qiyao Wang , Fei Cheng , Sadao Kurohashi

Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they…

Cryptography and Security · Computer Science 2024-03-01 Jun Huang , Jiawei Zhang , Qi Wang , Weihong Han , Yanchun Zhang

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

Multilingual large language models (LLMs) possess impressive multilingual understanding and generation capabilities. However, their performance and cross-lingual alignment often lag for non-dominant languages. A common solution is to…

Computation and Language · Computer Science 2025-09-30 Mengyu Bu , Shaolei Zhang , Zhongjun He , Hua Wu , Yang Feng

Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data, thereby introducing new dimensions of potential attacks and complex risk combinations. In this paper, we begin with…

‹ Prev 1 4 5 6 7 8 10 Next ›