English
Related papers

Related papers: CAGE: A Framework for Culturally Adaptive Red-Team…

200 papers

We introduce Synthetic Alignment data Generation for Safety Evaluation and Red Teaming (SAGE-RT or SAGE) a novel pipeline for generating synthetic alignment and red-teaming data. Existing methods fall short in creating nuanced and diverse…

Artificial Intelligence · Computer Science 2024-08-23 Anurakt Kumar , Divyanshu Kumar , Jatan Loya , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

In recent years, large language models (LLMs) have demonstrated strong performance on multilingual tasks. Given its wide range of applications, cross-cultural understanding capability is a crucial competency. However, existing benchmarks…

Computation and Language · Computer Science 2025-12-09 Shiwei Guo , Sihang Jiang , Qianxi He , Yanghua Xiao , Jiaqing Liang , Bi Yude , Minggui He , Shimin Tao , Li Zhang

Multimodal Large Language Models (MLLMs) exacerbate safety risks by introducing vulnerabilities across multiple modalities, such as language and vision. Current MLLM safety evaluation tools, however, suffer from major limitations: 1)…

Computation and Language · Computer Science 2026-05-28 Yongwoo Kim , Sojung An , Yunjin Park , Jungwon Yoon , Dujin Lee , HyunBeom Cho , Jaewon Lee , Wonhyuk Lee , Youngchol Kim , JeongYeop Kim , Donghyun Kim

The rapid progress in large language models (LLMs) has paved the way for novel approaches in knowledge-intensive tasks. Among these, Cache-Augmented Generation (CAG) has emerged as a promising alternative to Retrieval-Augmented Generation…

Computation and Language · Computer Science 2025-05-14 Rishabh Agrawal , Himanshu Kumar

As large language models (LLMs) achieve strong performance on traditional benchmarks, there is an urgent need for more challenging evaluation frameworks that probe deeper aspects of semantic understanding. We introduce SAGE (Semantic…

Artificial Intelligence · Computer Science 2025-09-26 Samarth Goel , Reagan J. Lee , Kannan Ramchandran

Cultural context profoundly shapes how people interpret online content, yet vision-language models (VLMs) remain predominantly trained through Western or English-centric lenses. This limits their fairness and cross-cultural robustness in…

Computation and Language · Computer Science 2026-02-13 Mo Wang , Kaixuan Ren , Pratik Jalan , Ahmed Ashraf , Tuong Vy Vu , Rahul Seetharaman , Shah Nawaz , Usman Naseem

As Large Language Models (LLMs) are deployed and integrated into thousands of applications, the need for scalable evaluation of how models respond to adversarial attacks grows rapidly. However, LLM security is a moving target: models…

Computation and Language · Computer Science 2024-06-18 Leon Derczynski , Erick Galinkin , Jeffrey Martin , Subho Majumdar , Nanna Inie

Automatic generation of high-quality commit messages for code commits can substantially facilitate software developers' works and coordination. However, the semantic gap between source code and natural language poses a major challenge for…

Computation and Language · Computer Science 2021-06-22 Lun Yiu Nie , Cuiyun Gao , Zhicong Zhong , Wai Lam , Yang Liu , Zenglin Xu

Robust content moderation requires classification systems that can quickly adapt to evolving policies without costly retraining. We present classification using Retrieval-Augmented Generation (RAG), which shifts traditional classification…

Computation and Language · Computer Science 2025-08-11 Richard Willats , Josh Pennington , Aravind Mohan , Bertie Vidgen

Large language models are unable to continuously adapt and learn from new data during reasoning at inference time. To address this limitation, we propose that complex reasoning tasks be decomposed into atomic subtasks and introduce SAGE, a…

Computation and Language · Computer Science 2025-09-09 Jiacheng Wei , Faguo Wu , Xiao Zhang

The vision of an inclusive World Wide Web is impeded by a severe linguistic divide, particularly for communities in low-resource regions of Southeast Asia. While large language models (LLMs) offer a potential solution for translation, their…

Computation and Language · Computer Science 2026-03-23 Zhixiang Lu , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Imran Razzak , Jionglong Su , Zhengyong Jiang

While safety mechanisms have significantly progressed in filtering harmful text inputs, MLLMs remain vulnerable to multimodal jailbreaks that exploit their cross-modal reasoning capabilities. We present MIRAGE, a novel multimodal jailbreak…

Computation and Language · Computer Science 2025-03-26 Wenhao You , Bryan Hooi , Yiwei Wang , Youke Wang , Zong Ke , Ming-Hsuan Yang , Zi Huang , Yujun Cai

Knowledge Editing (KE) has emerged as a promising paradigm for updating facts in Large Language Models (LLMs) without retraining. However, progress in Multilingual Knowledge Editing (MKE) is currently hindered by biased evaluation…

Computation and Language · Computer Science 2026-01-27 Yucheng Hu , Wei Zhou , Juesi Xiao

Generative Adversarial Networks (GANs) have emerged as a prominent research focus for image editing tasks, leveraging the powerful image generation capabilities of the GAN framework to produce remarkable results.However, prevailing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ruicheng Zhang , Guoheng Huang , Yejing Huo , Xiaochen Yuan , Zhizhen Zhou , Xuhang Chen , Guo Zhong

Visual token compression is widely used to accelerate large vision-language models (LVLMs) by pruning or merging visual tokens, yet its adversarial robustness remains unexplored. We show that existing encoder-based attacks cannot fully…

Cryptography and Security · Computer Science 2026-05-19 Xinwei Zhang , Hangcheng Liu , Li Bai , Hao Wang , Qingqing Ye , Tianwei Zhang , Haibo Hu

In cross-cultural recipe adaptation, the goal is not only to ensure cultural appropriateness and retain the original dish's essence, but also to provide diverse options for various dietary needs and preferences. Retrieval Augmented…

Computation and Language · Computer Science 2026-04-21 Tianyi Hu , Andrea Morales-Garzón , Jingyi Zheng , Maria Maistro , Daniel Hershcovich

Retrieval-augmented generation (RAG) enhances the capabilities of large language models (LLMs) by incorporating external knowledge into their input prompts. However, when the retrieved context contradicts the LLM's parametric knowledge, it…

Computation and Language · Computer Science 2025-09-29 Eunseong Choi , June Park , Hyeri Lee , Jongwuk Lee

AI agents are increasingly deployed in production, yet their security evaluations remain bottlenecked by manual red-teaming or static benchmarks that fail to model adaptive, multi-turn adversaries. We propose NAAMSE, an evolutionary…

Artificial Intelligence · Computer Science 2026-03-10 Kunal Pai , Parth Shah , Harshil Patel

Knowledge editing (KE) methods offer an efficient way to modify knowledge in large language models. Current KE evaluations typically assess editing success by considering only the edited knowledge without any preceding contexts. In…

Computation and Language · Computer Science 2025-06-03 Haewon Park , Gyubin Choi , Minjun Kim , Yohan Jo

As Large Language Models are rapidly deployed across diverse applications from healthcare to financial advice, safety evaluation struggles to keep pace. Current benchmarks focus on single-turn interactions with generic policies, failing to…

Cryptography and Security · Computer Science 2025-10-28 Madhur Jindal , Hari Shrawgi , Parag Agrawal , Sandipan Dandapat
‹ Prev 1 2 3 10 Next ›