English
Related papers

Related papers: Phi: Preference Hijacking in Multi-modal Large Lan…

200 papers

As Large Language Models (LLMs) become more powerful and autonomous, they increasingly face conflicts and dilemmas in many scenarios. We first summarize and taxonomize these diverse conflicts. Then, we model the LLM's preferences to make…

Artificial Intelligence · Computer Science 2026-03-17 Zhenheng Tang , Xiang Liu , Qian Wang , Eunsol Choi , Bo Li , Xiaowen Chu

Model selection is a fundamental task in Machine Learning~(ML), focusing on selecting the most suitable model from a pool of candidates by evaluating their performance on specific metrics. This process ensures optimal performance,…

Machine Learning · Computer Science 2025-02-21 Riccardo Petrucci , Luca Pajola , Francesco Marchiori , Luca Pasa , Mauro conti

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding

Large Language Models (LLMs) have seen rapid adoption in recent years, with industries increasingly relying on them to maintain a competitive advantage. These models excel at interpreting user instructions and generating human-like…

Cryptography and Security · Computer Science 2025-09-09 Andrew Yeo , Daeseon Choi

Large Language Models (LLMs) are deployed in interactive contexts with direct user engagement, such as chatbots and writing assistants. These deployments are vulnerable to prompt injection and jailbreaking (collectively, prompt hacking), in…

Large Language Models (LLMs) as judges and LLM-based data synthesis have emerged as two fundamental LLM-driven data annotation methods in model development. While their combination significantly enhances the efficiency of model training and…

Machine Learning · Computer Science 2026-03-05 Dawei Li , Renliang Sun , Yue Huang , Ming Zhong , Bohan Jiang , Jiawei Han , Xiangliang Zhang , Wei Wang , Huan Liu

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

While large language models (LLMs) demonstrate impressive capabilities across numerous applications, their robustness remains a critical concern. This paper is motivated by a specific vulnerability: the order sensitivity of LLMs. This…

Machine Learning · Computer Science 2025-05-22 Beni Egressy , Jan Stühmer

Recent large-scale natural language processing (NLP) systems use a pre-trained Large Language Model (LLM) on massive and diverse corpora as a headstart. In practice, the pre-trained model is adapted to a wide array of tasks via fine-tuning…

Computation and Language · Computer Science 2022-09-12 Jimit Majmudar , Christophe Dupuy , Charith Peris , Sami Smaili , Rahul Gupta , Richard Zemel

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

Large Language Models (LLMs) have become pivotal in advancing natural language processing, yet their potential to perpetuate biases poses significant concerns. This paper introduces a new framework employing Direct Preference Optimization…

Computation and Language · Computer Science 2024-07-22 Ahmed Allam

Large Vision-Language Models (LVLMs) have demonstrated their powerful multimodal capabilities. However, they also face serious safety problems, as adversaries can induce robustness issues in LVLMs through the use of well-designed…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Yu Wang

As the popularity of Large Language Models (LLMs) grow, combining model safety with utility becomes increasingly important. The challenge is making sure that LLMs can recognize and decline dangerous prompts without sacrificing their ability…

Computation and Language · Computer Science 2024-08-30 Ruchira Ray , Ruchi Bhalani

Reproducibility is a major concern across scientific fields. Human-Computer Interaction (HCI), in particular, is subject to diverse reproducibility challenges due to the wide range of research methodologies employed. In this article, we…

Human-Computer Interaction · Computer Science 2024-11-04 Thomas Kosch , Sebastian Feger

Typosquatting is a long-standing cyber threat that exploits human error in typing URLs to deceive users, distribute malware, and conduct phishing attacks. With the proliferation of domain names and new Top-Level Domains (TLDs),…

Cryptography and Security · Computer Science 2025-03-31 Jackson Welch

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where…

Computation and Language · Computer Science 2025-02-12 Anvesh Rao Vijjini , Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

In recent years, the rapid development of large language models (LLMs) has achieved remarkable performance across various tasks. However, research indicates that LLMs are vulnerable to jailbreak attacks, where adversaries can induce the…

Cryptography and Security · Computer Science 2024-08-23 Jiawei Zhao , Kejiang Chen , Xiaojian Yuan , Weiming Zhang