English
Related papers

Related papers: Steering LLMs for Culturally Localized Generation

200 papers

Steering methods have emerged as effective and targeted tools for guiding large language models' (LLMs) behavior without modifying their parameters. Multimodal large language models (MLLMs), however, do not currently enjoy the same suite of…

Machine Learning · Computer Science 2025-05-21 Woody Haosheng Gan , Deqing Fu , Julian Asilis , Ollie Liu , Dani Yogatama , Vatsal Sharan , Robin Jia , Willie Neiswanger

Research in cultural evolution aims at providing causal explanations for the change of culture over time. Over the past decades, this field has generated an important body of knowledge, using experimental, historical, and computational…

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

Computation and Language · Computer Science 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Language Models (LMs) are typically tuned with human preferences to produce helpful responses, but the impact of preference tuning on the ability to handle culturally diverse queries remains understudied. In this paper, we systematically…

Computation and Language · Computer Science 2025-09-19 Geyang Guo , Tarek Naous , Hiromi Wakaki , Yukiko Nishimura , Yuki Mitsufuji , Alan Ritter , Wei Xu

Although value-aligned language models (LMs) appear unbiased in explicit bias evaluations, they often exhibit stereotypes in implicit word association tasks, raising concerns about their fair usage. We investigate the mechanisms behind this…

Computation and Language · Computer Science 2025-06-10 Lihao Sun , Chengzhi Mao , Valentin Hofmann , Xuechunzi Bai

Social cues, which convey others' presence, behaviors, or identities, play a crucial role in human information seeking by helping individuals judge relevance and trustworthiness. However, existing LLM-based search systems primarily rely on…

Human-Computer Interaction · Computer Science 2026-01-06 Yubo Shu , Peng Zhang , Meng Wu , Yan Chen , Haoxuan Zhou , Guanming Liu , Yu Zhang , Liuxin Zhang , Qianying Wang , Tun Lu , Ning Gu

Large-scale deployment of large language models (LLMs) in various applications, such as chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure inclusivity. Culture has been widely studied in…

Multimodal LLMs (MLLMs) have reached remarkable levels of proficiency in understanding multimodal inputs. However, understanding and interpreting the behavior of such complex models is a challenging task, not to mention the dynamic shifts…

Artificial Intelligence · Computer Science 2025-08-14 Pegah Khayatan , Mustafa Shukor , Jayneel Parekh , Arnaud Dapogny , Matthieu Cord

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Large Language models (LLMs) can generate complicated source code from natural language prompts. However, LLMs can generate output that deviates from what the user wants, requiring supervision and editing. To support this process, we offer…

Software Engineering · Computer Science 2026-01-01 David Gros , Prem Devanbu

Large Language Model (LLM) image recognition is a powerful tool for extracting data from images, but accuracy depends on providing sufficient cues in the prompt - requiring a domain expert for specialized tasks. We introduce Cue Learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Peter J. Bentley , Soo Ling Lim , Fuyuki Ishikawa

Large language models (LLMs) are increasingly used in everyday communication, including multilingual interactions across different cultural contexts. While LLMs can now generate near-perfect literal translations, it remains unclear whether…

Computation and Language · Computer Science 2025-12-18 Helene Tenzer , Oumnia Abidi , Stefan Feuerriegel

Cultural representation in Large Language Model (LLM) outputs has primarily been evaluated through the proxies of cultural diversity and factual accuracy. However, a crucial gap remains in assessing cultural alignment: the degree to which…

Computation and Language · Computer Science 2026-04-07 Erin MacMurray van Liemt , Aida Davani , Sinchana Kumbale , Neha Dixit , Sunipa Dev

Steering has emerged as a practical approach to enable post-hoc guidance of LLMs towards enforcing a specific behavior. However, it remains largely underexplored for multimodal LLMs (MLLMs); furthermore, existing steering techniques, such…

Machine Learning · Computer Science 2025-11-04 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Arnaud Dapogny , Alasdair Newson , Matthieu Cord

LLMs have been showing limitations when it comes to cultural coverage and competence, and in some cases show regional biases such as amplifying Western and Anglocentric viewpoints. While there have been works analysing the cultural…

Computation and Language · Computer Science 2026-04-24 Joseba Fernandez de Landa , Carla Perez-Almendros , Jose Camacho-Collados

Steering vectors have emerged as a lightweight and effective approach for aligning large language models (LLMs) at inference time, enabling modulation over model behaviors by shifting LLM representations towards a target behavior. However,…

Machine Learning · Computer Science 2026-04-07 Soham Gadgil , Chris Lin , Su-In Lee

Large language models (LLMs) are increasingly used across diverse linguistic and cultural contexts, yet their cultural knowledge remains uneven across regions and languages. We present the DFKI-MLT system for SemEval-2026 Task 7 on cultural…

Computation and Language · Computer Science 2026-05-25 Yusser Al Ghussin , Daniil Gurgurov , Yasser Hamidullah , Josef van Genabith , Cristina España-Bonet , Simon Ostermann

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

Large language models (LLMs) can be controlled at inference time through prompts (in-context learning) and internal activations (activation steering). Different accounts have been proposed to explain these methods, yet their common goal of…

Machine Learning · Computer Science 2026-03-13 Eric Bigelow , Daniel Wurgaft , YingQiao Wang , Noah Goodman , Tomer Ullman , Hidenori Tanaka , Ekdeep Singh Lubana

Many benchmarks show that large language models can answer direct questions about culture. We study a different question: do they also change how they speak when culture is only implied by the situation? We evaluate 60 culturally grounded…