English
Related papers

Related papers: Alignment Debt: The Hidden Work of Making AI Usabl…

200 papers

AI Alignment, primarily in the form of Reinforcement Learning from Human Feedback (RLHF), has been a cornerstone of the post-training phase in developing Large Language Models (LLMs). It has also been a popular research topic across various…

Computation and Language · Computer Science 2025-08-26 Ilias Chalkidis

AI (super) alignment describes the challenge of ensuring (future) AI systems behave in accordance with societal norms and goals. While a quickly evolving literature is addressing biases and inequalities, the geographic variability of…

Artificial Intelligence · Computer Science 2025-08-08 Krzysztof Janowicz , Zilong Liu , Gengchen Mai , Zhangyu Wang , Ivan Majic , Alexandra Fortacz , Grant McKenzie , Song Gao

Current AI alignment paradigms rely on behavioral correction: external supervisors (e.g., RLHF) observe outputs, judge against preferences, and adjust parameters. This paper argues that behavioral correction is structurally analogous to an…

Computers and Society · Computer Science 2026-04-16 Rui Chai

Autonomous AI agents now plan, decide, and act on behalf of users across healthcare, financial services, and workplace contexts, often without step-by-step human approval. Existing AI literacy frameworks were built for a world in which…

Computers and Society · Computer Science 2026-05-28 Rohith Nama

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

LLMs increasingly excel on AI benchmarks, but doing so does not guarantee validity for downstream tasks. This study contrasts LLM alignment on benchmarks, downstream tasks, and, importantly the intended impact of those tasks. We evaluate…

Machine Learning · Computer Science 2026-04-21 Michael Hardy , Yunsung Kim

Frontier AI systems, including large language models (LLMs), hold increasing influence over the epistemology of human users. Such influence can reinforce prevailing societal values, potentially contributing to the lock-in of misguided moral…

Machine Learning · Computer Science 2024-11-01 Tianyi Qiu , Yang Zhang , Xuchuan Huang , Jasmine Xinze Li , Jiaming Ji , Yaodong Yang

Teachers' trust in artificial intelligence (AI) in education depends on how they balance its perceived benefits and risks. Yet global discussions about scaling AI in education rely on fragmented evidence, as most studies of teachers'…

Computers and Society · Computer Science 2026-05-12 Yan Tao , Olga Viberg , Deepak Varuvel Dennison , Zhikun Wu , René F. Kizilcec

From media platforms to chatbots, algorithms shape how people interact, learn, and discover information. Such interactions between users and an algorithm often unfold over multiple steps, during which strategic users can guide the algorithm…

Artificial Intelligence · Computer Science 2025-10-21 Ali Shirali

Frontier AI systems are being adopted across Africa, yet most AI safety evaluations are designed and validated in Western environments. In this paper, we argue that the portability gap can leave Africa-centric pathways to severe harm…

In AI alignment, extensive latitude must be granted to annotators, either human or algorithmic, to judge which model outputs are `better' or `safer.' We refer to this latitude as alignment discretion. Such discretion remains largely…

Artificial Intelligence · Computer Science 2025-02-18 Maarten Buyl , Hadi Khalaf , Claudio Mayrink Verdun , Lucas Monteiro Paes , Caio C. Vieira Machado , Flavio du Pin Calmon

Multilingual large language models (MLLMs) are increasingly deployed across cultural, linguistic, and political contexts, yet existing governance frameworks largely assume English-centric data, homogeneous user populations, and abstract…

Computation and Language · Computer Science 2026-02-03 Hanjing Shi , Dominic DiFranzo

Accurate estimation of item (question or task) difficulty is critical for educational assessment but suffers from the cold start problem. While Large Language Models demonstrate superhuman problem-solving capabilities, it remains an open…

Computation and Language · Computer Science 2026-05-12 Ming Li , Han Chen , Yunze Xiao , Jian Chen , Hong Jiao , Tianyi Zhou

AI Alignment is often presented as an interaction between a single designer and an artificial agent in which the designer attempts to ensure the agent's behavior is consistent with its purpose, and risks arise solely because of conflicts…

Artificial Intelligence · Computer Science 2023-09-14 Steve Phelps , Rebecca Ranson

Understanding human attitudes, preferences, and behaviors through social surveys is essential for academic research and policymaking. Yet traditional surveys face persistent challenges, including fixed-question formats, high costs, limited…

Computation and Language · Computer Science 2025-11-14 Chenxi Lin , Weikang Yuan , Zhuoren Jiang , Biao Huang , Ruitao Zhang , Jianan Ge , Yueqian Xu , Jianxing Yu

General Alignment has improved average-case helpfulness and safety, but current alignment practice still rewards confident, single-turn responses. The problem is not only that models fail on edge cases; it is that current evaluation makes…

Computation and Language · Computer Science 2026-05-19 Han Bao , Yue Huang , Xiaoda Wang , Zheyuan Zhang , Yujun Zhou , Carl Yang , Xiangliang Zhang , Yanfang Ye

Much of the research focus on AI alignment seeks to align large language models and other foundation models to the context-less and generic values of helpfulness, harmlessness, and honesty. Frontier model providers also strive to align…

Computers and Society · Computer Science 2025-01-23 Kush R. Varshney , Zahra Ashktorab , Djallel Bouneffouf , Matthew Riemer , Justin D. Weisz

Affordance theory suggests that environments inherently provide action possibilities shaping perception and behavior. While Multimodal Large Language Models (MLLMs) achieve strong performance in vision-language tasks, their ability to…

Computation and Language · Computer Science 2025-08-05 Junying Wang , Wenzhe Li , Yalun Wu , Yingji Liang , Yijin Guo , Chunyi Li , Haodong Duan , Zicheng Zhang , Guangtao Zhai

With AI systems becoming more powerful and pervasive, there is increasing debate about keeping their actions aligned with the broader goals and needs of humanity. This multi-disciplinary and multi-stakeholder debate must resolve many…

Artificial Intelligence · Computer Science 2021-12-21 Koen Holtman

AI models are already deployed in societies affected by armed conflict, and journalists, humanitarian workers, governments and ordinary citizens rely on them for information or for their work processes. No established practice exists for…

Artificial Intelligence · Computer Science 2026-05-22 Andrii Kryshtal