English
Related papers

Related papers: PrefPalette: Personalized Preference Modeling with…

200 papers

Feature selection is a prevalent data preprocessing paradigm for various learning tasks. Due to the expensive cost of acquiring supervision information, unsupervised feature selection sparks great interests recently. However, existing…

Machine Learning · Computer Science 2021-06-07 Xiaoying Xing , Hongfu Liu , Chen Chen , Jundong Li

Large Language Models (LLMs) are integral to applications such as conversational agents and content creation, where precise control over a model's personality is essential for maintaining tone, consistency, and user engagement. However,…

Computation and Language · Computer Science 2026-01-22 Seojin Hwang , Yumin Kim , Byeongjeong Kim , Donghoon Shin , Hwanhee Lee

Despite impressive progress in deep learning, generalizing far beyond the training distribution is an important open challenge. In this work, we consider few-shot classification, and aim to shed light on what makes some novel classes easier…

Machine Learning · Computer Science 2022-05-31 Mengye Ren , Eleni Triantafillou , Kuan-Chieh Wang , James Lucas , Jake Snell , Xaq Pitkow , Andreas S. Tolias , Richard Zemel

While Large Language Models (LLMs) are increasingly used in agentic frameworks to assist individual users, there is a growing need for agents that can proactively manage complex, multi-party collaboration. Systematic evaluation methods for…

Computation and Language · Computer Science 2026-05-07 Ziyi Liu , Bahar Sarrafzadeh , Pei Zhou , Longqi Yang , Jieyu Zhao , Ashish Sharma

AI-enhanced personality assessments are increasingly shaping hiring decisions, using affective computing to predict traits from the Big Five (OCEAN) model. However, integrating AI into these assessments raises ethical concerns, especially…

Human-Computer Interaction · Computer Science 2025-11-24 Dena F. Mujtaba , Nihar R. Mahapatra

Despite the potential benefits of machine learning (ML) in high-risk decision-making domains, the deployment of ML is not accessible to practitioners, and there is a risk of discrimination. To establish trust and acceptance of ML in such…

Machine Learning · Computer Science 2023-04-11 Francesco Di Carlo , Nazanin Nezami , Hadis Anahideh , Abolfazl Asudeh

The protection of sensitive data becomes more vital, as data increases in value and potency. Furthermore, the pressure increases from regulators and society on model developers to make their Artificial Intelligence (AI) models…

Machine Learning · Computer Science 2026-05-12 Florian van der Steen , Fré Vink , Heysem Kaya

Customizing robotic behaviors to be aligned with diverse human preferences is an underexplored challenge in the field of embodied AI. In this paper, we present Promptable Behaviors, a novel framework that facilitates efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Minyoung Hwang , Luca Weihs , Chanwoo Park , Kimin Lee , Aniruddha Kembhavi , Kiana Ehsani

User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Wenyi Mo , Ying Ba , Tianyu Zhang , Yalong Bai , Biye Li

Some traits making a "good" AI model are hard to describe upfront. For example, should responses be more polite or more casual? Such traits are sometimes summarized as model character or personality. Without a clear objective, conventional…

Computation and Language · Computer Science 2025-10-01 Arduin Findeis , Timo Kaufmann , Eyke Hüllermeier , Robert Mullins

Personalized alignment from preference data has focused primarily on improving personal reward model (RM) accuracy, with the implicit assumption that better preference ranking translates to better personalized behavior. However, in…

Artificial Intelligence · Computer Science 2026-01-09 Fady Rezk , Yuangang Pan , Chuan-Sheng Foo , Xun Xu , Nancy Chen , Henry Gouk , Timothy Hospedales

Online social networks have enabled new methods and modalities of collaboration and sharing. These advances bring privacy concerns: online social data is more accessible and persistent and simultaneously less contextualized than traditional…

Social and Information Networks · Computer Science 2014-06-11 Tehila Minkus , Nasir Memon

Learning from human involvement aims to incorporate the human subject to monitor and correct agent behavior errors. Although most interactive imitation learning methods focus on correcting the agent's action at the current state, they do…

Machine Learning · Computer Science 2025-10-17 Haoyuan Cai , Zhenghao Peng , Bolei Zhou

We introduce $\mathbf{SP-Rank}$, the first large-scale, publicly available dataset for benchmarking algorithms that leverage both first-order preferences and second-order predictions in ranking tasks. Each datapoint includes a personal vote…

Information Retrieval · Computer Science 2026-01-12 Hadi Hosseini , Debmalya Mandal , Amrit Puhan

Data owners face increasing liability for how the use of their data could harm under-priviliged communities. Stakeholders would like to identify the characteristics of data that lead to algorithms being biased against any particular…

Machine Learning · Computer Science 2022-08-19 Jonathan Vasquez , Xavier Gitiaux , Huzefa Rangwala

Federated recommendation systems employ federated learning techniques to safeguard user privacy by transmitting model parameters instead of raw user data between user devices and the central server. Nevertheless, the current federated…

Information Retrieval · Computer Science 2023-05-12 Sichun Luo , Yuanzhang Xiao , Xinyi Zhang , Yang Liu , Wenbo Ding , Linqi Song

Human feedback can alter language models in unpredictable and undesirable ways, as practitioners lack a clear understanding of what feedback data encodes. While prior work studies preferences over certain attributes (e.g., length or…

Computation and Language · Computer Science 2026-04-14 Rajiv Movva , Smitha Milli , Sewon Min , Emma Pierson

Personalized decision-making is essential for human-AI interaction, enabling AI agents to act in alignment with individual users' value preferences. As AI systems expand into real-world applications, adapting to personalized values beyond…

Artificial Intelligence · Computer Science 2025-12-17 Yitong Luo , Ziang Chen , Hou Hei Lam , Jiayu zhan , Junqi Wang , Zhenliang Zhang , Xue Feng

While preference modelling is becoming one of the pillars of machine learning, the problem of preference explanation remains challenging and underexplored. In this paper, we propose \textsc{Pref-SHAP}, a Shapley value-based model…

Machine Learning · Statistics 2022-11-09 Robert Hu , Siu Lun Chau , Jaime Ferrando Huertas , Dino Sejdinovic

Personalization is central to human-AI interaction, yet current diffusion-based image generation systems remain largely insensitive to user diversity. Existing attempts to address this often rely on costly paired preference data or…

Information Retrieval · Computer Science 2025-11-27 Gabriel Patron , Zhiwei Xu , Ishan Kapnadak , Felipe Maia Polo