English
Related papers

Related papers: RPM: Reasoning-Level Personalization for Black-Box…

200 papers

The development of reasoning capabilities represents a critical frontier in large language models (LLMs) research, where reinforcement learning (RL) and process reward models (PRMs) have emerged as predominant methodological frameworks.…

Artificial Intelligence · Computer Science 2025-12-09 Zhangying Feng , Qianglong Chen , Ning Lu , Yongqian Li , Siqi Cheng , Shuangmu Peng , Duyu Tang , Shengcai Liu , Zhirui Zhang

Vision-language models (VLMs) pre-trained on web-scale datasets have demonstrated remarkable capabilities on downstream tasks when fine-tuned with minimal data. However, many VLMs rely on proprietary data and are not open-source, which…

Computation and Language · Computer Science 2024-05-15 Shihong Liu , Zhiqiu Lin , Samuel Yu , Ryan Lee , Tiffany Ling , Deepak Pathak , Deva Ramanan

Despite the many use cases for large language models (LLMs) in creating personalized chatbots, there has been limited research on evaluating the extent to which the behaviors of personalized LLMs accurately and consistently reflect specific…

Computation and Language · Computer Science 2024-04-03 Hang Jiang , Xiajie Zhang , Xubo Cao , Cynthia Breazeal , Deb Roy , Jad Kabbara

Large language models (LLMs) are increasingly integrated into users' daily lives, leading to a growing demand for personalized outputs. Previous work focuses on leveraging a user's own history, overlooking inter-user differences that are…

Computation and Language · Computer Science 2025-09-23 Yilun Qiu , Tianhao Shi , Xiaoyan Zhao , Fengbin Zhu , Yang Zhang , Fuli Feng

Large Language Models (LLMs) are increasingly expected to handle complex decision-making tasks, yet their ability to perform structured resource allocation remains underexplored. Evaluating their reasoning is also difficult due to data…

Artificial Intelligence · Computer Science 2025-08-11 Sankarshan Damle , Boi Faltings

Process Reward Models (PRMs) have emerged as a promising approach to enhance the reasoning capabilities of large language models (LLMs) by guiding their step-by-step reasoning toward a final answer. However, existing PRMs either treat each…

Machine Learning · Computer Science 2026-03-02 Zheng Zhang , Ziwei Shan , Kaitao Song , Yexin Li , Kan Ren

Large language models (LLMs) are typically aligned with population-level preferences, despite substantial variation across individual users. We introduce POPI, a user-level personalization framework that separates the problem into two…

Computation and Language · Computer Science 2026-04-28 Yizhuo Chen , Xin Liu , Ruijie Wang , Zheng Li , Pei Chen , Changlong Yu , Qingyu Yin , Priyanka Nigam , Meng Jiang , Bing Yin

Large language models (LLMs) have traditionally been aligned through one-size-fits-all approaches that assume uniform human preferences, fundamentally overlooking the diversity in user values and needs. This paper introduces a comprehensive…

Computation and Language · Computer Science 2025-05-23 Jia-Nan Li , Jian Guan , Songhao Wu , Wei Wu , Rui Yan

We investigate whether large language models (LLMs) can generate effective, user-facing explanations from a mathematically interpretable recommendation model. The model is based on constrained matrix factorization, where user types are…

Artificial Intelligence · Computer Science 2025-10-02 Maxime Manderlier , Fabian Lecron , Olivier Vu Thanh , Nicolas Gillis

Recommender systems are widely used in online services, with embedding-based models being particularly popular due to their expressiveness in representing complex signals. However, these models often function as a black box, making them…

Information Retrieval · Computer Science 2024-06-25 Yuxuan Lei , Jianxun Lian , Jing Yao , Xu Huang , Defu Lian , Xing Xie

Large language models (LLMs) have shown significant potential for robotics applications, particularly task planning, by harnessing their language comprehension and text generation capabilities. However, in applications such as household…

Robotics · Computer Science 2024-12-31 Dongge Han , Trevor McInroe , Adam Jelley , Stefano V. Albrecht , Peter Bell , Amos Storkey

Recent advancements have showcased the potential of Large Language Models (LLMs) in executing reasoning tasks, particularly facilitated by Chain-of-Thought (CoT) prompting. While tasks like arithmetic reasoning involve clear, definitive…

Information Retrieval · Computer Science 2024-08-05 Alicia Y. Tsai , Adam Kraft , Long Jin , Chenwei Cai , Anahita Hosseini , Taibai Xu , Zemin Zhang , Lichan Hong , Ed H. Chi , Xinyang Yi

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

Artificial Intelligence · Computer Science 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

In the realm of software development, providing accurate and personalized code explanations is crucial for both technical professionals and business stakeholders. Technical professionals benefit from enhanced understanding and improved…

Software Engineering · Computer Science 2025-01-28 Zexing Xu , Zhuang Luo , Yichuan Li , Kyumin Lee , S. Rasoul Etesami

Personalized outfit recommendation remains a complex challenge, demanding both fashion compatibility understanding and trend awareness. This paper presents a novel framework that harnesses the expressive power of large language models…

Information Retrieval · Computer Science 2024-09-19 Najmeh Forouzandehmehr , Nima Farrokhsiar , Ramin Giahi , Evren Korpeoglu , Kannan Achan

Process Reward Models (PRMs) are a powerful mechanism for steering large language model reasoning by providing fine-grained, step-level supervision. However, this effectiveness comes at a significant cost: PRMs require expert annotations…

Machine Learning · Computer Science 2026-05-12 Artyom Gadetsky , Maxim Kodryan , Siba Smarak Panigrahi , Hang Guo , Maria Brbic

Large Language Models (LLMs) have revolutionized natural language processing through their state of art reasoning capabilities. This paper explores the convergence of LLM reasoning techniques and feature generation for machine learning…

Computation and Language · Computer Science 2025-03-21 Dharani Chandra

The black-box nature of Large Language Models necessitates novel evaluation frameworks that transcend surface-level performance metrics. This study investigates the internal neural representations of cognitive complexity using Bloom's…

Artificial Intelligence · Computer Science 2026-02-20 Bianca Raimondi , Maurizio Gabbrielli

Business Process Management (BPM) aims to improve organizational activities and their outcomes by managing the underlying processes. To achieve this, it is often necessary to consider information from various sources, including unstructured…

Computation and Language · Computer Science 2023-07-20 Michael Grohs , Luka Abb , Nourhan Elsayed , Jana-Rebecca Rehse

Large Language Models (LLMs) are increasingly described as possessing strong reasoning capabilities, supported by high performance on mathematical, logical, and planning benchmarks. However, most existing evaluations rely on aggregate…

Computation and Language · Computer Science 2026-04-16 Md. Fahad Ullah Utsho , Mohd. Ruhul Ameen , Akif Islam , Md. Golam Rashed , Dipankar Das