中文
相关论文

相关论文: Controllable and explainable personality sliders f…

200 篇论文

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

计算工程、金融与科学 · 计算机科学 2025-09-26 Hong Su

Precise control over language model generation is vital for ensuring both safety and reliability. Although prompt engineering and steering are commonly used to intervene in model behaviors, the vast number of parameters in models often…

计算与语言 · 计算机科学 2025-06-04 Mengru Wang , Ziwen Xu , Shengyu Mao , Shumin Deng , Zhaopeng Tu , Huajun Chen , Ningyu Zhang

Large language models (LLMs) often encode cognitive behaviors unpredictably across prompts, layers, and contexts, making them difficult to diagnose and control. We present CBMAS, a diagnostic framework for continuous activation steering,…

人工智能 · 计算机科学 2026-01-13 Ahmed H. Ismail , Anthony Kuang , Ayo Akinkugbe , Kevin Zhu , Sean O'Brien

Large Language Models (LLMs) exhibit strong implicit personalization ability, yet most existing approaches treat this behavior as a black box, relying on prompt engineering or fine tuning on user data. In this work, we adopt a mechanistic…

计算与语言 · 计算机科学 2026-04-27 Weixu Zhang , Ye Yuan , Changjiang Han , Yuxing Tian , Zipeng Sun , Linfeng Du , Jikun Kang , Hong Kang , Xue Liu , Haolun Wu

It is a critical challenge to efficiently unlock the powerful reasoning potential of Large Language Models (LLMs) for specific tasks or new distributions. Existing test-time adaptation methods often require tuning model parameters, which is…

计算与语言 · 计算机科学 2025-12-05 Xinyue Kang , Diwei Shi , Li Chen

Sparse autoencoders (SAEs) decompose language model activations into interpretable features, but existing methods reveal only which features activate, not which change model outputs when amplified. We introduce Control Reinforcement…

机器学习 · 计算机科学 2026-05-05 Seonglae Cho , Zekun Wu , Adriano Koshiyama

Recent advancements in recommender systems have focused on leveraging Large Language Models (LLMs) to improve user preference modeling, yielding promising outcomes. However, current LLM-based approaches struggle to fully leverage user…

信息检索 · 计算机科学 2024-10-31 Yang Zhang , Juntao You , Yimeng Bai , Jizhi Zhang , Keqin Bao , Wenjie Wang , Tat-Seng Chua

Reflection, the ability of large language models (LLMs) to evaluate and revise their own reasoning, has been widely used to improve performance on complex reasoning tasks. Yet, most prior works emphasizes designing reflective prompting…

机器学习 · 计算机科学 2025-12-12 Fu-Chieh Chang , Yu-Ting Lee , Pei-Yuan Wu

As large language models (LLMs) become increasingly embedded in everyday applications, ensuring their alignment with the diverse preferences of individual users has become a critical challenge. Currently deployed approaches typically assume…

机器学习 · 计算机科学 2024-12-19 Katarzyna Kobalczyk , Claudio Fanconi , Hao Sun , Mihaela van der Schaar

Large language models (LLMs) are increasingly deployed as autonomous decision-makers in strategic settings, yet we have limited tools for understanding their high-level behavioral traits. We use activation steering methods in game-theoretic…

人工智能 · 计算机科学 2026-03-24 Johnathan Sun , Andrew Zhang

Large language models can be steered at inference time through prompting or activation interventions, but activation steering methods often underperform compared to prompt-based approaches. We propose a framework that formulates prompt…

计算与语言 · 计算机科学 2026-05-06 Geert Heyman , Frederik Vandeputte

Supervised fine-tuning (SFT) is crucial for aligning Large Language Models (LLMs) with human instructions. The primary goal during SFT is to select a small yet representative subset of training data from the larger pool, such that…

计算与语言 · 计算机科学 2024-12-10 Tingyu Xia , Bowen Yu , Kai Dang , An Yang , Yuan Wu , Yuan Tian , Yi Chang , Junyang Lin

Large reasoning models (LRMs) achieve strong performance through extended reasoning traces, but they often exhibit overthinking behavior for low-complexity queries. Existing efforts to mitigate this issue are fundamentally limited by…

机器学习 · 计算机科学 2026-02-27 Zihang Xu , Haozhi Xie , Ziqi Miao , Wuxuan Gong , Chen Qian , Lijun Li

While large language models (LLMs) are trained to align with human values, their generations may still violate safety constraints. A growing line of work addresses this problem by modifying the model's sampling policy at decoding time using…

机器学习 · 计算机科学 2026-05-15 Bat-Sheva Einbinder , Hen Davidov , Yee Whye Teh , Yarin Gal , Yaniv Romano

The quality of human preference data is crucial for training and evaluating large language models (LLMs), particularly in reinforcement learning from human feedback (RLHF) and direct preference optimization (DPO) scenarios. Traditional…

计算与语言 · 计算机科学 2025-06-02 Yimin Du

Multilingual Large Language Models (LLMs) often exhibit hallucinations such as unintended code-switching, reducing reliability in downstream tasks. We propose latent-space language steering, a lightweight inference-time method that…

计算与语言 · 计算机科学 2026-04-16 Andrey Goncharov , Nikolai Kondusov , Alexey Zaytsev

This study validates Large Language Models (LLMs) as a dynamic alternative to questionnaire-based personality assessment. Using a within-subjects experiment (N=33), we compared Big Five personality scores derived from guided LLM…

计算与语言 · 计算机科学 2026-02-19 Andrius Matšenas , Anet Lello , Tõnis Lees , Hans Peep , Kim Lilii Tamm

Even after fine-tuning and reinforcement learning, large language models (LLMs) can be difficult, if not impossible, to control reliably with prompts alone. We propose a new inference-time approach to enforcing syntactic and semantic…

人工智能 · 计算机科学 2023-11-28 Alexander K. Lew , Tan Zhi-Xuan , Gabriel Grand , Vikash K. Mansinghka

Understanding and controlling the behavior of large language models (LLMs) is an increasingly important topic in multilingual NLP. Beyond prompting or fine-tuning, , i.e.,~manipulating internal representations during inference, has emerged…

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

信息检索 · 计算机科学 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo