中文
相关论文

相关论文: Learning Personalized Alignment for Evaluating Ope…

200 篇论文

Personality detection automatically identifies an individual's personality from various data sources, such as social media texts. However, as the parameter scale of language models continues to grow, the computational cost becomes…

计算与语言 · 计算机科学 2025-04-09 Lingzhi Shen , Yunfei Long , Xiaohao Cai , Guanming Chen , Imran Razzak , Shoaib Jameel

Large language models (LLMs) are increasingly used as evaluators for natural language generation, applying human-defined rubrics to assess system outputs. However, human rubrics are often static and misaligned with how models internally…

计算与语言 · 计算机科学 2026-02-10 Clemencia Siro , Pourya Aliannejadi , Mohammad Aliannejadi

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

计算与语言 · 计算机科学 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

计算与语言 · 计算机科学 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

信息检索 · 计算机科学 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

机器学习 · 计算机科学 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

人工智能 · 计算机科学 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. Recent research has…

计算与语言 · 计算机科学 2024-12-05 Sergio E. Zanotto , Segun Aroyehun

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

计算与语言 · 计算机科学 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

Large language models (LLMs) are increasingly being used as decision aids. However, users have diverse values and preferences that can affect their decision-making, which requires novel methods for LLM alignment and personalization.…

While Reinforcement Learning from Human Feedback (RLHF) is widely used to align Large Language Models (LLMs) with human preferences, it typically assumes homogeneous preferences across users, overlooking diverse human values and minority…

计算与语言 · 计算机科学 2025-10-28 Yijiang River Dong , Tiancheng Hu , Yinhong Liu , Ahmet Üstün , Nigel Collier

Existing large language models (LLMs) evaluation methods typically focus on testing the performance on some closed-environment and domain-specific benchmarks with human annotations. In this paper, we explore a novel unsupervised evaluation…

计算与语言 · 计算机科学 2025-02-24 Kun-Peng Ning , Shuo Yang , Yu-Yang Liu , Jia-Yu Yao , Zhen-Hui Liu , Yong-Hong Tian , Yibing Song , Li Yuan

Large Language Models (LLMs) have demonstrated promising capabilities as automatic evaluators in assessing the quality of generated natural language. However, LLMs still exhibit biases in evaluation and often struggle to generate coherent…

计算与语言 · 计算机科学 2025-01-20 Yinhong Liu , Han Zhou , Zhijiang Guo , Ehsan Shareghi , Ivan Vulić , Anna Korhonen , Nigel Collier

Large language models (LLMs) have revolutionized NLP research. Notably, in-context learning enables their use as evaluation metrics for natural language generation, making them particularly advantageous in low-resource scenarios and…

计算与语言 · 计算机科学 2024-11-19 Christoph Leiter , Steffen Eger

High-stakes applications require AI-generated models to be interpretable. Current algorithms for the synthesis of potentially interpretable models rely on objectives or regularization terms that represent interpretability only coarsely…

机器学习 · 计算机科学 2021-04-28 Marco Virgolin , Andrea De Lorenzo , Francesca Randone , Eric Medvet , Mattias Wahde

Preference learning is a widely adopted post-training technique that aligns large language models (LLMs) to human preferences and improves specific downstream task capabilities. In this work we systematically investigate how specific…

计算与语言 · 计算机科学 2024-12-23 Joongwon Kim , Anirudh Goyal , Aston Zhang , Bo Xiong , Rui Hou , Melanie Kambadur , Dhruv Mahajan , Hannaneh Hajishirzi , Liang Tan

A reliable and comprehensive evaluation metric that aligns with manual preference assessments is crucial for conversational head video synthesis methods development. Existing quantitative evaluations often fail to capture the full…

计算机视觉与模式识别 · 计算机科学 2023-08-03 Mohan Zhou , Yalong Bai , Wei Zhang , Ting Yao , Tiejun Zhao , Tao Mei

Learning from preference feedback is a common practice for aligning large language models~(LLMs) with human value. Conventionally, preference data is learned and encoded into a scalar reward model that connects a value head with an LLM to…

计算与语言 · 计算机科学 2025-09-03 Ziyi Ye , Xiangsheng Li , Qiuchi Li , Qingyao Ai , Yujia Zhou , Wei Shen , Dong Yan , Yiqun Liu

Current benchmarks for evaluating Large Language Models (LLMs) often do not exhibit enough writing style diversity, with many adhering primarily to standardized conventions. Such benchmarks do not fully capture the rich variety of…

计算与语言 · 计算机科学 2025-09-29 Kimberly Le Truong , Riccardo Fogliato , Hoda Heidari , Zhiwei Steven Wu