中文
相关论文

相关论文: Incentive Compatible Pareto Alignment for Multi-So…

200 篇论文

As generative agents become increasingly capable, alignment of their behavior with complex human values remains a fundamental challenge. Existing approaches often simplify human intent through reduction to a scalar reward, overlooking the…

机器学习 · 计算机科学 2025-07-30 Kalyan Cherukuri , Aarav Lala

Multi-preference optimization enriches language-model alignment beyond pairwise preferences by contrasting entire sets of helpful and undesired responses, thereby enabling richer training signals for large language models. During self-play…

机器学习 · 计算机科学 2025-06-10 Taneesh Gupta , Rahul Madhavan , Xuchao Zhang , Chetan Bansal , Saravan Rajmohan

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

机器学习 · 计算机科学 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding

Preference-Conditioned Policy Learning (PCPL) in Multi-Objective Reinforcement Learning (MORL) aims to approximate diverse Pareto-optimal solutions by conditioning policies on user-specified preferences over objectives. This enables a…

机器学习 · 计算机科学 2026-02-04 Zhiheng Jiang , Yunzhe Wang , Ryan Marr , Ellen Novoseller , Benjamin T. Files , Volkan Ustun

While machine-type communication (MTC) devices generate considerable amounts of data, they often cannot process the data due to limited energy and computational power. To empower MTC with intelligence, edge machine learning has been…

信息论 · 计算机科学 2020-07-20 Shuai Wang , Yik-Chung Wu , Minghua Xia , Rui Wang , H. Vincent Poor

Large-scale knowledge bases have currently reached impressive sizes; however, these knowledge bases are still far from complete. In addition, most of the existing methods for knowledge base completion only consider the direct links between…

计算与语言 · 计算机科学 2017-02-27 Xixun Lin , Yanchun Liang , Fausto Giunchiglia , Xiaoyue Feng , Renchu Guan

With the rapid advancement of data science, charts have evolved from simple numerical presentation tools to essential instruments for insight discovery and decision-making support. However, current chart data intelligence exhibits…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jiajin Tang , Gaoyang , Wenjie Wang , Sibei Yang , Xing Chen

In the realm of large language models (LLMs), the ability of models to accurately follow instructions is paramount as more agents and applications leverage LLMs for construction, where the complexity of instructions are rapidly increasing.…

计算与语言 · 计算机科学 2025-07-18 Xinghua Zhang , Haiyang Yu , Cheng Fu , Fei Huang , Yongbin Li

Fitting cross-classified multilevel models with binary response is challenging. In this setting a promising method is Bayesian inference through Integrated Nested Laplace Approximations (INLA), which performs well in several latent variable…

统计计算 · 统计学 2016-07-21 Leonardo Grilli , Francesco Innocenti

Graphs provide an efficient tool for object representation in various computer vision applications. Once graph-based representations are constructed, an important question is how to compare graphs. This problem is often formulated as a…

机器学习 · 统计学 2010-04-30 Mikhail Zaslavskiy , Francis Bach , Jean-Philippe Vert

Given the effectiveness and ease of use, Item-based Collaborative Filtering (ICF) methods have been broadly used in industry in recent years. The key of ICF lies in the similarity measurement between items, which however is a coarse-grained…

信息检索 · 计算机科学 2019-11-12 Liang Zhang , Guannan Liu , Junjie Wu

Reward shaping is effective in addressing the sparse-reward challenge in reinforcement learning (RL) by providing immediate feedback through auxiliary, informative rewards. Based on the reward shaping strategy, we propose a novel multi-task…

机器学习 · 计算机科学 2025-10-28 Haozhe Ma , Zhengding Luo , Thanh Vinh Vo , Kuankuan Sima , Tze-Yun Leong

Large Language Models (LLMs) have made remarkable progress in enhancing step-by-step reasoning through reinforcement learning. However, the Group Relative Policy Optimization (GRPO) algorithm, which relies on sparse reward rules, often…

人工智能 · 计算机科学 2025-07-30 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

As a fundamental problem in pattern recognition, graph matching has applications in a variety of fields, from computer vision to computational biology. In graph matching, patterns are modeled as graphs and pattern recognition amounts to…

计算机视觉与模式识别 · 计算机科学 2008-06-19 Tiberio S. Caetano , Julian J. McAuley , Li Cheng , Quoc V. Le , Alex J. Smola

RLHF has emerged as a predominant approach for aligning artificial intelligence systems with human preferences, demonstrating exceptional and measurable efficacy in instruction following tasks; however, it exhibits insufficient compliance…

人工智能 · 计算机科学 2025-05-20 Ruopei Sun , Jianfeng Cai , Jinhua Zhu , Kangwen Zhao , Dongyun Xue , Wengang Zhou , Li Li , Houqiang Li

Ensuring AI models align with human values is essential for their safety and functionality. Reinforcement learning from human feedback (RLHF) leverages human preferences to achieve this alignment. However, when preferences are sourced from…

机器学习 · 计算机科学 2025-02-10 Ryan Bahlous-Boldi , Li Ding , Lee Spector , Scott Niekum

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

人工智能 · 计算机科学 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Entity Alignment (EA) has attracted widespread attention in both academia and industry, which aims to seek entities with same meanings from different Knowledge Graphs (KGs). There are substantial multi-step relation paths between entities…

计算与语言 · 计算机科学 2022-08-09 Weishan Cai , Wenjun Ma , Jieyu Zhan , Yuncheng Jiang

Entity alignment (EA) aims to find the equivalent entities in different KGs, which is a crucial step in integrating multiple KGs. However, most existing EA methods have poor scalability and are unable to cope with large-scale datasets. We…

人工智能 · 计算机科学 2021-08-13 Xin Mao , Wenting Wang , Yuanbin Wu , Man Lan

Reinforcement learning for multi-step reasoning with large language models (LLMs) typically relies on sparse terminal rewards, which creates a poorly conditioned credit-assignment problem: the final feedback is propagated uniformly across…

机器学习 · 计算机科学 2026-05-26 Fei Ding , Yongkang Zhang , youwei wang , Zijian Zeng