中文
相关论文

相关论文: A Unified Algorithm Framework for Unsupervised Dis…

200 篇论文

In this paper, we introduce the online and streaming MAP inference and learning problems for Non-symmetric Determinantal Point Processes (NDPPs) where data points arrive in an arbitrary order and the algorithms are constrained to use a…

机器学习 · 计算机科学 2021-11-30 Aravind Reddy , Ryan A. Rossi , Zhao Song , Anup Rao , Tung Mai , Nedim Lipka , Gang Wu , Eunyee Koh , Nesreen Ahmed

Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, current methods fail to account for the varying difficulty…

计算与语言 · 计算机科学 2024-12-31 Jingyuan Ma , Rui Li , Zheng Li , Lei Sha , Zhifang Sui

Learning meaningful behaviors in the absence of reward is a difficult problem in reinforcement learning. A desirable and challenging unsupervised objective is to learn a set of diverse skills that provide a thorough coverage of the state…

Unsupervised Skill Discovery (USD) allows agents to autonomously learn diverse behaviors without task-specific rewards. While recent USD methods have shown promise, their application to real-world robotics remains underexplored. In this…

机器人学 · 计算机科学 2025-09-01 Rafael Cathomen , Mayank Mittal , Marin Vlastelica , Marco Hutter

Beam search is a go-to strategy for decoding neural sequence models. The algorithm can naturally be viewed as a subset optimization problem, albeit one where the corresponding set function does not reflect interactions between candidates.…

计算与语言 · 计算机科学 2023-06-26 Clara Meister , Martina Forster , Ryan Cotterell

In this paper we introduce a new unsupervised reinforcement learning method for discovering the set of intrinsic options available to an agent. This set is learned by maximizing the number of different states an agent can reliably reach, as…

机器学习 · 计算机科学 2016-11-23 Karol Gregor , Danilo Jimenez Rezende , Daan Wierstra

Understanding how subsets of items are chosen from offered sets is critical to assortment planning, wireless network planning, and many other applications. There are two seemingly unrelated subset choice models that capture dependencies…

机器学习 · 计算机科学 2023-02-23 Sander Aarts , David B. Shmoys , Alex Coy

In reinforcement learning, unsupervised skill discovery aims to learn diverse skills without extrinsic rewards. Previous methods discover skills by maximizing the mutual information (MI) between states and skills. However, such an MI…

机器学习 · 计算机科学 2023-05-09 Rushuai Yang , Chenjia Bai , Hongyi Guo , Siyuan Li , Bin Zhao , Zhen Wang , Peng Liu , Xuelong Li

In this paper we develop a unified approach for solving a wide class of sequential selection problems. This class includes, but is not limited to, selection problems with no-information, rank-dependent rewards, and considers both fixed as…

概率论 · 数学 2020-01-27 Alexander Goldenshluger , Yaakov Malinovsky , Assaf Zeevi

This paper proposes a framework for multi-robot systems to perform simultaneous learning and coverage of a domain of interest characterized by an unknown and potentially time-varying density function. To overcome the limitations of Gaussian…

机器人学 · 计算机科学 2025-11-11 Ruijie Du , Ruoyu Lin , Yanning Shen , Magnus Egerstedt

Active learning aims to achieve greater accuracy with less training data by selecting the most useful data samples from which it learns. Single-criterion based methods (i.e., informativeness and representativeness based methods) are simple…

机器学习 · 计算机科学 2021-07-06 Xueying Zhan , Qing Li , Antoni B. Chan

Reinforcement learning has shown promise in learning policies that can solve complex problems. However, manually specifying a good reward function can be difficult, especially for intricate tasks. Inverse reinforcement learning offers a…

机器学习 · 计算机科学 2017-11-28 Peter Henderson , Wei-Di Chang , Pierre-Luc Bacon , David Meger , Joelle Pineau , Doina Precup

Unsupervised Reinforcement Learning (RL) provides a promising paradigm for learning useful behaviors via reward-free per-training. Existing methods for unsupervised RL mainly conduct empowerment-driven skill discovery or entropy-based…

机器学习 · 计算机科学 2024-05-28 Chenjia Bai , Rushuai Yang , Qiaosheng Zhang , Kang Xu , Yi Chen , Ting Xiao , Xuelong Li

Identifying statistical regularities in solutions to some tasks in multi-task reinforcement learning can accelerate the learning of new tasks. Skill learning offers one way of identifying these regularities by decomposing pre-collected…

机器学习 · 计算机科学 2022-12-12 Yiding Jiang , Evan Zheran Liu , Benjamin Eysenbach , Zico Kolter , Chelsea Finn

Mutual information-based reinforcement learning (RL) has been proposed as a promising framework for retrieving complex skills autonomously without a task-oriented reward function through mutual information (MI) maximization or variational…

机器学习 · 计算机科学 2023-10-31 Seongun Kim , Kyowoon Lee , Jaesik Choi

The development of machine learning interatomic potentials faces a critical computational bottleneck with the generation and labeling of useful training datasets. We present a novel application of determinantal point processes (DPPs) to the…

应用统计 · 统计学 2026-03-24 Joanna Zou , Youssef Marzouk

Learning options that allow agents to exhibit temporally higher order behavior has proven to be useful in increasing exploration, reducing sample complexity and for various transfer scenarios. Deep Discovery of Options (DDO) is a generative…

机器学习 · 计算机科学 2019-08-06 Ameet Deshpande , Harshavardhan Kamarthi , Balaraman Ravindran

Users of industrial recommender systems are normally suggesteda list of items at one time. Ideally, such list-wise recommendationshould provide diverse and relevant options to the users. However, in practice, list-wise recommendation is…

信息检索 · 计算机科学 2020-04-22 Yichao Wang , Xiangyu Zhang , Zhirong Liu , Zhenhua Dong , Xinhua Feng , Ruiming Tang , Xiuqiang He

We propose a framework based on distributional reinforcement learning and recent attempts to combine Bayesian parameter updates with deep reinforcement learning. We show that our proposed framework conceptually unifies multiple previous…

机器学习 · 计算机科学 2018-06-22 Yunhao Tang , Shipra Agrawal

Subset selection problems ask for a small, diverse yet representative subset of the given data. When pairwise similarities are captured by a kernel, the determinants of submatrices provide a measure of diversity or independence of items…

数据结构与算法 · 计算机科学 2016-07-07 Tarun Kathuria , Amit Deshpande