中文
相关论文

相关论文: Understanding and Improving Hyperbolic Deep Reinfo…

200 篇论文

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

人工智能 · 计算机科学 2017-05-29 Maximilian Nickel , Douwe Kiela

Recent research in representation learning has shown that hierarchical data lends itself to low-dimensional and highly informative representations in hyperbolic space. However, even if hyperbolic embeddings have gathered attention in image…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Alexander Hauptmann

Incomplete Multi-View Clustering (IMVC) faces the challenge of learning discriminative representations from fragmentary observations while maintaining robustness against missing views. However, prevalent Euclidean-based methods suffer from…

机器学习 · 计算机科学 2026-04-21 Tianyi Chen , Haobo Wang , Kai Tang , Gengyu Lyu , Tianlei Hu , Gang Chen , Hong Ma , Meixiang Xiang

3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embedding spaces, whose flat geometry limits their ability to…

机器人学 · 计算机科学 2026-03-13 Jin Yang , Ping Wei , Yixin Chen , Nanning Zheng

The Reinforcement Learning (RL) building blocks, i.e. Q-functions and policy networks, usually take elements from the cartesian product of two domains as input. In particular, the input of the Q-function is both the state and the action,…

机器学习 · 计算机科学 2021-06-15 Shai Keynan , Elad Sarafian , Sarit Kraus

Reinforcement Learning (RL) remains a central optimisation framework in machine learning. Although RL agents can converge to optimal solutions, the definition of ``optimality'' depends on the environment's statistical properties. The…

机器学习 · 计算机科学 2026-01-14 Bert Verbruggen , Arne Vanhoyweghen , Vincent Ginis

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

机器学习 · 计算机科学 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

Embedding geometry plays a fundamental role in retrieval quality, yet dense retrievers for retrieval-augmented generation (RAG) remain largely confined to Euclidean space. However, natural language exhibits hierarchical structure from broad…

Reinforcement learning (RL) typically defines a discount factor as part of the Markov Decision Process. The discount factor values future rewards by an exponential scheme that leads to theoretical convergence guarantees of the Bellman…

机器学习 · 统计学 2019-03-01 William Fedus , Carles Gelada , Yoshua Bengio , Marc G. Bellemare , Hugo Larochelle

Given the exponential growth of the volume of the ball w.r.t. its radius, the hyperbolic space is capable of embedding trees with arbitrarily small distortion and hence has received wide attention for representing hierarchical datasets.…

机器学习 · 计算机科学 2024-12-25 Gal Mishne , Zhengchao Wan , Yusu Wang , Sheng Yang

Hyperbolic embeddings are a class of representation learning methods that offer competitive performances when data can be abstracted as a tree-like graph. However, in practice, learning hyperbolic embeddings of hierarchical data is…

机器学习 · 计算机科学 2024-07-24 Zhangyu Wang , Lantian Xu , Zhifeng Kong , Weilong Wang , Xuyu Peng , Enyang Zheng

Deep reinforcement learning agents are often misaligned, as they over-exploit early reward signals. Recently, several symbolic approaches have addressed these challenges by encoding sparse objectives along with aligned plans. However,…

In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space…

信息检索 · 计算机科学 2022-05-31 Menglin Yang , Min Zhou , Jiahong Liu , Defu Lian , Irwin King

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embeddings of CL are arranged on a hypersphere where similarity…

机器学习 · 计算机科学 2025-02-25 Yifei Zhang , Hao Zhu , Menglin Yang , Jiahong Liu , Rex Ying , Irwin King , Piotr Koniusz

Embedding the data in hyperbolic spaces can preserve complex relationships in very few dimensions, thus enabling compact models and improving efficiency of machine learning (ML) algorithms. The underlying idea is that hyperbolic…

机器学习 · 计算机科学 2025-01-14 Vladimir Jaćimović

Graph representation learning in Euclidean space, despite its widespread adoption and proven utility in many domains, often struggles to effectively capture the inherent hierarchical and complex relational structures prevalent in real-world…

机器学习 · 计算机科学 2025-08-26 Menglin Yang , Min Zhou , Tong Zhang , Jiahong Liu , Zhihao Li , Lujia Pan , Hui Xiong , Irwin King

Hyperbolic geometry has emerged as an effective latent space for representing complex networks, owing to its ability to capture hierarchical organization and heterogeneous connectivity patterns using low-dimensional embeddings. As a result,…

机器学习 · 计算机科学 2026-05-01 Sofía Pérez Casulo , Marcelo Fiori , Bernardo Marenco , Federico Larroca

Hyperparameter sensitivity in Deep Reinforcement Learning (RL) is often accepted as unavoidable. However, it remains unclear whether it is intrinsic to the RL problem or exacerbated by specific training mechanisms. We investigate this…

机器学习 · 计算机科学 2026-02-06 Jan Malte Töpperwien , Aditya Mohan , Marius Lindauer

In this work, we devise a new, general-purpose reinforcement learning strategy for the optimal control of parametric dynamical systems. Such problems frequently arise in applied sciences and engineering and entail a significant complexity…

机器学习 · 计算机科学 2026-02-12 Nicolò Botteghi , Stefania Fresca , Mengwu Guo , Andrea Manzoni

Reinforcement learning (RL) is a popular technique that allows an agent to learn by trial and error while interacting with a dynamic environment. The traditional Reinforcement Learning (RL) approach has been successful in learning and…