English
Related papers

Related papers: Learning in Low-Dimensional Subspaces: Orthogonal …

200 papers

Feature selection removes redundant features to enhanc performance and computational efficiency in downstream tasks. Existing works often struggle to capture complex feature interactions and adapt to diverse scenarios. Recent advances in…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Rui Xie , Zijun Yao , Yanjie Fu , Dongjie Wang

We present a novel framework for learning cost-efficient latent representations in problems with high-dimensional state spaces through nonlinear dimension reduction. By enriching linear state approximations with low-order polynomial terms…

Numerical Analysis · Mathematics 2026-05-27 Rudy Geelen , Laura Balzano , Karen Willcox

The autoencoder is an unsupervised learning paradigm that aims to create a compact latent representation of data by minimizing the reconstruction loss. However, it tends to overlook the fact that most data (images) are embedded in a…

Machine Learning · Computer Science 2023-10-26 Alokendu Mazumder , Tirthajit Baruah , Bhartendu Kumar , Rishab Sharma , Vishwajeet Pattanaik , Punit Rathore

In this work we investigate a specific transfer learning approach for deep reinforcement learning in the context where the internal dynamics between two tasks are the same but the visual representations differ. We learn a low-dimensional…

Machine Learning · Computer Science 2021-11-24 Geoffrey van Driessel , Vincent Francois-Lavet

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

Machine learning tasks are generally formulated as optimization problems, where one searches for an optimal function within a certain functional space. In practice, parameterized functional spaces are considered, in order to be able to…

Artificial Intelligence · Computer Science 2024-12-13 Manon Verbockhaven , Sylvain Chevallier , Guillaume Charpiat , Théo Rudkiewicz

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy…

Artificial Intelligence · Computer Science 2019-01-10 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

Machine Learning · Computer Science 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia

The classical theory of reinforcement learning (RL) has focused on tabular and linear representations of value functions. Further progress hinges on combining RL with modern function approximators such as kernel functions and deep neural…

Machine Learning · Computer Science 2021-01-01 Zhuoran Yang , Chi Jin , Zhaoran Wang , Mengdi Wang , Michael I. Jordan

The instability of embedding spaces across model retraining cycles presents significant challenges to downstream applications using user or item embeddings derived from recommendation systems as input features. This paper introduces a novel…

Information Retrieval · Computer Science 2025-08-12 Kevin Zielnicki , Ko-Jen Hsiao

In this work, we study value function approximation in reinforcement learning (RL) problems with high dimensional state or action spaces via a generalized version of representation policy iteration (RPI). We consider the limitations of…

Machine Learning · Computer Science 2019-01-18 Sephora Madjiheurem , Laura Toni

Low-rank structure is a common implicit assumption in many modern reinforcement learning (RL) algorithms. For instance, reward-free and goal-conditioned RL methods often presume that the successor measure admits a low-rank representation.…

Machine Learning · Computer Science 2025-11-06 Bastien Dubail , Stefan Stojanovic , Alexandre Proutière

Creating reinforcement learning (RL) agents that are capable of accepting and leveraging task-specific knowledge from humans has been long identified as a possible strategy for developing scalable approaches for solving long-horizon…

Artificial Intelligence · Computer Science 2022-06-22 Lin Guan , Sarath Sreedharan , Subbarao Kambhampati

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Datasets such as images, text, or movies are embedded in high-dimensional spaces. However, in important cases such as images of objects, the statistical structure in the data constrains samples to a manifold of dramatically lower…

Machine Learning · Computer Science 2019-10-29 Stefano Recanatesi , Matthew Farrell , Madhu Advani , Timothy Moore , Guillaume Lajoie , Eric Shea-Brown

This paper explores the application of Reinforcement Learning (RL) to the two-dimensional rectangular packing problem. We propose a reduced representation of the state and action spaces that allow us for high granularity. Leveraging UNet…

Machine Learning · Computer Science 2024-09-25 Waldemar Kołodziejczyk , Mariusz Kaleta

Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL problem is, however, to be an impediment to developing bilevel…

Optimization and Control · Mathematics 2025-02-28 Yan Yang , Bin Gao , Ya-xiang Yuan

Capturing latent variations ("contexts") is key to deploying reinforcement-learning (RL) agents beyond their training regime. We recast context-based RL as a dual inference-control problem and formally characterize two properties and their…

Machine Learning · Computer Science 2025-07-28 Yuliang Gu , Hongpeng Cao , Marco Caccamo , Naira Hovakimyan

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

Vision Transformers (ViTs) lack the hierarchical inductive biases inherent to Convolutional Neural Networks (CNNs), theoretically allowing them to maintain high-dimensional representations throughout all layers. However, recent observations…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kanishk Awadhiya