English
Related papers

Related papers: Structuring Value Representations via Geometric Co…

200 papers

We introduce a biologically plausible RL framework for solving tasks in partially observable Markov decision processes (POMDPs). The proposed algorithm combines three integral parts: (1) A Meta-RL architecture, resembling the mammalian…

Machine Learning · Computer Science 2025-04-17 Julian Lemmel , Radu Grosu

In the context of online education, designing an automatic solver for geometric problems has been considered a crucial step towards general math Artificial Intelligence (AI), empowered by natural language understanding and traditional…

Computers and Society · Computer Science 2024-03-25 Xiuqin Zhong , Shengyuan Yan , Gongqi Lin , Hongguang Fu , Liang Xu , Siwen Jiang , Lei Huang , Wei Fang

As a generalization of reinforcement learning (RL) to parametrizable goals, goal conditioned RL (GCRL) has a broad range of applications, particularly in challenging tasks in robotics. Recent work has established that the optimal value…

Machine Learning · Computer Science 2024-09-16 Khadichabonu Valieva , Bikramjit Banerjee

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

Machine Learning · Computer Science 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Graph Neural Networks (GNNs) have recently gained widespread attention as a successful tool for analyzing graph-structured data. However, imperfect graph structure with noisy links lacks enough robustness and may damage graph…

Machine Learning · Computer Science 2025-03-25 Xianlin Zeng , Yufeng Wang , Yuqi Sun , Guodong Guo , Wenrui Ding , Baochang Zhang

Continual reinforcement learning aims to sequentially learn a variety of tasks, retaining the ability to perform previously encountered tasks while simultaneously developing new policies for novel tasks. However, current continual RL…

Machine Learning · Computer Science 2023-06-16 Shiqi Liu , Mengdi Xu , Piede Huang , Yongkang Liu , Kentaro Oguchi , Ding Zhao

The ever increasing memory requirements of several applications has led to increased demands which might not be met by embedded devices. Constraining the usage of memory in such cases is of paramount importance. It is important that such…

Programming Languages · Computer Science 2022-08-09 Shalini Jain , Yashas Andaluri , S. VenkataKeerthy , Ramakrishna Upadrasta

Recent advances in feature learning have shown that self-supervised vision foundation models can capture semantic correspondences but often lack awareness of underlying 3D geometry. GECO addresses this gap by producing geometrically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Regine Hartwig , Dominik Muhle , Riccardo Marin , Daniel Cremers

Implicit Neural Representations (INRs) have emerged as a powerful tool for geometric representation, yet their suitability for physics-based simulation remains underexplored. While metrics like Hausdorff distance quantify surface…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Samundra Karki , Adarsh Krishnamurthy , Baskar Ganapathysubramanian

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Inverse reinforcement learning (IRL) is the problem of finding a reward function that generates a given optimal policy for a given Markov Decision Process. This paper looks at an algorithmic-independent geometric analysis of the IRL problem…

Machine Learning · Computer Science 2021-02-19 Abi Komanduru , Jean Honorio

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang

In the problem of structured prediction with graph representation learning (GRL for short), the hypothesis returned by the algorithm maps the set of features in the \emph{receptive field} of the targeted vertex to its label. To understand…

Machine Learning · Computer Science 2021-11-29 Yihan He , Joan Bruna

Trajectory adjustment decisions throughout the drilling process, called geosteering, affect subsequent choices and information gathering, thus resulting in a coupled sequential decision problem. Previous works on applying decision…

Machine Learning · Computer Science 2025-01-23 Ressi Bonti Muhammad , Sergey Alyaev , Reidar Brumer Bratvold

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

We design a new iterative algorithm, called REINFORCE-OPT, for solving a general type of optimization problems. This algorithm parameterizes the solution search rule and iteratively updates the parameter using a reinforcement learning (RL)…

Optimization and Control · Mathematics 2025-01-27 Chen Xu , Yun-Bin Zhao , Zhipeng Lu , Ye Zhang

Recently, deep learning approaches have been extensively investigated to reconstruct images from accelerated magnetic resonance image (MRI) acquisition. Although these approaches provide significant performance gain compared to compressed…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Eunju Cha , Gyutaek Oh , Jong Chul Ye

While representation and similarity learning have improved the sample efficiency of Reinforcement Learning (RL), they are rarely used to shape policy updates directly in the action space. To bridge this gap, a geometry-aware RL algorithm…

Machine Learning · Computer Science 2026-05-04 Stavros Orfanoudakis , Pedro P. Vergara

Mesh-based learning is one of the popular approaches nowadays to learn shapes. The most established backbone in this field is MeshCNN. In this paper, we propose infusing MeshCNN with geometric reasoning to achieve higher quality learning.…

Graphics · Computer Science 2021-05-28 Amir Barda , Yotam Erel , Amit H. Bermano

Reinforcement Learning (RL) has achieved tremendous development in recent years, but still faces significant obstacles in addressing complex real-life problems due to the issues of poor system generalization, low sample efficiency as well…

Artificial Intelligence · Computer Science 2025-02-25 Chao Yu , Shicheng Ye , Hankz Hankui Zhuo