English
Related papers

Related papers: Structuring Value Representations via Geometric Co…

200 papers

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

We present a novel approach to automate and optimize anisotropic p-adaptation in high-order h/p solvers using Reinforcement Learning (RL). The dynamic RL adaptation uses the evolving solution to adjust the high-order polynomials. We develop…

Since the 1990s, considerable empirical work has been carried out to train statistical models, such as neural networks (NNs), as learned heuristics for combinatorial optimization (CO) problems. When successful, such an approach eliminates…

Machine Learning · Statistics 2026-01-21 Orit Davidovich , Shimrit Shtern , Segev Wasserkrug , Nimrod Megiddo

The performance of Large Language Models (LLMs) is increasingly governed by data efficiency rather than raw scaling volume. However, existing selection methods often decouple global distribution balancing from local instance selection,…

Computation and Language · Computer Science 2026-03-03 Changhao Wang , Jiaolong Yang , Xinhao Yao , Yunfei Yu , Peng Jiao , Lu Yu , Junpeng Fang , Riccardo Cantoro , Qing Cui , Jun Zhou

Recent point cloud completion models, including transformer-based, denoising-based, and other state-of-the-art approaches, generate globally plausible shapes from partial inputs but often leave local geometric inconsistencies. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Bhanu Pratap Paregi , Vaibhav Kumar

Effective molecular representation learning is of great importance to facilitate molecular property prediction, which is a fundamental task for the drug and material industry. Recent advances in graph neural networks (GNNs) have shown great…

Machine Learning · Computer Science 2022-05-17 Xiaomin Fang , Lihang Liu , Jieqiong Lei , Donglong He , Shanzhuo Zhang , Jingbo Zhou , Fan Wang , Hua Wu , Haifeng Wang

Compositional generalization in sequential decision-making requires identifying which parts of prior rollouts remain useful for new tasks. Existing methods reuse skills or predictive models, but often overlook rich local transition geometry…

Machine Learning · Computer Science 2026-05-15 Zuyuan Zhang , Carlee Joe-Wong , Tian Lan

We present a novel method for Deep Reinforcement Learning (DRL), incorporating the convex property of the value function over the belief space in Partially Observable Markov Decision Processes (POMDPs). We introduce hard- and soft-enforced…

Machine Learning · Computer Science 2025-03-13 Daniel Koutas , Daniel Hettegger , Kostas G. Papakonstantinou , Daniel Straub

Learning from rewards (i.e., reinforcement learning or RL) and learning to imitate a teacher (i.e., teacher-student learning) are two established approaches for solving sequential decision-making problems. To combine the benefits of these…

Machine Learning · Computer Science 2024-02-21 Idan Shenfeld , Zhang-Wei Hong , Aviv Tamar , Pulkit Agrawal

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they…

Robotics · Computer Science 2022-11-22 Malte Mosbach , Sven Behnke

Many traditional algorithms for solving combinatorial optimization problems involve using hand-crafted heuristics that sequentially construct a solution. Such heuristics are designed by domain experts and may often be suboptimal due to the…

Machine Learning · Computer Science 2020-12-25 Nina Mazyavkina , Sergey Sviridov , Sergei Ivanov , Evgeny Burnaev

Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yushuai Song , Weize Quan , Weining Wang , Jiahui Sun , Jing Liu , Meng Li , Pengbin Yu , Zhentao Chen , Wei Shen , Lunxi Yuan , Dong-ming Yan

Deep Reinforcement Learning (DRL) is a powerful framework for solving complex sequential decision-making problems, particularly in robotic control. However, its practical deployment is often hindered by the substantial amount of experience…

Here we propose using the successor representation (SR) to accelerate learning in a constructive knowledge system based on general value functions (GVFs). In real-world settings like robotics for unstructured and dynamic environments, it is…

Machine Learning · Computer Science 2018-03-28 Craig Sherstan , Marlos C. Machado , Patrick M. Pilarski

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Reinforcement learning (RL) over text representations can be effective for finding high-value policies that can search over graphs. However, RL requires careful structuring of the search space and algorithm design to be effective in this…

Machine Learning · Computer Science 2023-10-05 Raj Ghugare , Santiago Miret , Adriana Hugessen , Mariano Phielipp , Glen Berseth

While Goal-Conditioned Reinforcement Learning (GCRL) has gained attention, its algorithmic robustness against adversarial perturbations remains unexplored. The attacks and robust representation training methods that are designed for…

Machine Learning · Computer Science 2023-12-21 Xiangyu Yin , Sihao Wu , Jiaxu Liu , Meng Fang , Xingyu Zhao , Xiaowei Huang , Wenjie Ruan

The ability to transform location-centric geospatial data into meaningful computational representations has become fundamental to modern spatial analysis and decision-making. Geospatial Representation Learning (GRL), the process of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xixuan Hao , Yutian Jiang , Xingchen Zou , Jiabo Liu , Yifang Yin , Song Gao , Flora Salim , Tianrui Li , Yuxuan Liang

Prior ReLoc3R achieves breakthrough performance with fast 25ms inference and state-of-the-art regression accuracy, yet our analysis reveals subtle geometric inconsistencies in its internal representations that prevent reaching the precision…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingxing Li , Yongjae Lee , Deliang Fan