English
Related papers

Related papers: Program Synthesis Guided Reinforcement Learning fo…

200 papers

This paper develops a robust and efficient method for policy learning from observational data in the presence of unobserved confounding, complementing existing instrumental variable (IV) based approaches. We employ the marginal sensitivity…

Econometrics · Economics 2025-07-29 Zequn Jin , Gaoqian Xu , Xi Zheng , Yahong Zhou

A tenet of reinforcement learning is that the agent always observes rewards. However, this is not true in many realistic settings, e.g., a human observer may not always be available to provide rewards, sensors may be limited or…

Machine Learning · Computer Science 2026-03-24 Alireza Kazemipour , Simone Parisi , Matthew E. Taylor , Michael Bowling

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

Machine Learning · Computer Science 2013-01-07 Christian R. Shelton

A major bottleneck in search-based program synthesis is the exponentially growing search space which makes learning large programs intractable. Humans mitigate this problem by leveraging the compositional nature of the real world: In…

Artificial Intelligence · Computer Science 2024-12-25 Jonas Witt , Sebastijan Dumančić , Tias Guns , Claus-Christian Carbon

This paper proposes an Adaptive Learning Model Predictive Control strategy for uncertain constrained linear systems performing iterative tasks. The additive uncertainty is modeled as the sum of a bounded process noise and an unknown…

Systems and Control · Computer Science 2018-04-27 Monimoy Bujarbaruah , Xiaojing Zhang , Ugo Rosolia , Francesco Borrelli

The use of machine learning to investigate grasp affordances has received extensive attention over the past several decades. The existing literature provides a robust basis to build upon, though a number of aspects may be improved. Results…

Robotics · Computer Science 2024-06-28 Michael Zechmair , Yannick Morel

Making sense of the world and acting in it relies on building simplified mental representations that abstract away aspects of reality. This principle of cognitive mapping is universal to agents with limited resources. Living organisms,…

Artificial Intelligence · Computer Science 2025-04-30 Marta Kryven , Cole Wyeth , Aidan Curtis , Kevin Ellis

Learning image representations using synthetic data allows training neural networks without some of the concerns associated with real images, such as privacy and bias. Existing work focuses on a handful of curated generative processes which…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Manel Baradad , Chun-Fu Chen , Jonas Wulff , Tongzhou Wang , Rogerio Feris , Antonio Torralba , Phillip Isola

Safety is still one of the major research challenges in reinforcement learning (RL). In this paper, we address the problem of how to avoid safety violations of RL agents during exploration in probabilistic and partially unknown…

Machine Learning · Computer Science 2022-12-06 Martin Tappler , Stefan Pranger , Bettina Könighofer , Edi Muškardin , Roderick Bloem , Kim Larsen

We present RLSS: a reinforcement learning algorithm for sequential scene generation. This is based on employing the proximal policy optimization (PPO) algorithm for generative problems. In particular, we consider how to effectively reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Azimkhon Ostonov , Peter Wonka , Dominik L. Michels

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

Artificial Intelligence · Computer Science 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

Pre-training Reinforcement Learning agents in a task-agnostic manner has shown promising results. However, previous works still struggle in learning and discovering meaningful skills in high-dimensional state-spaces, such as pixel-spaces.…

Artificial Intelligence · Computer Science 2021-07-20 Juan José Nieto , Roger Creus , Xavier Giro-i-Nieto

We develop an approach to estimate the probability that a program sampled from a large language model is correct. Given a natural language description of a programming problem, our method samples both candidate programs as well as candidate…

Software Engineering · Computer Science 2023-10-11 Darren Key , Wen-Ding Li , Kevin Ellis

Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To…

Machine Learning · Computer Science 2021-09-28 Valerie Chen , Abhinav Gupta , Kenneth Marino

Foundation models have revolutionized general-purpose problem-solving, offering rapid task adaptation through pretraining, meta-training, and finetuning. Recent crucial advances in these paradigms reveal the importance of challenging task…

Machine Learning · Computer Science 2025-10-21 Qi Wang , Zehao Xiao , Yixiu Mao , Yun Qu , Jiayi Shen , Yiqin Lv , Xiangyang Ji

Daily objects embedded in a contextual environment are often ungraspable initially. Whether it is a book sandwiched by other books on a fully packed bookshelf or a piece of paper lying flat on the desk, a series of nonprehensile pregrasp…

Robotics · Computer Science 2023-05-09 Sirui Chen , Albert Wu , C. Karen Liu

Capturing and labeling real-world 3D data is laborious and time-consuming, which makes it costly to train strong 3D models. To address this issue, recent works present a simple method by generating randomized 3D scenes without simulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

We propose an approach to synthesize linear feedback controllers for linear systems in polygonal environments. Our method focuses on designing a robust controller that can account for uncertainty in measurements. Its inputs are provided by…

Systems and Control · Electrical Eng. & Systems 2023-10-13 Mehdi Kermanshah , Calin Belta , Roberto Tron

Many approaches to program synthesis perform a search within an enormous space of programs to find one that satisfies a given specification. Prior works have used neural models to guide combinatorial search algorithms, but such approaches…

Machine Learning · Computer Science 2023-10-31 Kensen Shi , Hanjun Dai , Kevin Ellis , Charles Sutton

Typical models of learning assume incremental estimation of continuously-varying decision variables like expected rewards. However, this class of models fails to capture more idiosyncratic, discrete heuristics and strategies that people and…

Machine Learning · Computer Science 2024-02-27 Carlos G. Correa , Thomas L. Griffiths , Nathaniel D. Daw