English
Related papers

Related papers: Habits of Mind: Reusing Action Sequences for Effic…

200 papers

While modern biotechnologies allow synthesizing new proteins and function measurements at scale, efficiently exploring a protein sequence space and engineering it remains a daunting task due to the vast sequence space of any given protein.…

Biomolecules · Quantitative Biology 2024-01-15 Jiahao Qiu , Hui Yuan , Jinghong Zhang , Wentao Chen , Huazheng Wang , Mengdi Wang

Trajectory optimizers for model-based reinforcement learning, such as the Cross-Entropy Method (CEM), can yield compelling results even in high-dimensional control tasks and sparse-reward environments. However, their sampling inefficiency…

Recent advances in reasoning models have demonstrated significant improvements in accuracy by employing detailed and comprehensive reasoning processes. However, generating these lengthy reasoning sequences is computationally expensive and…

Computation and Language · Computer Science 2025-08-27 Yijiong Yu

Learning to perform activities through demonstration requires extracting meaningful information about the environment from observations. In this research, we investigate the challenge of planning high-level goal-oriented actions in a…

Machine Learning · Computer Science 2025-07-08 Jing Bi , Chenliang Xu

In unsupervised learning, an unbiased uniform sampling strategy is typically used, in order that the learned features faithfully encode the statistical structure of the training data. In this work, we explore whether active example…

Machine Learning · Computer Science 2015-04-01 Tomoki Tsuchida , Garrison W. Cottrell

The objective of this work is to augment the basic abilities of a robot by learning to use new sensorimotor primitives to enable the solution of complex long-horizon problems. Solving long-horizon problems in complex domains requires…

Robotics · Computer Science 2018-08-14 Zi Wang , Caelan Reed Garrett , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Tree ensembles are one of the most widely used model classes. However, these models are susceptible to adversarial examples, i.e., slightly perturbed examples that elicit a misprediction. There has been significant research on designing…

Machine Learning · Computer Science 2024-02-14 Lorenzo Cascioli , Laurens Devos , Ondřej Kuželka , Jesse Davis

Sequential decision problems are often approximately solvable by simulating possible future action sequences. {\em Metalevel} decision procedures have been developed for selecting {\em which} action sequences to simulate, based on…

Artificial Intelligence · Computer Science 2012-07-26 Nicholas Hay , Stuart Russell , David Tolpin , Solomon Eyal Shimony

The past two decades have seen a growing interest in combining causal information, commonly represented using causal graphs, with machine learning models. Probability trees provide a simple yet powerful alternative representation of causal…

Machine Learning · Computer Science 2022-05-18 Tue Herlau

Motion Planning is necessary for robots to complete different tasks. Rapidly-exploring Random Tree (RRT) and its variants have been widely used in robot motion planning due to their fast search in state space. However, they perform not well…

Robotics · Computer Science 2022-05-19 Zhirui Sun , Jiankun Wang , Max Q. -H. Meng

Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for…

Machine Learning · Statistics 2021-10-22 Louis Filstroff , Iiris Sundin , Petrus Mikkola , Aleksei Tiulpin , Juuso Kylmäoja , Samuel Kaski

A modern radar may be designed to perform multiple functions, such as surveillance, tracking, and fire control. Each function requires the radar to execute a number of transmit-receive tasks. A radar resource management (RRM) module makes…

Artificial Intelligence · Computer Science 2018-05-21 Mahdi Shaghaghi , Raviraj S. Adve , Zhen Ding

Action planning using learned and differentiable forward models of the world is a general approach which has a number of desirable properties, including improved sample complexity over model-free RL methods, reuse of learned models across…

Artificial Intelligence · Computer Science 2018-04-05 Mikael Henaff , William F. Whitney , Yann LeCun

Multi-mode resource and precedence-constrained project scheduling is a well-known challenging real-world optimisation problem. An important variant of the problem requires scheduling of activities for multiple projects considering…

Data Structures and Algorithms · Computer Science 2016-09-09 Shahriar Asta , Daniel Karapetyan , Ahmed Kheiri , Ender Özcan , Andrew J. Parkes

The difficulty of deterministic planning increases exponentially with search-tree depth. Black-box planning presents an even greater challenge, since planners must operate without an explicit model of the domain. Heuristics can make search…

Artificial Intelligence · Computer Science 2021-06-25 Cameron Allen , Michael Katz , Tim Klinger , George Konidaris , Matthew Riemer , Gerald Tesauro

To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations would be very useful…

Artificial Intelligence · Computer Science 2021-02-02 Saksham Consul , Lovis Heindrich , Jugoslav Stojcheski , Falk Lieder

Sequential decision problems are often approximately solvable by simulating possible future action sequences. Metalevel decision procedures have been developed for selecting which action sequences to simulate, based on estimating the…

Artificial Intelligence · Computer Science 2014-08-12 Nicholas Hay , Stuart Russell , David Tolpin , Solomon Eyal Shimony

Legged robots are able to navigate complex terrains by continuously interacting with the environment through careful selection of contact sequences and timings. However, the combinatorial nature behind contact planning hinders the…

Modern language models predict the next token in the sequence by considering the past text through a powerful function such as attention. However, language models have no explicit mechanism that allows them to spend computation time for…

Computation and Language · Computer Science 2024-09-04 Florian Mai , Nathan Cornille , Marie-Francine Moens

Retrieving target objects from unknown, confined spaces remains a challenging task that requires integrated, task-driven active sensing and rearrangement planning. Previous approaches have independently addressed active sensing and…

Robotics · Computer Science 2024-11-19 Junyong Kim , Hanwen Ren , Ahmed H. Qureshi