English
Related papers

Related papers: Learning Lifted Action Models from Unsupervised Vi…

200 papers

An accurate model of the environment and the dynamic agents acting in it offers great potential for improving motion planning. We present MILE: a Model-based Imitation LEarning approach to jointly learn a model of the world and a policy for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Anthony Hu , Gianluca Corrado , Nicolas Griffiths , Zak Murez , Corina Gurau , Hudson Yeo , Alex Kendall , Roberto Cipolla , Jamie Shotton

Existing planning action domain model acquisition approaches consider different types of state traces from which they learn. The differences in state traces refer to the level of observability of state changes (from full to none) and…

Artificial Intelligence · Computer Science 2025-03-10 Tomáš Balyo , Martin Suda , Lukáš Chrpa , Dominik Šafránek , Stephan Gocht , Filip Dvořák , Roman Barták , G. Michael Youngblood

Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yi Xin , Junlong Du , Qiang Wang , Ke Yan , Shouhong Ding

Contrastive Language-Image Pre-training (CLIP) model, as an effective pre-trained multimodal neural network, has been widely used in distributed machine learning tasks, especially Federated Learning (FL). Typically, CLIP-based FL adopts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Peiheng Zhou , Ming Hu , Xiaofei Xie , Yihao Huang , Kangjie Chen , Mingsong Chen

In this paper, we propose a new mixed-integer linear programming (MILP) model ontology and a novel constraint typology of MILP formulations. MILP is a commonly used mathematical programming technique for modelling and solving real-life…

Artificial Intelligence · Computer Science 2021-03-02 Bahadorreza Ofoghi , Vicky Mak , John Yearwood

Mixed Integer Linear Programming (MILP) is a fundamental class of NP-hard problems that has garnered significant attention from both academia and industry. The Branch-and-Bound (B\&B) method is the dominant approach for solving MILPs and…

Machine Learning · Computer Science 2025-11-27 Tongkai Lu , Shuai Ma , Chongyang Tao

The ability to infer pre- and postconditions of an action is vital for comprehending complex instructions, and is essential for applications such as autonomous instruction-guided agents and assistive AI that supports humans to perform…

Computation and Language · Computer Science 2024-07-04 Te-Lin Wu , Caiqi Zhang , Qingyuan Hu , Alex Spangher , Nanyun Peng

In this paper, we propose Skip-Plan, a condensed action space learning method for procedure planning in instructional videos. Current procedure planning methods all stick to the state-action pair prediction at every timestep and generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Zhiheng Li , Wenjia Geng , Muheng Li , Lei Chen , Yansong Tang , Jiwen Lu , Jie Zhou

Mixed-integer linear programming (MILP) has been a fundamental problem in combinatorial optimization. Conventional MILP solving mainly relies on carefully designed heuristics embedded in the branch-and-bound framework. Driven by the strong…

Artificial Intelligence · Computer Science 2026-01-13 Siyuan Li , Yifan Yu , Zhihao Zhang , Mengjing Chen , Fangzhou Zhu , Tao Zhong , Peng Liu , Jianye Hao

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes.…

Machine Learning · Computer Science 2020-01-01 Karl Schmeckpeper , Annie Xie , Oleh Rybkin , Stephen Tian , Kostas Daniilidis , Sergey Levine , Chelsea Finn

The problem of specifying high-level knowledge bases for planning becomes a hard task in realistic environments. This knowledge is usually handcrafted and is hard to keep updated, even for system experts. Recent approaches have shown the…

Artificial Intelligence · Computer Science 2021-03-08 Alejandro Suárez-Hernández , Javier Segovia-Aguas , Carme Torras , Guillem Alenyà

Mixed-integer linear programs (MILPs) are extensively used to model practical problems such as planning and scheduling. A prominent method for solving MILPs is large neighborhood search (LNS), which iteratively seeks improved solutions…

Optimization and Control · Mathematics 2024-12-12 Wenbo Liu , Akang Wang , Wenguo Yang , Qingjiang Shi

We introduce Latent Action Pretraining for general Action models (LAPA), an unsupervised method for pretraining Vision-Language-Action (VLA) models without ground-truth robot action labels. Existing Vision-Language-Action models require…

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the…

Robotics · Computer Science 2025-10-28 Amirreza Razmjoo , Sylvain Calinon , Michael Gienger , Fan Zhang

In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is…

Robotics · Computer Science 2019-04-16 Chen Liang , Weihong Wang , Zhenghua Liu , Chao Lai , Benchun Zhou

Mixed-Integer Linear Programming (MILP) is a fundamental and powerful framework for modeling complex optimization problems across diverse domains. Recently, learning-based methods have shown great promise in accelerating MILP solvers by…

Machine Learning · Computer Science 2025-11-05 Tianle Pu , Zijie Geng , Haoyang Liu , Shixuan Liu , Jie Wang , Li Zeng , Chao Chen , Changjun Fan

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

Compounding error, where small prediction mistakes accumulate over time, presents a major challenge in learning-based control. For example, this issue often limits the performance of model-based reinforcement learning and imitation…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Anne Somalwar , Bruce D. Lee , George J. Pappas , Nikolai Matni

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

Machine Learning · Computer Science 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao