English
Related papers

Related papers: Adaptformer: Sequence models as adaptive iterative…

200 papers

Strategic classification studies the problem where self-interested individuals or agents manipulate their response to obtain favorable decision outcomes made by classifiers, typically turning to dishonest actions when they are less costly…

Machine Learning · Computer Science 2026-05-07 Ziyuan Huang , Lina Alkarmi , Mingyan Liu

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

Machine Learning · Computer Science 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Enabling robots to solve multiple manipulation tasks has a wide range of industrial applications. While learning-based approaches enjoy flexibility and generalizability, scaling these approaches to solve such compositional tasks remains a…

Machine Learning · Computer Science 2021-09-17 Michael H. Lim , Andy Zeng , Brian Ichter , Maryam Bandari , Erwin Coumans , Claire Tomlin , Stefan Schaal , Aleksandra Faust

Robot task planning is an important problem for autonomous robots in long-horizon challenging tasks. As large pre-trained models have demonstrated superior planning ability, recent research investigates utilizing large models to achieve…

Robotics · Computer Science 2024-11-12 Siyuan Li , Zhe Ma , Feifan Liu , Jiani Lu , Qinqin Xiao , Kewu Sun , Lingfei Cui , Xirui Yang , Peng Liu , Xun Wang

In many real-world applications, modeling both the internal structure of sets and their temporal relationships is essential for capturing complex underlying patterns. Sequential multiple-instance learning aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

Machine Learning · Computer Science 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

Transformers have achieved remarkable success in sequence modeling and beyond but suffer from quadratic computational and memory complexities with respect to the length of the input sequence. Leveraging techniques include sparse and linear…

Machine Learning · Computer Science 2022-08-02 Tan Nguyen , Richard G. Baraniuk , Robert M. Kirby , Stanley J. Osher , Bao Wang

Vision Transformers have shown great performance in single tasks such as classification and segmentation. However, real-world problems are not isolated, which calls for vision transformers that can perform multiple tasks concurrently.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Liu , Shen Yan , Yuge Zhang , Kan Ren , Quanlu Zhang , Zebin Ren , Deng Cai , Mi Zhang

Robust and flexible leader-following is a critical capability for robots to integrate into human society. While existing methods struggle to generalize to leaders of arbitrary form and often fail when the leader temporarily leaves the…

Robotics · Computer Science 2026-05-29 Qianyi Zhang , Shijian Ma , Boyi Liu , Jianhao Jiao , Dimitrios Kanoulas

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…

Customizing robotic behaviors to be aligned with diverse human preferences is an underexplored challenge in the field of embodied AI. In this paper, we present Promptable Behaviors, a novel framework that facilitates efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Minyoung Hwang , Luca Weihs , Chanwoo Park , Kimin Lee , Aniruddha Kembhavi , Kiana Ehsani

Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Elmira Amirloo , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

Assistive teleoperation enhances efficiency via shared control, yet inter-operator variability, stemming from diverse habits and expertise, induces highly heterogeneous trajectory distributions that undermine intent recognition stability.…

Robotics · Computer Science 2026-04-13 Yu Liu , Yihang Yin , Tianlv Huang , Fei Yan , Yuan Xu , Weinan Hong , Wei Han , Yue Cao , Xiangyu Chen , Zipei Fan , Xuan Song

In this work, we introduce MO-SeGMan, a Multi-Objective Sequential and Guided Manipulation planner for highly constrained rearrangement problems. MO-SeGMan generates object placement sequences that minimize both replanning per object and…

Robotics · Computer Science 2025-11-04 Cankut Bora Tuncer , Marc Toussaint , Ozgur S. Oguz

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Planning is a crucial element of both human intelligence and contemporary large language models (LLMs). In this paper, we initiate a theoretical investigation into the emergence of planning capabilities in Transformer-based LLMs via their…

Machine Learning · Computer Science 2024-11-12 Siwei Wang , Yifei Shen , Shi Feng , Haoran Sun , Shang-Hua Teng , Wei Chen

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Learning to perform activities through demonstration requires extracting meaningful information about the environment from observations. In this research, we investigate the challenge of planning high-level goal-oriented actions in a…

Machine Learning · Computer Science 2025-07-08 Jing Bi , Chenliang Xu

While Transformers have enabled tremendous progress in various application settings, such architectures still trail behind traditional symbolic planners for solving complex decision making tasks. In this work, we demonstrate how to train…

Artificial Intelligence · Computer Science 2024-04-30 Lucas Lehnert , Sainbayar Sukhbaatar , DiJia Su , Qinqing Zheng , Paul Mcvay , Michael Rabbat , Yuandong Tian

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani