English
Related papers

Related papers: STAR: Learning Diverse Robot Skill Abstractions th…

200 papers

Large language models exhibit strong reasoning capabilities, yet often rely on shortcuts such as surface pattern matching and answer memorization rather than genuine logical inference. We propose Shortcut-Aware Reasoning Training (SART), a…

Computation and Language · Computer Science 2026-03-24 Hongyu Cao , Kunpeng Liu , Dongjie Wang , Yanjie Fu

A desirable property of autonomous agents is the ability to both solve long-horizon problems and generalize to unseen tasks. Recent advances in data-driven skill learning have shown that extracting behavioral priors from offline data can…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Ruihan Zhao , Albert Zhan , Pieter Abbeel , Michael Laskin

Vector Quantized Variational AutoEncoders (VQ-VAEs) are designed to compress a continuous input to a discrete latent space and reconstruct it with minimal distortion. They operate by maintaining a set of vectors -- often referred to as the…

We propose an algorithm for rotational sparse coding along with an efficient implementation using steerability. Sparse coding (also called dictionary learning) is an important technique in image processing, useful in inverse problems,…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Michael T. McCann , Vincent Andrearczyk , Michael Unser , Adrien Depeursinge

Self-supervision has emerged as a propitious method for visual representation learning after the recent paradigm shift from handcrafted pretext tasks to instance-similarity based approaches. Most state-of-the-art methods enforce similarity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Sravanti Addepalli , Kaushal Bhogale , Priyam Dey , R. Venkatesh Babu

Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning…

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity. Existing reasoning…

Computation and Language · Computer Science 2025-05-28 Yong Wu , Weihang Pan , Ke Li , Chen Binhui , Ping Li , Binbin Lin

We address the problem of safely solving complex bimanual robot manipulation tasks with sparse rewards. Such challenging tasks can be decomposed into sub-tasks that are accomplishable by different robots concurrently or sequentially for…

Machine Learning · Computer Science 2021-10-07 Minghao Zhang , Pingcheng Jian , Yi Wu , Huazhe Xu , Xiaolong Wang

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

Machine Learning · Computer Science 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

For high spatial resolution (HSR) remote sensing images, bitemporal supervised learning always dominates change detection using many pairwise labeled bitemporal images. However, it is very expensive and time-consuming to pairwise label…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Zhuo Zheng , Ailong Ma , Liangpei Zhang , Yanfei Zhong

Reinforcement learning (RL) methods with a high replay ratio (RR) and regularization have gained interest due to their superior sample efficiency. However, these methods have mainly been developed for dense-reward tasks. In this paper, we…

Machine Learning · Computer Science 2023-12-12 Takuya Hiraoka

Quality-Diversity (QD) algorithms are powerful exploration algorithms that allow robots to discover large repertoires of diverse and high-performing skills. However, QD algorithms are sample inefficient and require millions of evaluations.…

Machine Learning · Computer Science 2022-07-21 Bryan Lim , Luca Grillotti , Lorenzo Bernasconi , Antoine Cully

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo

Most reinforcement learning (RL) methods focus on learning optimal policies over low-level action spaces. While these methods can perform well in their training environments, they lack the flexibility to transfer to new tasks. Instead, RL…

Robotics · Computer Science 2024-09-20 Jesse Zhang , Minho Heo , Zuxin Liu , Erdem Biyik , Joseph J Lim , Yao Liu , Rasool Fakoor

Vision-Language-Action (VLA) models have demonstrated impressive capabilities in generalized robotic control; however, they remain notoriously brittle to linguistic perturbations. We identify a critical ``modality collapse'' phenomenon…

Robotics · Computer Science 2026-04-21 Zhihao Zhan , Yuhao Chen , Jiaying Zhou , Qinhan Lyu , Hao Liu , Keze Wang , Liang Lin , Guangrun Wang

As robots are expected to perform increasingly diverse tasks, they must understand not only low-level actions but also the higher-level structure that determines how a task should unfold. Existing vision-language-action (VLA) models…

Robotics · Computer Science 2026-02-10 Jingyi Hou , Leyu Zhou , Chenchen Jing , Jinghan Yang , Xinbo Yu , Wei He

Long-horizon tasks in robotic manipulation present significant challenges in reinforcement learning (RL) due to the difficulty of designing dense reward functions and effectively exploring the expansive state-action space. However, despite…

Machine Learning · Computer Science 2025-10-06 Adrià López Escoriza , Nicklas Hansen , Stone Tao , Tongzhou Mu , Hao Su

The success of autoregressive models largely depends on the effectiveness of vector quantization, a technique that discretizes continuous features by mapping them to the nearest code vectors within a learnable codebook. Two critical issues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Xianghong Fang , Litao Guo , Hengchao Chen , Yuxuan Zhang , XiaofanXia , Dingjie Song , Yexin Liu , Hao Wang , Harry Yang , Yuan Yuan , Qiang Sun

Vision-based reinforcement learning (RL) is a promising technique to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-09-29 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel