English
Related papers

Related papers: GNFactor: Multi-Task Real Robot Learning with Gene…

200 papers

Generalized category discovery (GCD) is a highly popular task in open-world recognition, aiming to identify unknown class samples using known class data. By leveraging pre-training, meta-training, and fine-tuning, ViT achieves excellent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jiayi Su , Dequan Jin

The recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. However, longstanding drawbacks of these approaches, such as their poor sample…

Artificial Intelligence · Computer Science 2020-02-05 Thommen George Karimpanal

Manipulation tasks, like loading a dishwasher, can be seen as a sequence of spatial constraints and relationships between different objects. We aim to discover these rules from demonstrations by posing manipulation as a classification…

Robotics · Computer Science 2022-01-13 Yixin Lin , Austin S. Wang , Eric Undersander , Akshara Rai

While instance-level explanation of GNN is a well-studied problem with plenty of approaches being developed, providing a global explanation for the behaviour of a GNN is much less explored, despite its potential in interpretability and…

Machine Learning · Computer Science 2023-04-13 Steve Azzolin , Antonio Longa , Pietro Barbiero , Pietro Liò , Andrea Passerini

Diffusion-based policies have shown remarkable capability in executing complex robotic manipulation tasks but lack explicit characterization of geometry and semantics, which often limits their ability to generalize to unseen objects and…

Robotics · Computer Science 2024-10-24 Yixuan Wang , Guang Yin , Binghao Huang , Tarik Kelestemur , Jiuguang Wang , Yunzhu Li

In this paper, we propose a real-world benchmark for studying robotic learning in the context of functional manipulation: a robot needs to accomplish complex long-horizon behaviors by composing individual manipulation skills in functionally…

Robotics · Computer Science 2024-09-04 Jianlan Luo , Charles Xu , Fangchen Liu , Liam Tan , Zipeng Lin , Jeffrey Wu , Pieter Abbeel , Sergey Levine

Robotic manipulation in unstructured environments requires systems that can generalize across diverse tasks while maintaining robust and reliable performance. We introduce {GVF-TAPE}, a closed-loop framework that combines generative visual…

Robotics · Computer Science 2025-09-03 Chuye Zhang , Xiaoxiong Zhang , Wei Pan , Linfang Zheng , Wei Zhang

The ability to plan for multi-step manipulation tasks in unseen situations is crucial for future home robots. But collecting sufficient experience data for end-to-end learning is often infeasible in the real world, as deploying robots in…

Robotics · Computer Science 2022-05-18 Chen Wang , Danfei Xu , Li Fei-Fei

Learning-based methods have shown promising performance for accelerating motion planning, but mostly in the setting of static environments. For the more challenging problem of planning in dynamic environments, such as multi-arm assembly…

Robotics · Computer Science 2025-06-13 Ruipeng Zhang , Chenning Yu , Jingkai Chen , Chuchu Fan , Sicun Gao

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

Pre-training over mixtured multi-task, multi-domain, and multi-modal data remains an open challenge in vision perception pre-training. In this paper, we propose GPPF, a General Perception Pre-training Framework, that pre-trains a task-level…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Benyuan Sun , Jin Dai , Zihao Liang , Congying Liu , Yi Yang , Bo Bai

Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural…

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Robot learning holds tremendous promise to unlock the full potential of flexible, general, and dexterous robot systems, as well as to address some of the deepest questions in artificial intelligence. However, bringing robot learning to the…

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

Embodied AI represents a paradigm in AI research where artificial agents are situated within and interact with physical or virtual environments. Despite the recent progress in Embodied AI, it is still very challenging to learn the…

Robotics · Computer Science 2024-10-10 Xuetao Li , Fang Gao , Jun Yu , Shaodong Li , Feng Shuang

Existing RGB-based imitation learning approaches typically employ traditional vision encoders such as ResNet or ViT, which lack explicit 3D reasoning capabilities. Recent geometry-grounded vision models, such as VGGT~\cite{wang2025vggt},…

Robotics · Computer Science 2025-09-22 An Dinh Vuong , Minh Nhat Vu , Ian Reid

Generative based strategy has shown great potential in the Generalized Zero-Shot Learning task. However, it suffers severe generalization problem due to lacking of feature diversity for unseen classes to train a good classifier. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Bonan Li , Xuecheng Nie , Congying Han

The robotics field is evolving towards data-driven, end-to-end learning, inspired by multimodal large models. However, reliance on expensive real-world data limits progress. Simulators offer cost-effective alternatives, but the gap between…

Robotics · Computer Science 2025-12-23 Hongwei Fan , Hang Dai , Jiyao Zhang , Jinzhou Li , Qiyang Yan , Yujie Zhao , Mingju Gao , Jinghang Wu , Hao Tang , Hao Dong