中文
相关论文

相关论文: GNFactor: Multi-Task Real Robot Learning with Gene…

200 篇论文

Generalized category discovery (GCD) is a highly popular task in open-world recognition, aiming to identify unknown class samples using known class data. By leveraging pre-training, meta-training, and fine-tuning, ViT achieves excellent…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Jiayi Su , Dequan Jin

The recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. However, longstanding drawbacks of these approaches, such as their poor sample…

人工智能 · 计算机科学 2020-02-05 Thommen George Karimpanal

Manipulation tasks, like loading a dishwasher, can be seen as a sequence of spatial constraints and relationships between different objects. We aim to discover these rules from demonstrations by posing manipulation as a classification…

机器人学 · 计算机科学 2022-01-13 Yixin Lin , Austin S. Wang , Eric Undersander , Akshara Rai

While instance-level explanation of GNN is a well-studied problem with plenty of approaches being developed, providing a global explanation for the behaviour of a GNN is much less explored, despite its potential in interpretability and…

机器学习 · 计算机科学 2023-04-13 Steve Azzolin , Antonio Longa , Pietro Barbiero , Pietro Liò , Andrea Passerini

Diffusion-based policies have shown remarkable capability in executing complex robotic manipulation tasks but lack explicit characterization of geometry and semantics, which often limits their ability to generalize to unseen objects and…

机器人学 · 计算机科学 2024-10-24 Yixuan Wang , Guang Yin , Binghao Huang , Tarik Kelestemur , Jiuguang Wang , Yunzhu Li

In this paper, we propose a real-world benchmark for studying robotic learning in the context of functional manipulation: a robot needs to accomplish complex long-horizon behaviors by composing individual manipulation skills in functionally…

机器人学 · 计算机科学 2024-09-04 Jianlan Luo , Charles Xu , Fangchen Liu , Liam Tan , Zipeng Lin , Jeffrey Wu , Pieter Abbeel , Sergey Levine

Robotic manipulation in unstructured environments requires systems that can generalize across diverse tasks while maintaining robust and reliable performance. We introduce {GVF-TAPE}, a closed-loop framework that combines generative visual…

机器人学 · 计算机科学 2025-09-03 Chuye Zhang , Xiaoxiong Zhang , Wei Pan , Linfang Zheng , Wei Zhang

The ability to plan for multi-step manipulation tasks in unseen situations is crucial for future home robots. But collecting sufficient experience data for end-to-end learning is often infeasible in the real world, as deploying robots in…

机器人学 · 计算机科学 2022-05-18 Chen Wang , Danfei Xu , Li Fei-Fei

Learning-based methods have shown promising performance for accelerating motion planning, but mostly in the setting of static environments. For the more challenging problem of planning in dynamic environments, such as multi-arm assembly…

机器人学 · 计算机科学 2025-06-13 Ruipeng Zhang , Chenning Yu , Jingkai Chen , Chuchu Fan , Sicun Gao

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

机器人学 · 计算机科学 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

Pre-training over mixtured multi-task, multi-domain, and multi-modal data remains an open challenge in vision perception pre-training. In this paper, we propose GPPF, a General Perception Pre-training Framework, that pre-trains a task-level…

计算机视觉与模式识别 · 计算机科学 2022-08-05 Benyuan Sun , Jin Dai , Zihao Liang , Congying Liu , Yi Yang , Bo Bai

Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural…

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

机器学习 · 计算机科学 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Robot learning holds tremendous promise to unlock the full potential of flexible, general, and dexterous robot systems, as well as to address some of the deepest questions in artificial intelligence. However, bringing robot learning to the…

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

计算机视觉与模式识别 · 计算机科学 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

Embodied AI represents a paradigm in AI research where artificial agents are situated within and interact with physical or virtual environments. Despite the recent progress in Embodied AI, it is still very challenging to learn the…

机器人学 · 计算机科学 2024-10-10 Xuetao Li , Fang Gao , Jun Yu , Shaodong Li , Feng Shuang

Existing RGB-based imitation learning approaches typically employ traditional vision encoders such as ResNet or ViT, which lack explicit 3D reasoning capabilities. Recent geometry-grounded vision models, such as VGGT~\cite{wang2025vggt},…

机器人学 · 计算机科学 2025-09-22 An Dinh Vuong , Minh Nhat Vu , Ian Reid

Generative based strategy has shown great potential in the Generalized Zero-Shot Learning task. However, it suffers severe generalization problem due to lacking of feature diversity for unseen classes to train a good classifier. In this…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Bonan Li , Xuecheng Nie , Congying Han

The robotics field is evolving towards data-driven, end-to-end learning, inspired by multimodal large models. However, reliance on expensive real-world data limits progress. Simulators offer cost-effective alternatives, but the gap between…

机器人学 · 计算机科学 2025-12-23 Hongwei Fan , Hang Dai , Jiyao Zhang , Jinzhou Li , Qiyang Yan , Yujie Zhao , Mingju Gao , Jinghang Wu , Hao Tang , Hao Dong