English
Related papers

Related papers: GeCo-SRT: Geometry-aware Continual Adaptation for …

200 papers

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph Transformers (GTs)…

Machine Learning · Computer Science 2024-06-19 Kaan Sancak , Zhigang Hua , Jin Fang , Yan Xie , Andrey Malevich , Bo Long , Muhammed Fatih Balin , Ümit V. Çatalyürek

Simulation parameter settings such as contact models and object geometry approximations are critical to training robust robotic policies capable of transferring from simulation to real-world deployment. Previous approaches typically…

Robotics · Computer Science 2023-10-03 Allen Z. Ren , Hongkai Dai , Benjamin Burchfiel , Anirudha Majumdar

Recent advancements of image captioning have featured Visual-Semantic Fusion or Geometry-Aid attention refinement. However, those fusion-based models, they are still criticized for the lack of geometry information for inter and intra…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Ling Cheng , Wei Wei , Feida Zhu , Yong Liu , Chunyan Miao

We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of diverse policies that…

Machine Learning · Computer Science 2018-11-15 Ryan Julian , Eric Heiden , Zhanpeng He , Hejia Zhang , Stefan Schaal , Joseph J. Lim , Gaurav Sukhatme , Karol Hausman

Zero-shot sim-to-real transfer of tasks with complex dynamics is a highly challenging and unsolved problem. A number of solutions have been proposed in recent years, but we have found that many works do not present a thorough evaluation in…

Robotics · Computer Science 2020-08-18 Eugene Valassakis , Zihan Ding , Edward Johns

Standard evaluation protocols in robotic manipulation typically assess policy performance over curated, in-distribution test sets, offering limited insight into how systems fail under plausible variation. We introduce Geometric Red-Teaming…

Robotics · Computer Science 2025-09-17 Divyam Goel , Yufei Wang , Tiancheng Wu , Guixiu Qiao , Pavel Piliptchak , David Held , Zackory Erickson

In recent years, molecular representation learning has emerged as a key area of focus in various chemical tasks. However, many existing models fail to fully consider the geometric information of molecular structures, resulting in less…

Machine Learning · Computer Science 2023-06-29 Bumju Kwak , Jiwon Park , Taewon Kang , Jeonghee Jo , Byunghan Lee , Sungroh Yoon

A fundamental challenge in deep metric learning is the generalization capability of the feature embedding network model since the embedding network learned on training classes need to be evaluated on new test classes. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Shichao Kan , Yixiong Liang , Min Li , Yigang Cen , Jianxin Wang , Zhihai He

The accuracy of large language models (LLMs) improves with increasing model size, but increasing model complexity also poses significant challenges to training stability. Periodic checkpointing is a key mechanism for fault recovery and is…

Operating Systems · Computer Science 2025-11-11 Keyao Zhang , Yiquan Chen , Zhuo Hu , Wenhai Lin , Jiexiong Xu , Wenzhi Chen

Tactile sensing is an important sensing modality for robot manipulation. Among different types of tactile sensors, magnet-based sensors, like u-skin, balance well between high durability and tactile density. However, the large sim-to-real…

Robotics · Computer Science 2025-05-07 Beining Han , Abhishek Joshi , Jia Deng

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Human-robot teaming (HRT) systems often rely on large-scale datasets of human and robot interactions, especially for close-proximity collaboration tasks such as human-robot handovers. Learning robot manipulation policies from raw,…

Robotics · Computer Science 2025-08-14 Yuekun Wu , Yik Lung Pang , Andrea Cavallaro , Changjae Oh

Continuum robots possess high flexibility and redundancy, making them well suited for safe interaction in complex environments, yet their continuous deformation and nonlinear dynamics pose fundamental challenges to perception, modeling, and…

Robotics · Computer Science 2026-03-03 Peng Yu , Xin Wang , Ning Tan

Simulation based learning often provides a cost-efficient recourse to reinforcement learning applications in robotics. However, simulators are generally incapable of accurately replicating real-world dynamics, and thus bridging the sim2real…

Machine Learning · Computer Science 2023-02-09 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

Scalable sensor simulation is an important yet challenging open problem for safety-critical domains such as self-driving. Current works in image simulation either fail to be photorealistic or do not model the 3D environment and the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yun Chen , Frieda Rong , Shivam Duggal , Shenlong Wang , Xinchen Yan , Sivabalan Manivasagam , Shangjie Xue , Ersin Yumer , Raquel Urtasun

Existing RGB-based imitation learning approaches typically employ traditional vision encoders such as ResNet or ViT, which lack explicit 3D reasoning capabilities. Recent geometry-grounded vision models, such as VGGT~\cite{wang2025vggt},…

Robotics · Computer Science 2025-09-22 An Dinh Vuong , Minh Nhat Vu , Ian Reid

Knowledge graph representation learning approaches provide a mapping between symbolic knowledge in the form of triples in a knowledge graph (KG) and their feature vectors. Knowledge graph embedding (KGE) models often represent relations in…

Machine Learning · Computer Science 2025-07-18 Kossi Amouzouvi , Bowen Song , Andrea Coletta , Luigi Bellomarini , Jens Lehmann , Sahar Vahdati

By driving models to converge to flat minima, sharpness-aware learning algorithms (such as SAM) have shown the power to achieve state-of-the-art performances. However, these algorithms will generally incur one extra forward-backward…

Machine Learning · Computer Science 2023-04-11 Yang Zhao , Hao Zhang , Xiuyuan Hu

Predictive world models that simulate future observations under explicit camera control are fundamental to interactive AI. Despite rapid advances, current systems lack spatial persistence: they fail to maintain stable scene structures over…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chendong Xiang , Jiajun Liu , Jintao Zhang , Xiao Yang , Zhengwei Fang , Shizun Wang , Zijun Wang , Yingtian Zou , Hang Su , Jun Zhu

Continuum robots with floating bases demonstrate exceptional operational capabilities in confined spaces, such as those encountered in medical surgeries and equipment maintenance. However, developing low-cost solutions for their motion and…

Robotics · Computer Science 2025-03-20 Congjun Ma , Quan Xiao , Liangcheng Liu , Xingxing You , Songyi Dian