English
Related papers

Related papers: Zero-Shot Robotic Manipulation via 3D Gaussian Spl…

200 papers

We present a method for zero-shot recommendation of multimodal non-stationary content that leverages recent advancements in the field of generative AI. We propose rendering inputs of different modalities as textual descriptions and to…

Artificial Intelligence · Computer Science 2023-10-03 Rachel M. Harrison , Anton Dereventsov , Anton Bibin

Achieving real-time Simultaneous Localization and Mapping (SLAM) based on 3D Gaussian splatting (3DGS) in large-scale real-world environments remains challenging, as existing methods still struggle to jointly achieve low-latency pose…

Ensuring cultural values alignment in Large Language Models (LLMs) remains a critical challenge, as these models often embed Western-centric biases from their training data, leading to misrepresentations and fairness concerns in…

Computation and Language · Computer Science 2025-05-09 Wonduk Seo , Zonghao Yuan , Yi Bu

Reconstructing dynamic scenes with multiple interacting humans and objects from sparse-view inputs is a critical yet challenging task, essential for creating high-fidelity digital twins for robotics and VR/AR. This problem, which we term…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Weiquan Wang , Jun Xiao , Feifei Shao , Yi Yang , Yueting Zhuang , Long Chen

While Retrieval-Augmented Generation (RAG) has been swiftly adopted in scientific and clinical QA systems, a comprehensive evaluation benchmark in the medical domain is lacking. To address this gap, we introduce the Medical…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

Robots are increasingly envisioned to interact in real-world scenarios, where they must continuously adapt to new situations. To detect and grasp novel objects, zero-shot pose estimators determine poses without prior knowledge. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Tessa Pulli , Stefan Thalhammer , Simon Schwaiger , Markus Vincze

User-friendly 3D object editing is a challenging task that has attracted significant attention recently. The limitations of direct 3D object editing without 2D prior knowledge have prompted increased attention towards utilizing 2D…

Graphics · Computer Science 2024-05-10 Sitian Shen , Jing Xu , Yuheng Yuan , Xingyi Yang , Qiuhong Shen , Xinchao Wang

Coordinating a team of robots to reposition multiple objects in cluttered environments requires reasoning jointly about where robots should establish contact, how to manipulate objects once contact is made, and how to navigate safely and…

Recent advances in time series foundation models (TSFMs) demonstrate strong expressive capacity through large-scale pretraining across diverse time series domains. Zero-shot time series forecasting with TSFMs, however, exhibits limited…

Machine Learning · Computer Science 2026-03-17 Seunghan Lee , Jaehoon Lee , Jun Seo , Sungdong Yoo , Minjae Kim , Tae Yoon Lim , Dongwan Kang , Hwanil Choi , SoonYoung Lee , Wonbin Ahn

Enhancing the generalization capability of robotic learning to enable robots to operate effectively in diverse, unseen scenes is a fundamental and challenging problem. Existing approaches often depend on pretraining with large-scale data…

Robotics · Computer Science 2026-02-17 Xinhua Wang , Kun Wu , Zhen Zhao , Hu Cao , Yinuo Zhao , Zhiyuan Xu , Meng Li , Shichao Fan , Di Wu , Yixue Zhang , Ning Liu , Zhengping Che , Jian Tang

Understanding object affordances is essential for enabling robots to perform purposeful and fine-grained interactions in diverse and unstructured environments. However, existing approaches either rely on retrieval, which is fragile due to…

Robotics · Computer Science 2026-04-01 Qiyuan Zhuang , He-Yang Xu , Yijun Wang , Xin-Yang Zhao , Yang-Yang Li , Xiu-Shen Wei

Achieving zero-shot peg insertion, where inserting an arbitrary peg into an unseen hole without task-specific training, remains a fundamental challenge in robotics. This task demands a highly generalizable perception system capable of…

Robotics · Computer Science 2025-03-11 Masaru Yajima , Kei Ota , Asako Kanezaki , Rei Kawakami

Neural 3D representations such as Neural Radiance Fields (NeRF), excel at producing photo-realistic rendering results but lack the flexibility for manipulation and editing which is crucial for content creation. Previous works have attempted…

Graphics · Computer Science 2025-03-25 Xiangjun Gao , Xiaoyu Li , Yiyu Zhuang , Qi Zhang , Wenbo Hu , Chaopeng Zhang , Yao Yao , Ying Shan , Long Quan

Large Language Models (LLMs) have demonstrated impressive capabilities in answering questions, but they lack domain-specific knowledge and are prone to hallucinations. Retrieval Augmented Generation (RAG) is one approach to address these…

Computation and Language · Computer Science 2024-10-30 Monica Riedler , Stefan Langer

Learning robust and generalizable manipulation skills from demonstrations remains a key challenge in robotics, with broad applications in industrial automation and service robotics. While recent imitation learning methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yu Ren , Yang Cong , Ronghan Chen , Jiahao Long

Scenes reconstructed by 3D Gaussian Splatting (3DGS) trained on low-resolution (LR) images are unsuitable for high-resolution (HR) rendering. Consequently, a 3DGS super-resolution (SR) method is needed to bridge LR inputs and HR rendering.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kaizhe Zhang , Shinan Chen , Qian Zhao , Weizhan Zhang , Caixia Yan , Yudeng Xin

Retrieval Augmented Generation (RAG) has become the standard approach for equipping Large Language Models (LLMs) with up-to-date knowledge. However, standard RAG, relying on independent passage retrieval, often fails to capture the…

Computation and Language · Computer Science 2025-11-20 Jingjin Wang , Jiawei Han

Single-image 3D generation with part-level structure remains challenging: learned priors struggle to cover the long tail of part geometries and maintain multi-view consistency, and existing systems provide limited support for precise,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Peize Li , Zeyu Zhang , Hao Tang

Generating realistic full-body motion interacting with objects is critical for applications in robotics, virtual reality, and human-computer interaction. While existing methods can generate full-body motion within 3D scenes, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kunal Bhosikar , Siddharth Katageri , Vivek Madhavaram , Kai Han , Charu Sharma

Partial-view 3D recognition -- reconstructing 3D geometry and identifying object instances from a few sparse RGB images -- is an exceptionally challenging yet practically essential task, particularly in cluttered, occluded real-world…

Robotics · Computer Science 2025-07-09 Young Hun Kim , Seungyeon Kim , Yonghyeon Lee , Frank Chongwoo Park