English
Related papers

Related papers: Goal State Generation for Robotic Manipulation Bas…

200 papers

This paper addresses the problem of distributed coordination control for multi-robot systems (MRSs) in the presence of localization uncertainty using a Linear Quadratic Gaussian (LQG) approach. We introduce a stochastic LQG control strategy…

Systems and Control · Electrical Eng. & Systems 2025-04-07 Tohid Kargar Tasooji , Sakineh Khodadadi

Legibility of robot motion is critical in human-robot interaction, as it allows humans to quickly infer a robot's intended goal. Although traditional trajectory generation methods typically prioritize efficiency, they often fail to make the…

Robotics · Computer Science 2025-10-15 Wenli Shi , Clemence Grislain , Olivier Sigaud , Mohamed Chetouani

Generalizable manipulation involving cross-type object interactions is a critical yet challenging capability in robotics. To reliably accomplish such tasks, robots must address two fundamental challenges: "where to manipulate" (contact…

Robotics · Computer Science 2026-05-13 Zhenhao Shen , Zeming Yang , Yue Chen , Yuran Wang , Shengqiang Xu , Mingleyang Li , Hao Dong , Ruihai Wu

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal consistency remains a challenge. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yifei Zeng , Yanqin Jiang , Siyu Zhu , Yuanxun Lu , Youtian Lin , Hao Zhu , Weiming Hu , Xun Cao , Yao Yao

Recent advances in diffusion models have opened new avenues for research into embodied AI agents and robotics. Despite significant achievements in complex robotic locomotion and skills, mobile manipulation-a capability that requires the…

Robotics · Computer Science 2025-04-03 Sixu Yan , Zeyu Zhang , Muzhi Han , Zaijin Wang , Qi Xie , Zhitian Li , Zhehan Li , Hangxin Liu , Xinggang Wang , Song-Chun Zhu

3D Gaussian Splatting offers expressive scene reconstruction, modeling a broad range of visual, geometric, and semantic information. However, efficient real-time map reconstruction with data streamed from multiple robots and devices remains…

Robotics · Computer Science 2025-06-04 Javier Yu , Timothy Chen , Mac Schwager

Object recognition, commonly performed by a camera, is a fundamental requirement for robots to complete complex tasks. Some tasks require recognizing objects far from the robot's camera. A challenging example is Ultra-Range Gesture…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Eran Bamani , Eden Nissinman , Lisa Koenigsberg , Inbar Meir , Avishai Sintov

Dexterous manipulation, particularly adept coordinating and grasping, constitutes a fundamental and indispensable capability for robots, facilitating the emulation of human-like behaviors. Integrating this capability into robots empowers…

Robotics · Computer Science 2024-04-04 Apan Dastider , Hao Fang , Mingjie Lin

Multi-step manipulation tasks in unstructured environments are extremely challenging for a robot to learn. Such tasks interlace high-level reasoning that consists of the expected states that can be attained to achieve an overall task and…

Robotics · Computer Science 2021-11-22 Sulabh Kumra , Shirin Josh , Ferat Sahin

Path planning for a robotic system in high-dimensional cluttered environments needs to be efficient, safe, and adaptable for different environments and hardware. Conventional methods face high computation time and require extensive…

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Salient object detection (SOD) requires modeling both long-range contextual dependencies and fine-grained structural details, which remains challenging for convolutional, transformer-based, and Mamba-based state space models. While recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Suklav Ghosh , Arijit Sur , Pinaki Mitra

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

Video grounding aims to localize the target moment in an untrimmed video corresponding to a given sentence query. Existing methods typically select the best prediction from a set of predefined proposals or directly regress the target span…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Xiao Liang , Tao Shi , Yaoyuan Liang , Te Tao , Shao-Lun Huang

World-model-based imagine-then-act becomes a promising paradigm for robotic manipulation, yet existing approaches typically support either purely image-based forecasting or reasoning over partial 3D geometry, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jiaxu Wang , Yicheng Jiang , Tianlun He , Jingkai Sun , Qiang Zhang , Junhao He , Jiahang Cao , Zesen Gan , Mingyuan Sun , Qiming Shao , Xiangyu Yue

How can we reconstruct 3D hand poses when large portions of the hand are heavily occluded by itself or by objects? Humans often resolve such ambiguities by leveraging contextual knowledge -- such as affordances, where an object's shape and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Naru Suzuki , Takehiko Ohkawa , Tatsuro Banno , Jihyun Lee , Ryosuke Furuta , Yoichi Sato

Mesh generation is of great value in various applications involving computer graphics and virtual content, yet designing generative models for meshes is challenging due to their irregular data structure and inconsistent topology of meshes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Zhaoyang Lyu , Jinyi Wang , Yuwei An , Ya Zhang , Dahua Lin , Bo Dai

Generating articulated assets is crucial for robotics, digital twins, and embodied intelligence. Existing generative models often rely on single-view inputs representing closed states, resulting in ambiguous or unrealistic kinematic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haowen Wang , Xiaoping Yuan , Fugang Zhang , Rui Jian , Yuanwei Zhu , Xiuquan Qiao , Yakun Huang

Articulated object generation has seen increasing advancements, yet existing models often lack the ability to be conditioned on text prompts. To address the significant gap between textual descriptions and 3D articulated object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hao Sun , Lei Fan , Donglin Di , Shaohui Liu

Can we train a 3D molecule generator using data from dense regions to generate samples in sparse regions? This challenge can be framed as an out-of-distribution (OOD) generation problem. While prior research on OOD generation predominantly…

Machine Learning · Computer Science 2026-03-03 Haokai Hong , Wanyu Lin , Ming Yang , Kay Chen Tan