English
Related papers

Related papers: GRASPLAT: Enabling dexterous grasping through nove…

200 papers

Grasping in cluttered scenes remains highly challenging for dexterous hands due to the scarcity of data. To address this problem, we present a large-scale synthetic benchmark, encompassing 1319 objects, 8270 scenes, and 427 million grasps.…

Robotics · Computer Science 2024-10-31 Jialiang Zhang , Haoran Liu , Danshi Li , Xinqiang Yu , Haoran Geng , Yufei Ding , Jiayi Chen , He Wang

Computer vision technologies markedly enhance the automation capabilities of robotic-assisted minimally invasive surgery (RAMIS) through advanced tool tracking, detection, and localization. However, the limited availability of comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Tianle Zeng , Gerardo Loza Galindo , Junlei Hu , Pietro Valdastri , Dominic Jones

Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep-learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the…

Robotic grasping is a fundamental capability for autonomous manipulation, yet remains highly challenging in cluttered environments where occlusion, poor perception quality, and inconsistent 3D reconstructions often lead to unstable or…

Robotics · Computer Science 2025-11-07 Shenglin Wang , Mingtong Dai , Jingxuan Su , Lingbo Liu , Chunjie Chen , Xinyu Wu , Liang Lin

In this work, we present several heuristic-based and data-driven active vision strategies for viewpoint optimization of an arm-mounted depth camera for the purpose of aiding robotic grasping. These strategies aim to efficiently collect data…

Robotics · Computer Science 2021-04-26 Sabhari Natarajan , Galen Brown , Berk Calli

Generating dexterous grasping has been a long-standing and challenging robotic task. Despite recent progress, existing methods primarily suffer from two issues. First, most prior arts focus on a specific type of robot hand, lacking the…

Robotics · Computer Science 2023-03-07 Puhao Li , Tengyu Liu , Yuyang Li , Yiran Geng , Yixin Zhu , Yaodong Yang , Siyuan Huang

We introduce a method for using event camera data in novel view synthesis via Gaussian Splatting. Event cameras offer exceptional temporal resolution and a high dynamic range. Leveraging these capabilities allows us to effectively address…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Toshiya Yura , Ashkan Mirzaei , Igor Gilitschenski

Human hands possess the dexterity to interact with diverse objects such as grasping specific parts of the objects and/or approaching them from desired directions. More importantly, humans can grasp objects of any shape without…

Robotics · Computer Science 2024-07-15 Hui Zhang , Sammy Christen , Zicong Fan , Otmar Hilliges , Jie Song

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling scenes affected by transient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Chuanyu Fu , Yuqi Zhang , Kunbin Yao , Guanying Chen , Yuan Xiong , Chuan Huang , Shuguang Cui , Xiaochun Cao

The study of hand-object interaction requires generating viable grasp poses for high-dimensional multi-finger models, often relying on analytic grasp synthesis which tends to produce brittle and unnatural results. This paper presents…

Grasping is a fundamental skill for interacting with and manipulating objects in the environment. However, this ability can be challenging for individuals with hand impairments. Soft hand exoskeletons designed to assist grasping can enhance…

Robotics · Computer Science 2025-04-07 Chen Hu , Enrica Tricomi , Eojin Rho , Daekyum Kim , Lorenzo Masia , Shan Luo , Letizia Gionfrida

The semantic synthesis of unseen scenes from multiple viewpoints is crucial for research in 3D scene understanding. Current methods are capable of rendering novel-view images and semantic maps by reconstructing generalizable Neural Radiance…

Graphics · Computer Science 2025-05-09 Feng Xiao , Hongbin Xu , Wanlin Liang , Wenxiong Kang

Grasping is a fundamental capability for robots to interact with the physical world. Humans, equipped with two hands, autonomously select appropriate grasp strategies based on the shape, size, and weight of objects, enabling robust grasping…

Robotics · Computer Science 2026-03-06 Sizhe Yang , Yiman Xie , Zhixuan Liang , Yang Tian , Jia Zeng , Dahua Lin , Jiangmiao Pang

In this paper, we study the problem of adapting manipulation trajectories involving grasped objects (e.g. tools) defined for a single grasp pose to novel grasp poses. A common approach to address this is to define a new trajectory for each…

Robotics · Computer Science 2024-08-02 Georgios Papagiannis , Kamil Dreczkowski , Vitalis Vosylius , Edward Johns

Robotic grasping of house-hold objects has made remarkable progress in recent years. Yet, human grasps are still difficult to synthesize realistically. There are several key reasons: (1) the human hand has many degrees of freedom (more than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , Siyu Tang

The ability to successfully grasp objects is crucial in robotics, as it enables several interactive downstream applications. To this end, most approaches either compute the full 6D pose for the object of interest or learn to predict a set…

Robotic grasp detection is a fundamental capability for intelligent manipulation in unstructured environments. Previous work mainly employed visual and tactile fusion to achieve stable grasp, while, the whole process depending heavily on…

Robotics · Computer Science 2019-09-17 Teng Xue , Wenhai Liu , Mingshuo Han , Zhenyu Pan , Jin Ma , Quanquan Shao , Weiming Wang

Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Nikhil Keetha , Jay Karhade , Krishna Murthy Jatavallabhula , Gengshan Yang , Sebastian Scherer , Deva Ramanan , Jonathon Luiten

The ability to robustly grasp a variety of objects is essential for dexterous robots. In this paper, we present a framework for zero-shot dynamic dexterous grasping using single-view visual inputs, designed to be resilient to various…

Robotics · Computer Science 2025-08-15 Hui Zhang , Zijian Wu , Linyi Huang , Sammy Christen , Jie Song

Generalizable dexterous grasping with suitable grasp types is a fundamental skill for intelligent robots. Developing such skills requires a large-scale and high-quality dataset that covers numerous grasp types (i.e., at least those…

Robotics · Computer Science 2025-09-04 Jiayi Chen , Yubin Ke , Lin Peng , He Wang