English
Related papers

Related papers: Visual-Tactile Sensing for Real-time Liquid Volume…

200 papers

Camera-based tactile sensors provide robots with a high-performance tactile sensing approach for environment perception and dexterous manipulation. However, achieving comprehensive environmental perception still requires cooperation with…

Robotics · Computer Science 2025-04-15 Yueshi Dong , Jieji Ren , Zhenle Liu , Zhanxuan Peng , Zihao Yuan , Ningbin Zhang , Guoying Gu

Despite significant advancements in robotic manipulation, achieving consistent and stable grasping remains a fundamental challenge, often limiting the successful execution of complex tasks. Our analysis reveals that even state-of-the-art…

Artificial Intelligence · Computer Science 2025-03-20 Sungjae Lee , Yeonjoo Hong , Kwang In Kim

We consider the task of semantic robotic grasping, in which a robot picks up an object of a user-specified class using only monocular images. Inspired by the two-stream hypothesis of visual reasoning, we present a semantic grasping…

Robotics · Computer Science 2017-11-10 Eric Jang , Sudheendra Vijayanarasimhan , Peter Pastor , Julian Ibarz , Sergey Levine

Measuring grasp stability is an important skill for dexterous robot manipulation tasks, which can be inferred from haptic information with a tactile sensor. Control policies have to detect rotational displacement and slippage from tactile…

Robotics · Computer Science 2024-08-01 En Yen Puang , Zechen Li , Chee Meng Chew , Shan Luo , Yan Wu

Accurate in-hand pose estimation is crucial for robotic object manipulation, but visual occlusion remains a major challenge for vision-based approaches. This paper presents an approach to robotic in-hand object pose estimation, combining…

Robotics · Computer Science 2025-06-13 Felix Nonnengießer , Alap Kshirsagar , Boris Belousov , Jan Peters

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

Real-time proprioception is a challenging problem for soft robots, which have almost infinite degrees-of-freedom in body deformation. When multiple actuators are used, it becomes more difficult as deformation can also occur on actuators…

Robotics · Computer Science 2020-12-24 Rob B. N. Scharff , Guoxin Fang , Yingjun Tian , Jun Wu , Jo M. P. Geraedts , Charlie C. L. Wang

We achieved contact-rich flexible object manipulation, which was difficult to control with vision alone. In the unzipping task we chose as a validation task, the gripper grasps the puller, which hides the bag state such as the direction and…

Robotics · Computer Science 2022-05-11 Hideyuki Ichiwara , Hiroshi Ito , Kenjiro Yamamoto , Hiroki Mori , Tetsuya Ogata

To achieve a dexterous robotic manipulation, we need to endow our robot with tactile feedback capability, i.e. the ability to drive action based on tactile sensing. In this paper, we specifically address the challenge of tactile servoing,…

The verification of successful grasps is a crucial aspect of robot manipulation, particularly when handling deformable objects. Traditional methods relying on force and tactile sensors often struggle with deformable and non-rigid objects.…

Robotics · Computer Science 2025-05-07 Pau Amargant , Peter Hönig , Markus Vincze

Robotic grasp detection for novel objects is a challenging task, but for the last few years, deep learning based approaches have achieved remarkable performance improvements, up to 96.1% accuracy, with RGB-D data. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Dongwon Park , Yonghyeok Seo , Se Young Chun

Tactile sensing has seen a rapid adoption with the advent of vision-based tactile sensors. Vision-based tactile sensors provide high resolution, compact and inexpensive data to perform precise in-hand manipulation and human-robot…

Robotics · Computer Science 2021-07-26 Arpit Agarwal , Tim Man , Wenzhen Yuan

Many robotic tasks rely on the accurate localization of moving objects within a given workspace. This information about the objects' poses and velocities are used for control,motion planning, navigation, interaction with the environment or…

Robotics · Computer Science 2016-06-15 Michael Neunert , Michael Bloesch , Jonas Buchli

Vision-based models for robotic grasping automate critical, repetitive, and draining industrial tasks. Existing approaches are typically limited in two ways: they either target a single gripper and are potentially applied on costly dual-arm…

Tactile sensing is one of the modalities humans rely on heavily to perceive the world. Working with vision, this modality refines local geometry structure, measures deformation at the contact area, and indicates the hand-object contact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenqiang Xu , Zhenjun Yu , Han Xue , Ruolin Ye , Siqiong Yao , Cewu Lu

For in-hand manipulation, estimation of the object pose inside the hand is one of the important functions to manipulate objects to the target pose. Since in-hand manipulation tends to cause occlusions by the hand or the object itself, image…

Robotics · Computer Science 2020-08-04 Tomoki Anzai , Kuniyuki Takahashi

Developing personal robots that can perform a diverse range of manipulation tasks in unstructured environments necessitates solving several challenges for robotic grasping systems. We take a step towards this broader goal by presenting the…

Diagnostic activities, such as ultrasound scans and palpation, are relatively low-cost. They play a crucial role in the early detection of health problems and in assessing their progression. However, they are also error-prone activities,…

For both humans and robots, the sense of touch, known as tactile sensing, is critical for performing contact-rich manipulation tasks. Three key challenges in robotic tactile sensing are 1) interpreting sensor signals, 2) generating sensor…

Robotics · Computer Science 2025-03-11 Iretiayo Akinola , Jie Xu , Jan Carius , Dieter Fox , Yashraj Narang

We present an adaptive grasping method that finds stable grasps on novel objects. The main contributions of this paper is in the computation of the probability of success of grasps in the vicinity of an already applied grasp. Our method…

Robotics · Computer Science 2017-04-20 Emil Hyttinen , Danica Kragic , Renaud Detry