English
Related papers

Related papers: Simultaneous Tactile-Visual Perception for Learnin…

200 papers

Robotic palpation relies on force sensing, but force signals in soft-tissue environments are variable and cannot reliably reveal subtle subsurface features. We present a compact multimodal sensor that integrates high-resolution vision-based…

Tactile sensing is essential to the human perception system, so as to robot. In this paper, we develop a novel optical-based tactile sensor "FingerVision" with effective signal processing algorithms. This sensor is composed of soft skin…

Robotics · Computer Science 2018-10-08 Yazhan Zhang , Zicheng Kan , Yu Alexander Tse , Yang Yang , Michael Yu Wang

Tactile perception is important for robotic systems that interact with the world through touch. Touch is an active sense in which tactile measurements depend on the contact properties of an interaction--e.g., velocity, force,…

Robotics · Computer Science 2024-05-21 Jake Ketchum , Ahalya Prabhakar , Todd D. Murphey

Robot simulation has been an essential tool for data-driven manipulation tasks. However, most existing simulation frameworks lack either efficient and accurate models of physical interactions with tactile sensors or realistic tactile…

Robotics · Computer Science 2022-08-08 Zilin Si , Zirui Zhu , Arpit Agarwal , Stuart Anderson , Wenzhen Yuan

Tactile sensing is important for robots to perceive the world as it captures the texture and hardness of the object in contact and is robust to illumination and colour variances. However, due to the limited sensing area and the resistance…

Robotics · Computer Science 2021-03-02 Guanqun Cao , Jiaqi Jiang , Chen Lu , Daniel Fernandes Gomes , Shan Luo

As data from IoT (Internet of Things) sensors become ubiquitous, state-of-the-art machine learning algorithms face many challenges on directly using sensor data. To overcome these challenges, methods must be designed to learn directly from…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Qiong Liu , Yanxia Zhang

Visuotactile sensors are indispensable for contact-rich robotic manipulation tasks. However, policy learning with tactile feedback in simulation, especially for online reinforcement learning (RL), remains a critical challenge, as it demands…

Robotics · Computer Science 2026-03-31 Ningyu Yan , Shuai Wang , Xing Shen , Hui Wang , Hanqing Wang , Yang Xiang , Jiangmiao Pang

Whole body tactile perception via tactile skins offers large benefits for robots in unstructured environments. To fully realize this benefit, tactile systems must support real-time data acquisition over a massive number of tactile sensor…

Robotics · Computer Science 2016-03-07 Brayden Hollis , Stacy Patterson , Jeff Trinkle

Tactile perception is essential for real-world manipulation tasks, yet the high cost and fragility of tactile sensors can limit their practicality. In this work, we explore BeadSight (a low-cost, open-source tactile sensor) alongside a…

Robotics · Computer Science 2025-03-14 Selam Gano , Abraham George , Amir Barati Farimani

Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic…

Robotics · Computer Science 2026-04-23 Qianxi Hua , Xinyue Li , Zheng Yan , Yang Li , Chi Zhang , Yongyao Li , Yufei Liu

Robotic manipulation has made significant advancements, with systems demonstrating high precision and repeatability. However, this remarkable precision often fails to translate into efficient manipulation of thin deformable objects. Current…

Robotics · Computer Science 2025-07-09 Chao Zhao , Chunli Jiang , Lifan Luo , Shuai Yuan , Qifeng Chen , Hongyu Yu

This article reviews contemporary methods for integrating force, including both proprioception and tactile sensing, in robot manipulation policy learning. We conduct a comparative analysis on various approaches for sensing force, data…

Robotics · Computer Science 2025-04-17 William Xie , Nikolaus Correll

Tactile sensors can provide detailed contact in-formation that can facilitate robots to perform dexterous, in-hand manipulation tasks. One of the primitive but important tasks is surface following that is a key feature for robots while…

Robotics · Computer Science 2019-12-03 Chen Lu , Jing Wang , Shan Luo

Many-legged elongated robots show promise for reliable mobility on rugged landscapes. However, most studies on these systems focus on planar motion planning without addressing rapid vertical motion. Despite their success on mild rugged…

Robotics · Computer Science 2025-04-22 Juntao He , Baxi Chong , Massimiliano Iaschi , Vincent R. Nienhusser , Sehoon Ha , Daniel I. Goldman

Touch sensing is widely acknowledged to be important for dexterous robotic manipulation, but exploiting tactile sensing for continuous, non-prehensile manipulation is challenging. General purpose control techniques that are able to…

Vision-based tactile sensors, through high-resolution optical measurements, can effectively perceive the geometric shape of objects and the force information during the contact process, thus helping robots acquire higher-dimensional tactile…

Robotics · Computer Science 2026-03-06 Xi Lin , Weiliang Xu , Yixian Mao , Jing Wang , Meixuan Lv , Lu Liu , Xihui Luo , Xinming Li

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions primarily rely on visual information to devise a strategy for grasping. However, for robotic systems to attain a level of…

Robotic manipulation is essential for modernizing factories and automating industrial tasks like polishing, which require advanced tactile abilities. These robots must be easily set up, safely work with humans, learn tasks autonomously, and…

Robotics · Computer Science 2024-08-26 Anran Zhang , Kübra Karacan , Hamid Sadeghian , Yansong Wu , Fan Wu , Sami Haddadin

Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual feedback. However, the distinct nature of these modalities poses significant challenges. In this paper, we introduce a system that leverages visual and…

Robotics · Computer Science 2024-08-01 Ying Yuan , Haichuan Che , Yuzhe Qin , Binghao Huang , Zhao-Heng Yin , Kang-Won Lee , Yi Wu , Soo-Chul Lim , Xiaolong Wang

Robot assistive navigation (RAN) is critical for enhancing the mobility and independence of the growing population of mobility-impaired individuals. However, existing systems often rely on interfaces that fail to replicate the intuitive and…

Robotics · Computer Science 2025-09-23 Shaoting Peng , Dakarai Crowder , Wenzhen Yuan , Katherine Driggs-Campbell