English
Related papers

Related papers: Sensor-Invariant Tactile Representation

200 papers

Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics,…

Robotics · Computer Science 2021-07-23 Nathan F. Lepora

Robotic manipulation requires both rich multimodal perception and effective learning frameworks to handle complex real-world tasks. See-through-skin (STS) sensors, which combine tactile and visual perception, offer promising sensing…

Robotics · Computer Science 2026-02-10 Yuyang Li , Yinghan Chen , Zihang Zhao , Puhao Li , Tengyu Liu , Siyuan Huang , Yixin Zhu

Vision-based tactile sensors, through high-resolution optical measurements, can effectively perceive the geometric shape of objects and the force information during the contact process, thus helping robots acquire higher-dimensional tactile…

Robotics · Computer Science 2026-03-06 Xi Lin , Weiliang Xu , Yixian Mao , Jing Wang , Meixuan Lv , Lu Liu , Xihui Luo , Xinming Li

Simulating optical tactile sensors presents significant challenges due to their high deformability and intricate optical properties. To address these issues and enable a physically accurate simulation, we propose DOT-Sim: Differentiable…

Robotics · Computer Science 2026-05-01 Yang You , Won Kyung Do , Aiden Swann , Rika Antonova , Monroe Kennedy , Leonidas Guibas

The development of tactile sensing and its fusion with computer vision is expected to enhance robotic systems in handling complex tasks like deformable object manipulation. However, readily available industrial grippers typically lack…

Robotics · Computer Science 2023-06-12 Remko Proesmans , Francis wyffels

Tactile sensing is a essential for skilled manipulation and object perception, but existing devices are unable to capture mechanical signals in the full gamut of regimes that are important for human touch sensing, and are unable to emulate…

Robotics · Computer Science 2019-08-23 Yitian Shao , Hui Hu , Yon Visell

Skill transfer from humans to robots is challenging. Presently, many researchers focus on capturing only position or joint angle data from humans to teach the robots. Even though this approach has yielded impressive results for grasping…

Simulation has recently become key for deep reinforcement learning to safely and efficiently acquire general and complex control policies from visual and proprioceptive inputs. Tactile information is not usually considered despite its…

Robotics · Computer Science 2021-11-02 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora

Robotics research has long sought to give robots the ability to perceive the physical world through touch in an analogous manner to many biological systems. Developing such tactile capabilities is important for numerous emerging…

Robotics · Computer Science 2025-08-18 Shan Luo , Nathan F. Lepora , Wenzhen Yuan , Kaspar Althoefer , Gordon Cheng , Ravinder Dahiya

Simulators perform an important role in prototyping, debugging, and benchmarking new advances in robotics and learning for control. Although many physics engines exist, some aspects of the real world are harder than others to simulate. One…

Robotics · Computer Science 2022-02-14 Shaoxiong Wang , Mike Lambeta , Po-Wei Chou , Roberto Calandra

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility…

Robotics · Computer Science 2026-04-29 Wadhah Zai El Amri , Malte Kuhlmann , Nicolás Navarro-Guerrero

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

Research on tactile sensing has been progressing at constant pace. In robotics, tactile sensing is typically studied in the context of object grasping and manipulation. In this domain, the development of robust, multi-modal, tactile sensors…

Robotics · Computer Science 2022-06-29 Lorenzo Natale , Giorgio Cannata

Tactile sensing is critical to fine-grained, contact-rich manipulation tasks, such as insertion and assembly. Prior research has shown the possibility of learning tactile-guided policy from teleoperated demonstration data. However, to…

Robotics · Computer Science 2025-02-07 Kelin Yu , Yunhai Han , Qixian Wang , Vaibhav Saxena , Danfei Xu , Ye Zhao

Deformable object manipulation is a classical and challenging research area in robotics. Compared with rigid object manipulation, this problem is more complex due to the deformation properties including elastic, plastic, and elastoplastic…

Stretchable sensors indicate promising prospects for soft robotics, medical devices, and human-machine interactions due to the high compliance of soft materials. Discrete sensing strategies, including sensor arrays and distributed sensors,…

Robotics · Computer Science 2025-12-25 Yiding Nie , Dongliang Fan , Jiatai Huang , Chunyu Liu , Jian S. Dai

Robot skill acquisition processes driven by reinforcement learning often rely on simulations to efficiently generate large-scale interaction data. However, the absence of simulation models for tactile sensors has hindered the use of tactile…

Robotics · Computer Science 2025-09-15 Xiyan Huang , Zhe Xu , Chenxi Xiao

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Modern audio-visual media rely on compact representations for efficient storage and transmission, whereas realistic digital touch still depends on high-resolution tactile recordings. Existing approaches for representing tactile signals…

Human-Computer Interaction · Computer Science 2026-05-25 Jagan K. Balasubramanian , Yasemin Vardar

Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and…