English
Related papers

Related papers: Recognizing Complex Gestures on Minimalistic Knitt…

200 papers

This paper presents a control scheme for force sensitive, gentle grasping with a Pisa/IIT anthropomorphic SoftHand equipped with a miniaturised version of the TacTip optical tactile sensor on all five fingertips. The tactile sensors provide…

Manipulation of thin materials is critical for many everyday tasks and remains a significant challenge for robots. While existing research has made strides in tasks like material smoothing and folding, many studies struggle with common…

Robotics · Computer Science 2025-08-12 Ankush Kundan Dhawan , Camille Chungyoun , Karina Ting , Monroe Kennedy

One of the most important object properties that humans and robots perceive through touch is hardness. This paper investigates information-theoretic active sampling strategies for sample-efficient hardness classification with vision-based…

This work presents NeuroTouch, an optical-based tactile sensor that combines a highly deformable dome-shaped soft material with an integrated neuromorphic camera, leveraging frame-based and dynamic vision for gesture detection. Our approach…

Human-Computer Interaction · Computer Science 2025-02-03 Victor Hoffmann , Federico Paredes-Valles , Valentina Cavinato

Human activity recognition has become an attractive research area with the development of on-body wearable sensing technology. With comfortable electronic-textiles, sensors can be embedded into clothing so that it is possible to record…

Robotics · Computer Science 2022-09-26 Tianchen Shen , Irene Di Giulio , Matthew Howard

Humans represent and discriminate the objects in the same category using their properties, and an intelligent robot should be able to do the same. In this paper, we build a robot system that can autonomously perceive the object properties…

Robotics · Computer Science 2018-02-27 Wenzhen Yuan , Yuchen Mo , Shaoxiong Wang , Edward Adelson

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

A novel, highly flexible capacitor fiber (with 100 nF m-1 typical capacitance per length) having a multilayer periodic structure of dielectric and conductive polymer composite films is fabricated by drawing technique. The fiber is used to…

Instrumentation and Detectors · Physics 2011-06-21 Jian Feng Gu , Stephan Gorgutsa , Maksim Skorobogatiy

Soft robotic fingers can improve adaptability in grasping and manipulation, compensating for geometric variation in object or environmental contact, but today lack force capacity and fine dexterity. Integrated tactile sensors can provide…

Robotics · Computer Science 2024-10-28 Hun Jang , Joonbum Bae , Kevin Haninger

In this paper, we present a touch technology to achieve tactile interactivity for human-robot interaction (HRI) in soft robotics. By combining a capacitive touch sensor with an online solid mechanics simulation provided by the SOFA…

Gesture recognition has become increasingly important in human-computer interaction and can support different applications such as smart home, VR, and gaming. Traditional approaches usually rely on dedicated sensors that are worn by the…

Human-Computer Interaction · Computer Science 2021-06-03 Sheng Tan , Jie Yang

Tactile perception has the potential to significantly enhance dexterous robotic manipulation by providing rich local information that can complement or substitute for other sensory modalities such as vision. However, because tactile sensing…

Robotics · Computer Science 2025-06-17 Tim Schneider , Guillaume Duret , Cristiana de Farias , Roberto Calandra , Liming Chen , Jan Peters

In this paper, a novel tactile sensing mechanism for soft robotic fingers is proposed. Inspired by the proprioception mechanism found in mammals, the proposed approach infers tactile information from a strain sensor attached on the finger's…

Robotics · Computer Science 2021-07-07 Chang Cheng , Yadong Yan , Mingjun Guan , Jianan Zhang , Yu Wang

Gesture recognition is a cornerstone of Human-Computer Interaction (HCI) for smart eyewear, enabling natural and device-free control in augmented reality environments. Traditional vision-based approaches face significant challenges…

Machine Learning · Computer Science 2026-05-14 Pietro Bartoli , Christian Veronesi , Tommaso Bondini , Andrea Giudici , Franco Zappa

Robotic manipulation of cloth has applications ranging from fabrics manufacturing to handling blankets and laundry. Cloth manipulation is challenging for robots largely due to their high degrees of freedom, complex dynamics, and severe…

Robotics · Computer Science 2022-07-25 Sashank Tirumala , Thomas Weng , Daniel Seita , Oliver Kroemer , Zeynep Temel , David Held

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker

For machines to interact with the physical world, they must understand the physical properties of objects and materials they encounter. We use fabrics as an example of a deformable material with a rich set of mechanical properties. A thin…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Wenzhen Yuan , Shaoxiong Wang , Siyuan Dong , Edward Adelson

Hand gesture recognition has been granted as one of the emerging fields in research today providing a natural way of communication between man and a machine. Gestures are some forms of body motions which a person expresses when doing a work…

Image and Video Processing · Electrical Eng. & Systems 2018-12-27 Biswarup Ganguly , Amit Konar

This paper proposes an interactive system for mobile devices controlled by hand gestures aimed at helping people with visual impairments. This system allows the user to interact with the device by making simple static and dynamic hand…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Samer Alashhab , Antonio Javier Gallego , Miguel Ángel Lozano

We present multi-component knitted resistive sensors for tracking tensile force. The knits were fabricated using a Twill structure, which is a simple pattern featuring anisotropic elastic behavior, providing high stability along…

Systems and Control · Electrical Eng. & Systems 2023-06-14 Roland Aigner , Frank Hepper