English
Related papers

Related papers: TouchScribe: Augmenting Non-Visual Hand-Object Int…

200 papers

As eye-tracking becomes increasingly common in modern mobile devices, the potential for hands-free, gaze-based interaction grows, but current gesture sets are largely expert-designed and often misaligned with how users naturally move their…

Human-Computer Interaction · Computer Science 2026-03-25 Yaxiong Lei , Xinya Gong , Shijing He , Yafei Wang , Mohamed Khamis , Juan Ye

Robots in many real-world settings have access to force/torque sensors in their gripper and tactile sensing is often necessary in tasks that involve contact-rich motion. In this work, we leverage surprise from mismatches in touch feedback…

Machine Learning · Computer Science 2021-06-29 Sai Rajeswar , Cyril Ibrahim , Nitin Surya , Florian Golemo , David Vazquez , Aaron Courville , Pedro O. Pinheiro

We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-tracking for object manipulation. With HandOver, the mouse…

Human-Computer Interaction · Computer Science 2025-08-04 Esen K. Tütüncü , Mar Gonzalez-Franco , Eric J. Gonzalez

Grasping is an incredible ability of animals using their arms and limbs in their daily life. The human hand is an especially astonishing multi-fingered tool for precise grasping, which helped humans to develop the modern world. The…

Robotics · Computer Science 2023-01-03 Jose James

Grabbing virtual objects is one of the essential tasks for Augmented, Virtual, and Mixed Reality applications. Modern applications usually use a simple pinch gesture for grabbing and moving objects. However, picking up objects by pinching…

Human-Computer Interaction · Computer Science 2022-02-23 Alexander Schäfer , Gerd Reis , Didier Stricker

Human Computer Interaction (HCI) is a field in which developer makes a user friendly system. User can interact with a computer system without using any conventional peripheral devices. Marker is used to recognize hand movement accurately &…

Human-Computer Interaction · Computer Science 2014-02-05 Kinjal N. Shah , Kirit R. Rathod , Shardul J. Agravat

A touch sensitive screen displays the information on the screen and also receives the input by sensing a user's touch on the same screen. This mechanism facilitates system interaction directly through the screen without needing a mouse or…

Human-Computer Interaction · Computer Science 2014-04-29 Umakant Mishra

Physical contact between hands and objects plays a critical role in human grasps. We show that optimizing the pose of a hand to achieve expected contact with an object can improve hand poses inferred via image-based methods. Given a hand…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Patrick Grady , Chengcheng Tang , Christopher D. Twigg , Minh Vo , Samarth Brahmbhatt , Charles C. Kemp

The computer industry is developing at a fast pace. With this development almost all of the fields under computers have advanced in the past couple of decades. But the same technology is being used for human computer interaction that was…

Computer Vision and Pattern Recognition · Computer Science 2013-12-31 Amiraj Dhawan , Vipul Honrao

Improving object manipulation skills through hand-object interaction exercises is crucial for rehabilitation. Despite limited healthcare resources, physical therapists propose remote exercise routines followed up by remote monitoring.…

Human-Computer Interaction · Computer Science 2023-12-13 Trudi Di Qi , LouAnne Boyd , Scott Fitzpatrick , Meghna Raswan , Farnceli Cibrian

We achieved contact-rich flexible object manipulation, which was difficult to control with vision alone. In the unzipping task we chose as a validation task, the gripper grasps the puller, which hides the bag state such as the direction and…

Robotics · Computer Science 2022-05-11 Hideyuki Ichiwara , Hiroshi Ito , Kenjiro Yamamoto , Hiroki Mori , Tetsuya Ogata

No two people are alike. We usually ignore this diversity as we have the capability to adapt and, without noticing, become experts in interfaces that were probably misadjusted to begin with. This adaptation is not always at the user's…

Human-Computer Interaction · Computer Science 2014-02-06 Tiago Guerreiro , Hugo Nicolau , João Oliveira , Joaquim Jorge , Daniel Gonçalves

LinkGlide-S is a novel wearable hand-worn tactile display to deliver multi-contact and multi-modal stimuli at the user's palm.} The array of inverted five-bar linkages generates three independent contact points to cover the whole palm area.…

Human-Computer Interaction · Computer Science 2022-08-31 Miguel Altamirano Cabrera , Jonathan Tirado , Juan Heredia , Dzmitry Tsetserukou

TouchFusion is a wristband that enables touch interactions on nearby surfaces without any additional instrumentation or computer vision. TouchFusion combines surface electromyography (sEMG), bioimpedance, inertial, and optical sensing to…

Touch plays a central role in how humans perceive and recognize materials through physical contact. Despite decades of research, the mechanisms by which tactile signals are transformed into meaningful perceptual representations remain…

Human-Computer Interaction · Computer Science 2026-05-19 Yasemin Vardar

Access to non-verbal cues in social interactions is vital for people with visual impairment. It has been shown that non-verbal cues such as eye contact, number of people, their names and positions are helpful for individuals who are blind.…

Computers and Society · Computer Science 2017-11-30 M. Saquib Sarfraz , Angela Constantinescu , Melanie Zuzej , Rainer Stiefelhagen

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However,…

Human-Computer Interaction · Computer Science 2020-08-21 Ryo Suzuki , Rubaiat Habib Kazi , Li-Yi Wei , Stephen DiVerdi , Wilmot Li , Daniel Leithinger

Human-robot object handovers have been an actively studied area of robotics over the past decade; however, very few techniques and systems have addressed the challenge of handing over diverse objects with arbitrary appearance, size, shape,…

Robotics · Computer Science 2021-06-07 Wei Yang , Chris Paxton , Arsalan Mousavian , Yu-Wei Chao , Maya Cakmak , Dieter Fox

Touch contact and pressure are essential for understanding how humans interact with and manipulate objects, insights which can significantly benefit applications in mixed reality and robotics. However, estimating these interactions from an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yiming Zhao , Taein Kwon , Paul Streli , Marc Pollefeys , Christian Holz

Hybrid rigid-soft robots combine the precision of rigid manipulators with the compliance and adaptability of soft arms, offering a promising approach for versatile grasping in unstructured environments. However, coordinating hybrid robots…