English
Related papers

Related papers: TouchFusion: Multimodal Wristband Sensing for Ubiq…

200 papers

Smartphones with large screens provide users with increased display and interaction space but pose challenges in reaching certain areas with the thumb when using the device with one hand. To address this, we introduce GazeSwipe, a…

Human-Computer Interaction · Computer Science 2025-03-28 Zhuojiang Cai , Jingkai Hong , Zhimin Wang , Feng Lu

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond

Combining different sensing modalities with multiple positions helps form a unified perception and understanding of complex situations such as human behavior. Hence, human activity recognition (HAR) benefits from combining redundant and…

Machine Learning · Computer Science 2024-04-26 Hymalai Bello

Hand-face interactions play a key role in many everyday tasks, providing insights into user habits, behaviors, intentions, and expressions. However, existing wearable sensing systems often struggle to track these interactions in daily…

Human-Computer Interaction · Computer Science 2024-11-14 Saif Mahmud , Kian Mahmoodi , Chi-Jung Lee , Francois Guimbretiere , Cheng Zhang

Hand gesture recognition attracts great attention for interaction since it is intuitive and natural to perform. In this paper, we explore a novel method for interaction by using bone-conducted sound generated by finger movements while…

Human-Computer Interaction · Computer Science 2021-12-14 Bing Zhou , Matias Aiskovich , Sinem Guven

Mobile authentication is indispensable for preventing unauthorized access to multi-touch mobile devices. Existing mobile authentication techniques are often cumbersome to use and also vulnerable to shoulder-surfing and smudge attacks. This…

Cryptography and Security · Computer Science 2014-02-07 Jingchao Sun , Rui Zhang , Jinxue Zhang , Yanchao Zhang

Tactile sensing is a essential for skilled manipulation and object perception, but existing devices are unable to capture mechanical signals in the full gamut of regimes that are important for human touch sensing, and are unable to emulate…

Robotics · Computer Science 2019-08-23 Yitian Shao , Hui Hu , Yon Visell

This paper proposes a wearable-controlled mobile manipulator system for intelligent smart home assistance, integrating MEMS capacitive microphones, IMU sensors, vibration motors, and pressure feedback to enhance human-robot interaction. The…

Robotics · Computer Science 2025-04-21 Xiao Jin , Bo Xiao , Huijiang Wang , Wendong Wang , Zhenhua Yu

Tactile sensing represents a crucial technique that can enhance the performance of robotic manipulators in various tasks. This work presents a novel bioinspired neuromorphic vision-based tactile sensor that uses an event-based camera to…

Robotics · Computer Science 2024-03-18 Omar Faris , Mohammad I. Awad , Murana A. Awad , Yahya Zweiri , Kinda Khalaf

The human hand is our primary interface to the physical world, yet egocentric perception rarely knows when, where, or how forcefully it makes contact. Robust wearable tactile sensors are scarce, and no existing in-the-wild datasets align…

This paper presents the design flow of an IoT human machine touchless interface. The device uses embedded computing in conjunction with the Leap Motion Controller to provide an accurate and intuitive touchless interface. Its main function…

Image and Video Processing · Electrical Eng. & Systems 2023-04-14 Hans Johnson , Jafar Saniie

Tactile sensors play a crucial role in enabling robots to interact effectively and safely with objects in everyday tasks. In particular, visuotactile sensors have seen increasing usage in two and three-fingered grippers due to their…

Robotics · Computer Science 2024-10-22 Yifan Wu , Yuzhou Chen , Zhengying Zhu , Xuhao Qin , Chenxi Xiao

Hand-over-face gestures can provide important implicit interactions during conversations, such as frustration or excitement. However, in situations where interlocutors are not visible, such as phone calls or textual communication, the…

Human-Computer Interaction · Computer Science 2024-03-28 Mengxi Liu , Hymalai Bello , Bo Zhou , Paul Lukowicz , Jakob Karolus

The ability to associate touch with other modalities has huge implications for humans and computational systems. However, multimodal learning with touch remains challenging due to the expensive data collection process and non-standardized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Fengyu Yang , Chao Feng , Ziyang Chen , Hyoungseob Park , Daniel Wang , Yiming Dou , Ziyao Zeng , Xien Chen , Rit Gangopadhyay , Andrew Owens , Alex Wong

Across a plethora of social situations, we touch others in natural and intuitive ways to share thoughts and emotions, such as tapping to get one's attention or caressing to soothe one's anxiety. A deeper understanding of these…

Human-Computer Interaction · Computer Science 2022-10-11 Shan Xu , Chang Xu , Sarah McIntyre , Håkan Olausson , Gregory J. Gerling

Advancements in information technology have increased demand for natural human-computer interaction in areas such as gaming, smart homes, and vehicles. However, conventional approaches like physical buttons or cameras are often limited by…

Human-Computer Interaction · Computer Science 2025-11-24 Weiyi Wang , Lanqing Yang , Linqian Gan , Guangtao Xue

In robotic manipulation, tactile sensors are indispensable, especially when dealing with soft objects, objects of varying dimensions, or those out of the robot's direct line of sight. Traditional tactile sensors often grapple with…

Robotics · Computer Science 2024-05-24 Abraham George , Yibo Chen , Atharva Dikshit , Peter Pak , Amir Barati Farimani

This UIST Vision argues that "touch" input and interaction remains in its infancy when viewed in context of the seen but unnoticed vocabulary of natural human behaviors, activity, and environments that surround direct interaction with…

Human-Computer Interaction · Computer Science 2023-10-09 Ken Hinckley

Recognizing facial activity is a well-understood (but non-trivial) computer vision problem. However, reliable solutions require a camera with a good view of the face, which is often unavailable in wearable settings. Furthermore, in wearable…

Machine Learning · Computer Science 2023-06-21 Hymalai Bello , Luis Alfredo Sanchez Marin , Sungho Suh , Bo Zhou , Paul Lukowicz

Wireless earbuds are an appealing platform for wearable computing on-the-go. However, their small size and out-of-view location mean they support limited different inputs. We propose finger identification input on earbuds as a novel…

Human-Computer Interaction · Computer Science 2025-03-05 Jiwan Kim , Mingyu Han , Ian Oakley