English
Related papers

Related papers: Holoscopic 3D Micro-Gesture Database for Wearable …

200 papers

3D hand-object interaction data is scarce due to the hardware constraints in scaling up the data collection process. In this paper, we propose HOIDiffusion for generating realistic and diverse 3D hand-object interaction data. Our model is a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mengqi Zhang , Yang Fu , Zheng Ding , Sifei Liu , Zhuowen Tu , Xiaolong Wang

Generating realistic hand-object interactions (HOI) videos is a significant challenge due to the difficulty of modeling physical constraints (e.g., contact and occlusion between hands and manipulated objects). Current methods utilize HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Haodong Yan , Hang Yu , Zhide Zhong , Weilin Yuan , Xin Gong , Zehang Luo , Chengxi Heyu , Junfeng Li , Wenxuan Song , Shunbo Zhou , Haoang Li

Hand gestures are a natural means of interaction in Augmented Reality and Virtual Reality (AR/VR) applications. Recently, there has been an increased focus on removing the dependence of accurate hand gesture recognition on complex sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Varun Jain , Shivam Aggarwal , Suril Mehta , Ramya Hebbalaguppe

Designing of touchless user interface is gaining popularity in various contexts. Using such interfaces, users can interact with electronic devices even when the hands are dirty or non-conductive. Also, user with partial physical disability…

Human-Computer Interaction · Computer Science 2019-04-05 Abhik Singla , Partha Pratim Roy , Debi Prosad Dogra

We present HOI4D, a large-scale 4D egocentric dataset with rich annotations, to catalyze the research of category-level human-object interaction. HOI4D consists of 2.4M RGB-D egocentric video frames over 4000 sequences collected by 4…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yunze Liu , Yun Liu , Che Jiang , Kangbo Lyu , Weikang Wan , Hao Shen , Boqiang Liang , Zhoujie Fu , He Wang , Li Yi

Touch contact and pressure are essential for understanding how humans interact with and manipulate objects, insights which can significantly benefit applications in mixed reality and robotics. However, estimating these interactions from an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yiming Zhao , Taein Kwon , Paul Streli , Marc Pollefeys , Christian Holz

Vision based human pose estimation is an non-invasive technology for Human-Computer Interaction (HCI). Direct use of the hand as an input device provides an attractive interaction method, with no need for specialized sensing equipment, such…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nicholas Santavas , Ioannis Kansizoglou , Loukas Bampis , Evangelos Karakasis , Antonios Gasteratos

We present HOIMotion - a novel approach for human motion forecasting during human-object interactions that integrates information about past body poses and egocentric 3D object bounding boxes. Human motion forecasting is important in many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zhiming Hu , Zheming Yin , Daniel Haeufle , Syn Schmitt , Andreas Bulling

Human computer interaction facilitates intelligent communication between humans and computers, in which gesture recognition plays a prominent role. This paper proposes a machine learning system to identify dynamic gestures using tri-axial…

Human-Computer Interaction · Computer Science 2018-09-19 Gautham Krishna G , Karthik Subramanian Nathan , Yogesh Kumar B , Ankith A Prabhu , Ajay Kannan , Vineeth Vijayaraghavan

Human-Robot Interaction (HRI) has become increasingly important as robots are being integrated into various aspects of daily life. One key aspect of HRI is gesture recognition, which allows robots to interpret and respond to human gestures…

Human-Computer Interaction · Computer Science 2024-01-10 Sandeep Reddy Sabbella , Sara Kaszuba , Francesco Leotta , Pascal Serrarens , Daniele Nardi

Modeling and generating 3D human-object interactions from text is crucial for applications in AR, XR, and gaming. Existing approaches often rely on score distillation from text-to-image models, but their results suffer from the Janus…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Agniv Sharma , Xianghui Xie , Tom Fischer , Eddy Ilg , Gerard Pons-Moll

In this paper, we present MM-Gesture, the solution developed by our team HFUT-VUT, which ranked 1st in the micro-gesture classification track of the 3rd MiGA Challenge at IJCAI 2025, achieving superior performance compared to previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jihao Gu , Fei Wang , Kun Li , Yanyan Wei , Zhiliang Wu , Dan Guo

Emotion understanding is a fundamental challenge in affective computing and artificial intelligence. While existing approaches predominantly focus on facial expressions and speech, they often overlook the rich emotional cues conveyed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chengyan Wang , Haoyu Chen , Hui Wei , Yueyi Yang , Yunquan Chen , Guoying Zhao

Human Computer Interaction (HCI) is a field in which developer makes a user friendly system. User can interact with a computer system without using any conventional peripheral devices. Marker is used to recognize hand movement accurately &…

Human-Computer Interaction · Computer Science 2014-02-05 Kinjal N. Shah , Kirit R. Rathod , Shardul J. Agravat

Understanding egocentric human-object interaction (HOI) is a fundamental aspect of human-centric perception, facilitating applications like AR/VR and embodied AI. For the egocentric HOI, in addition to perceiving semantics e.g., ''what''…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yuhang Yang , Wei Zhai , Chengfeng Wang , Chengjun Yu , Yang Cao , Zheng-Jun Zha

Hologram is an ideal method for naked eye three-dimensional (3D) display, and computer-generated holography (CGH) makes it possible to reconstruct virtual objects. However, the large pixel size of common CGH devices results in shortages in…

Optics · Physics 2019-09-13 Hui Gao , Yuxi Wang , Xuhao Fan , Fenzhang Jiao , Jinsong Xia , Wei Xiong , Minghui Hong

While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sirui Xu , Dongting Li , Yucheng Zhang , Xiyan Xu , Qi Long , Ziyin Wang , Yunzhi Lu , Shuchang Dong , Hezi Jiang , Akshat Gupta , Yu-Xiong Wang , Liang-Yan Gui

Human-Object Interaction Recognition (HOIR) and user identification play a crucial role in advancing augmented reality (AR)-based personalized assistive technologies. These systems are increasingly being deployed in high-stakes,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Muhammad Hamza , Danish Hamid , Muhammad Tahir Akram

Remote collaborative work has become pervasive in many settings, from engineering to medical professions. Users are immersed in virtual environments and communicate through life-sized avatars that enable face-to-face collaboration. Within…

Human-Computer Interaction · Computer Science 2023-02-17 Catarina G. Fidalgo , Maurício Sousa , Daniel Mendes , Rafael Kuffner dos Anjos , Daniel Medeiros , Karan Singh , Joaquim Jorge

Recent diffusion methods have made significant progress in generating videos from single images due to their powerful visual generation capabilities. However, challenges persist in image-to-video synthesis, particularly in human video…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Tiantian Wang , Chun-Han Yao , Tao Hu , Mallikarjun Byrasandra Ramalinga Reddy , Ming-Hsuan Yang , Varun Jampani