English
Related papers

Related papers: FreeA: Human-object Interaction Detection using Fr…

200 papers

Modern machine learning models deployed often encounter distribution shifts in real-world applications, manifesting as covariate or semantic out-of-distribution (OOD) shifts. These shifts give rise to challenges in OOD generalization and…

Machine Learning · Computer Science 2024-10-11 Haoyue Bai , Jifan Zhang , Robert Nowak

We show that for human-object interaction detection a relatively simple factorized model with appearance and layout encodings constructed from pre-trained object detectors outperforms more sophisticated approaches. Our model includes…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Tanmay Gupta , Alexander Schwing , Derek Hoiem

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Every hand-object interaction begins with contact. Despite predicting the contact state between hands and objects is useful in understanding hand-object interactions, prior methods on hand-object analysis have assumed that the interacting…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Takuma Yagi , Md Tasnimul Hasan , Yoichi Sato

Unsupervised 3D object detection serves as an important solution for offline 3D object annotation. However, due to the data sparsity and limited views, the clustering-based label fitting in unsupervised object detection often generates…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Qiming Xia , Wenkai Lin , Haoen Xiang , Xun Huang , Siheng Chen , Zhen Dong , Cheng Wang , Chenglu Wen

Reconstructing human-object interactions (HOI) from single images is fundamental in computer vision. Existing methods are primarily trained and tested on indoor scenes due to the lack of 3D data, particularly constrained by the object…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Boran Wen , Dingbang Huang , Zichen Zhang , Jiahong Zhou , Jianbin Deng , Jingyu Gong , Yulong Chen , Lizhuang Ma , Yong-Lu Li

Humans constantly contact objects to move and perform tasks. Thus, detecting human-object contact is important for building human-centered artificial intelligence. However, there exists no robust method to detect contact between the body…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Yixin Chen , Sai Kumar Dwivedi , Michael J. Black , Dimitrios Tzionas

The lack of annotated datasets is a major bottleneck for training new task-specific supervised machine learning models, considering that manual annotation is extremely expensive and time-consuming. To address this problem, we present MONAI…

Human activity recognition in videos has been widely studied and has recently gained significant advances with deep learning approaches; however, it remains a challenging task. In this paper, we propose a novel framework that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Dong-Gyu Lee , Seong-Whan Lee

Advances in robotics have been driving the development of human-robot interaction (HRI) technologies. However, accurately perceiving human actions and achieving adaptive control remains a challenge in facilitating seamless coordination…

Robotics · Computer Science 2025-07-10 Mingqi Yuan , Huijiang Wang , Kai-Fung Chu , Fumiya Iida , Bo Li , Wenjun Zeng

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major drawbacks; they cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Masato Tamura , Hiroki Ohashi , Tomoaki Yoshinaga

We propose a novel approach for generating text-guided human-object interactions (HOIs) that achieves explicit joint-level interaction modeling in a computationally efficient manner. Previous methods represent the entire human body as a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guohong Huang , Ling-An Zeng , Zexin Zheng , Shengbo Gu , Wei-Shi Zheng

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Recovering 3D Human-Object Interaction (HOI) from single color images is challenging due to depth ambiguities, occlusions, and the huge variation in object shape and appearance. Thus, past work requires controlled settings such as known…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Alpár Cseke , Shashank Tripathi , Sai Kumar Dwivedi , Arjun Lakshmipathy , Agniv Chatterjee , Michael J. Black , Dimitrios Tzionas

Nowadays, a huge number of images are available. However, retrieving a required image for an ordinary user is a challenging task in computer vision systems. During the past two decades, many types of research have been introduced to improve…

Multimedia · Computer Science 2020-01-30 Amir Vatani , Milad Taleby Ahvanooey , Mostafa Rahimi

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided…

Robotics · Computer Science 2026-03-03 Yuhang Lin , Jiyuan Shi , Dewei Wang , Jipeng Kong , Yong Liu , Chenjia Bai , Xuelong Li

Twitter bot detection has become an increasingly important and challenging task to combat online misinformation, facilitate social content moderation, and safeguard the integrity of social platforms. Though existing graph-based Twitter bot…

Social and Information Networks · Computer Science 2023-06-23 Sen Ye , Zhaoxuan Tan , Zhenyu Lei , Ruijie He , Hongrui Wang , Qinghua Zheng , Minnan Luo

Generalized robots must learn from diverse, large-scale human-object interactions (HOI) to operate robustly in the real world. Monocular internet videos offer a nearly limitless and readily available source of data, capturing an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Boran Wen , Ye Lu , Sirui Wang , Keyan Wan , Jiahong Zhou , Junxuan Liang , Xinpeng Liu , Bang Xiao , Ruiyang Liu , Yong-Lu Li