English
Related papers

Related papers: TMHOI: Translational Model for Human-Object Intera…

200 papers

Amodal completion, which is the process of inferring the full appearance of objects despite partial occlusions, is crucial for understanding complex human-object interactions (HOI) in computer vision and robotics. Existing methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Seunggeun Chi , Enna Sachdeva , Pin-Hao Huang , Kwonjoon Lee

Large-scale text-to-image (T2I) diffusion models have showcased incredible capabilities in generating coherent images based on textual descriptions, enabling vast applications in content generation. While recent advancements have introduced…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiun Tian Hoe , Xudong Jiang , Chee Seng Chan , Yap-Peng Tan , Weipeng Hu

We address the challenging task of text-driven 3D human-object interaction (HOI) motion generation. Existing methods primarily rely on a direct text-to-HOI mapping, which suffers from three key limitations due to the significant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yin Wang , Ziyao Zhang , Zhiying Leng , Haitian Liu , Frederick W. B. Li , Mu Li , Xiaohui Liang

Egocentric human-object interaction (Ego-HOI) detection is crucial for intelligent agents to understand and assist human activities from a first-person perspective. However, progress has been hindered by the lack of benchmarks and methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kunyuan Deng , Yi Wang , Lap-Pui Chau

Human-object interaction (HOI) synthesis is crucial for creating immersive and realistic experiences for applications such as virtual reality. Existing methods often rely on simplified object representations, such as the object's centroid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Mengqing Xue , Yifei Liu , Ling Guo , Shaoli Huang , Changxing Ding

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Recovering 3D Human-Object Interaction (HOI) from single color images is challenging due to depth ambiguities, occlusions, and the huge variation in object shape and appearance. Thus, past work requires controlled settings such as known…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Alpár Cseke , Shashank Tripathi , Sai Kumar Dwivedi , Arjun Lakshmipathy , Agniv Chatterjee , Michael J. Black , Dimitrios Tzionas

Human-Object Interaction (HOI) detection, which localizes and infers relationships between human and objects, plays an important role in scene understanding. Although two-stage HOI detectors have advantages of high efficiency in training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jeeseung Park , Jin-Woo Park , Jong-Seok Lee

Existing hand-object interactions (HOI) methods are largely limited to rigid objects, while 4D reconstruction methods of articulated objects generally require pre-scanning the object or even multi-view videos. It remains an unexplored but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zikai Wang , Zhilu Zhang , Yiqing Wang , Hui Li , Wangmeng Zuo

Human-object contact (HOT) is designed to accurately identify the areas where humans and objects come into contact. Current methods frequently fail to account for scenarios where objects are frequently blocking the view, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxiao Wang , Wenpeng Neng , Zhenao Wei , Yu Lei , Weiying Xue , Nan Zhuang , Yanwu Xu , Xinyu Jiang , Qi Liu

Gaze plays a crucial role in revealing human attention and intention, particularly in hand-object interaction scenarios, where it guides and synchronizes complex tasks that require precise coordination between the brain, hand, and object.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jie Tian , Ran Ji , Lingxiao Yang , Suting Ni , Yuexin Ma , Lan Xu , Jingyi Yu , Ye Shi , Jingya Wang

Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Xinpeng Liu , Yong-Lu Li , Xiaoqian Wu , Yu-Wing Tai , Cewu Lu , Chi-Keung Tang

The goal of this paper is Human-object Interaction (HO-I) detection. HO-I detection aims to find interacting human-objects regions and classify their interaction from an image. Researchers obtain significant improvement in recent years by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Mert Kilickaya , Arnold Smeulders

Recent human-object interaction detection (HOID) methods highly require prior knowledge from vision-language models (VLMs) to enhance the interaction recognition capabilities. The training strategies and model architectures for connecting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Junwen Chen , Peilin Xiong , Keiji Yanai

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

Human-Object interaction (HOI) detection aims to localize and infer relationships between human and objects in an image. It is challenging because an enormous number of possible combinations of objects and verbs types forms a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhi Hou , Xiaojiang Peng , Yu Qiao , Dacheng Tao

We propose a single-stage Human-Object Interaction (HOI) detection method that has outperformed all existing methods on HICO-DET dataset at 37 fps on a single Titan XP GPU. It is the first real-time HOI detection method. Conventional HOI…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Yue Liao , Si Liu , Fei Wang , Yanjie Chen , Chen Qian , Jiashi Feng

Generating realistic 3D human-object interactions (HOIs) from text descriptions is a active research topic with potential applications in virtual and augmented reality, robotics, and animation. However, creating high-quality 3D HOIs remains…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yixuan Zhang , Hui Yang , Chuanchen Luo , Junran Peng , Yuxi Wang , Zhaoxiang Zhang

Physics-based humanoid control has achieved remarkable progress in enabling realistic and high-performing single-agent behaviors, yet extending these capabilities to cooperative human-object interaction (HOI) remains challenging. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Stefan Lionar , Gim Hee Lee

Reconstructing 3D Human-Object Interaction from an RGB image is essential for perceptive systems. Yet, this remains challenging as it requires capturing the subtle physical coupling between the body and objects. While current methods rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Dimitrije Antić , Alvaro Budria , George Paschalidis , Sai Kumar Dwivedi , Dimitrios Tzionas