English
Related papers

Related papers: Interact-Custom: Customized Human Object Interacti…

200 papers

Humans constantly contact objects to move and perform tasks. Thus, detecting human-object contact is important for building human-centered artificial intelligence. However, there exists no robust method to detect contact between the body…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Yixin Chen , Sai Kumar Dwivedi , Michael J. Black , Dimitrios Tzionas

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

We introduce PersonaHOI, a training- and tuning-free framework that fuses a general StableDiffusion model with a personalized face diffusion (PFD) model to generate identity-consistent human-object interaction (HOI) images. While existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Xinting Hu , Haoran Wang , Jan Eric Lenssen , Bernt Schiele

Human-object interaction (HOI) detection has seen advancements with Vision Language Models (VLMs), but these methods often depend on extensive manual annotations. Vision Large Language Models (VLLMs) can inherently recognize and reason…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianjun Gao , Chen Cai , Ruoyu Wang , Wenyang Liu , Kim-Hui Yap , Kratika Garg , Boon-Siew Han

Hand-Object Interaction (HOI) generation has significant application potential. However, current 3D HOI motion generation approaches heavily rely on predefined 3D object models and lab-captured motion data, limiting generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Lingwei Dang , Ruizhi Shao , Hongwen Zhang , Wei Min , Yebin Liu , Qingyao Wu

Video-based human-object interaction (HOI) understanding requires both detecting ongoing interactions and anticipating their future evolution. However, existing methods usually treat anticipation as a downstream forecasting task built on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuanhao Luo , Di Wen , Kunyu Peng , Ruiping Liu , Junwei Zheng , Yufan Chen , Jiale Wei , Rainer Stiefelhage

Human image generation is a very challenging task since it is affected by many factors. Many human image generation methods focus on generating human images conditioned on a given pose, while the generated backgrounds are often blurred.In…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dong Liang , Rui Wang , Xiaowei Tian , Cong Zou

We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Stéphane Lathuilière , Enver Sangineto , Aliaksandr Siarohin , Nicu Sebe

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly understanding complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 A S M Iftekhar , Satish Kumar , R. Austin McEver , Suya You , B. S. Manjunath

Image customization, a crucial technique for industrial media production, aims to generate content that is consistent with reference images. However, current approaches conventionally separate image customization into position-aware and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yaowei Li , Xiaoyu Li , Zhaoyang Zhang , Yuxuan Bian , Gan Liu , Xinyuan Li , Jiale Xu , Wenbo Hu , Yating Liu , Lingen Li , Jing Cai , Yuexian Zou , Yancheng He , Ying Shan

Most existing attention prediction research focuses on salient instances like humans and objects. However, the more complex interaction-oriented attention, arising from the comprehension of interactions between instances by human observers,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Yuchen Zhou , Linkai Liu , Chao Gou

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Whole-body Humanoid-Object Interaction (HOI) is bottlenecked by the scarcity of high-fidelity 3D data. While video generative priors offer a promising alternative, existing methods suffer from \textit{Representation Misalignment} due to…

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

Despite significant progress, controlled generation of complex images with interacting people remains difficult. Existing layout generation methods fall short of synthesizing realistic person instances; while pose-guided generation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Weidong Yin , Ziwei Liu , Leonid Sigal

This study introduces an adaptive user interface generation technology, emphasizing the role of Human-Computer Interaction (HCI) in optimizing user experience. By focusing on enhancing the interaction between users and intelligent systems,…

Human-Computer Interaction · Computer Science 2024-12-24 Qi Sun , Yayun Xue , Zhijun Song

Physics-based humanoid control has achieved remarkable progress in enabling realistic and high-performing single-agent behaviors, yet extending these capabilities to cooperative human-object interaction (HOI) remains challenging. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Stefan Lionar , Gim Hee Lee

Human-Object Interaction (HOI) detection plays a crucial role in activity understanding. Though significant progress has been made, interactiveness learning remains a challenging problem in HOI detection: existing methods usually generate…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Xiaoqian Wu , Yong-Lu Li , Xinpeng Liu , Junyi Zhang , Yuzhe Wu , Cewu Lu

Modeling 4D human-object interaction (HOI) is a compelling challenge in computer vision and an essential technology powering virtual and mixed-reality applications. While existing works have achieved promising results on specific HOI…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Mengfei Zhang , Jinlu Zhang , Zhigang Tu