中文
相关论文

相关论文: Human-Object Interaction Prediction in Videos thro…

200 篇论文

Synthesizing realistic human-object interactions (HOI) in video is challenging due to the complex, instance-specific interaction dynamics of both humans and objects. Incorporating controllability in video generation further adds to the…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Wanyue Zhang , Lin Geng Foo , Thabo Beeler , Rishabh Dabral , Christian Theobalt

Human object interaction (HOI) detection plays a crucial role in human-centric scene understanding and serves as a fundamental building-block for many vision tasks. One generalizable and scalable strategy for HOI detection is to use weak…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Bo Wan , Yongfei Liu , Desen Zhou , Tinne Tuytelaars , Xuming He

While Human-Object Interaction(HOI) Detection has achieved tremendous advances in recent, it still remains challenging due to complex interactions with multiple humans and objects occurring in images, which would inevitably lead to…

计算机视觉与模式识别 · 计算机科学 2022-04-04 Kunlun Xu , Zhimin Li , Zhijun Zhang , Leizhen Dong , Wenhui Xu , Luxin Yan , Sheng Zhong , Xu Zou

Spatio-temporal Human-Object Interaction (ST-HOI) understanding aims at detecting HOIs from videos, which is crucial for activity understanding. However, existing whole-body-object interaction video benchmarks overlook the truth that…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Xiaoyang Liu , Boran Wen , Xinpeng Liu , Zizheng Zhou , Hongwei Fan , Cewu Lu , Lizhuang Ma , Yulong Chen , Yong-Lu Li

Livestreaming often involves interactions between streamers and objects, which is critical for understanding and regulating web content. While human-object interaction (HOI) detection has made some progress in general-purpose video…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Menghui Zhang , Jing Zhang , Lin Chen , Li Zhuo

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

计算机视觉与模式识别 · 计算机科学 2021-05-10 Lu Liu , Robby T. Tan

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has shown great potential in providing interaction prior for HOI…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Shan Ning , Longtian Qiu , Yongfei Liu , Xuming He

We propose CG-HOI, the first method to address the task of generating dynamic 3D human-object interactions (HOIs) from text. We model the motion of both human and object in an interdependent fashion, as semantically rich human motion rarely…

计算机视觉与模式识别 · 计算机科学 2024-05-20 Christian Diller , Angela Dai

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

Cameras are essential vision instruments to capture images for pattern detection and measurement. Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Manli Zhu , Edmond S. L. Ho , Shuang Chen , Longzhi Yang , Hubert P. H. Shum

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

图形学 · 计算机科学 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects. Current HOI models rely on a vocabulary of interactions at training and inference time,…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Francesco Tonini , Alessandro Conti , Lorenzo Vaquero , Cigdem Beyan , Elisa Ricci

Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Yichen Xie , Hao-Shu Fang , Dian Shao , Yong-Lu Li , Cewu Lu

Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches addressed these tasks separately, either by designing highly…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Anshul Gupta , Samy Tafasca , Arya Farkhondeh , Pierre Vuillecard , Jean-Marc Odobez

Human-object interactions (HOI) recognition and pose estimation are two closely related tasks. Human pose is an essential cue for recognizing actions and localizing the interacted objects. Meanwhile, human action and their interacted…

计算机视觉与模式识别 · 计算机科学 2019-03-18 Wei Feng , Wentao Liu , Tong Li , Jing Peng , Chen Qian , Xiaolin Hu

Following the gaze of people inside videos is an important signal for understanding people and their actions. In this paper, we present an approach for following gaze across views by predicting where a particular person is looking…

计算机视觉与模式识别 · 计算机科学 2016-12-12 Adrià Recasens , Carl Vondrick , Aditya Khosla , Antonio Torralba

Analyzing the interactions between humans and objects from a video includes identification of the relationships between humans and the objects present in the video. It can be thought of as a specialized version of Visual Relationship…

计算机视觉与模式识别 · 计算机科学 2020-12-18 Sai Praneeth Reddy Sunkesula , Rishabh Dabral , Ganesh Ramakrishnan

Human-object interaction detection (HOID) refers to localizing interactive human-object pairs in images and identifying the interactions. Since there could be an exponential number of object-action combinations, labeled data is limited -…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Sandipan Sarma , Agney Talwarr , Arijit Sur

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

We present HOIMotion - a novel approach for human motion forecasting during human-object interactions that integrates information about past body poses and egocentric 3D object bounding boxes. Human motion forecasting is important in many…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zhiming Hu , Zheming Yin , Daniel Haeufle , Syn Schmitt , Andreas Bulling