English
Related papers

Related papers: Short-term Object Interaction Anticipation with Di…

200 papers

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Object detection as part of computer vision can be crucial for traffic management, emergency response, autonomous vehicles, and smart cities. Despite significant advances in object detection, detecting small objects in images captured by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Boshra Khalili , Andrew W. Smyth

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Hand-object interaction detection remains an open challenge in real-time applications, where intuitive user experiences depend on fast and accurate detection of interactions with surrounding objects. We propose an efficient approach for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Antonio Finocchiaro , Alessandro Sebastiano Catinello , Michele Mazzamuto , Rosario Leonardi , Antonino Furnari , Giovanni Maria Farinella

Autonomous driving systems require a quick and robust perception of the nearby environment to carry out their routines effectively. With the aim to avoid collisions and drive safely, autonomous driving systems rely heavily on object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Abdul Hannan Khan , Syed Tahseen Raza Rizvi , Dheeraj Varma Chittari Macharavtu , Andreas Dengel

Most existing Human-Object Interaction~(HOI) Detection methods rely heavily on full annotations with predefined HOI categories, which is limited in diversity and costly to scale further. We aim at advancing zero-shot HOI detection to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Mingrui Wu , Jiaxin Gu , Yunhang Shen , Mingbao Lin , Chao Chen , Xiaoshuai Sun

Anticipating future actions based on spatiotemporal observations is essential in video understanding and predictive computer vision. Moreover, a model capable of anticipating the future has important applications, it can benefit…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tsung-Ming Tai , Giuseppe Fiameni , Cheng-Kuang Lee , Simon See , Oswald Lanz

We propose VISTA, a V-JEPA Integrated StillFast Temporal Anticipator for the Ego4D Short-Term Object Interaction Anticipation (STA) Challenge at EgoVis 2026. Given an egocentric video timestamp, the task requires anticipating the next…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Qiaohui Chu , Haoyu Zhang , Yisen Feng , Meng Liu , Weili Guan , Dongmei Jiang , Liqiang Nie

Locating human-object interaction (HOI) actions within video serves as the foundation for multiple downstream tasks, such as human behavior analysis and human-robot skill transfer. Current temporal action localization methods typically rely…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Erhang Zhang , Junyi Ma , Yin-Dong Zheng , Yixuan Zhou , Hesheng Wang

Human-object interaction (HOI) detection plays a key role in high-level visual understanding, facilitating a deep comprehension of human activities. Specifically, HOI detection aims to locate the humans and objects involved in interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yuxiao Wang , Yu Lei , Li Cui , Weiying Xue , Qi Liu , Zhenao Wei

This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Mu Chen , Minghan Chen , Yi Yang

Every hand-object interaction begins with contact. Despite predicting the contact state between hands and objects is useful in understanding hand-object interactions, prior methods on hand-object analysis have assumed that the interacting…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Takuma Yagi , Md Tasnimul Hasan , Yoichi Sato

Weakly supervised object detection aims at reducing the amount of supervision required to train detection models. Such models are traditionally learned from images/videos labelled only with the object class and not the object bounding box.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Zhenheng Yang , Dhruv Mahajan , Deepti Ghadiyaram , Ram Nevatia , Vignesh Ramanathan

To determine the 3D orientation and 3D location of objects in the surroundings of a camera mounted on a robot or mobile device, we developed two powerful algorithms in object detection and temporal tracking that are combined seamlessly for…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 David Joseph Tan , Nassir Navab , Federico Tombari

Human object interaction (HOI) detection plays a crucial role in human-centric scene understanding and serves as a fundamental building-block for many vision tasks. One generalizable and scalable strategy for HOI detection is to use weak…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Bo Wan , Yongfei Liu , Desen Zhou , Tinne Tuytelaars , Xuming He

Most existing attention prediction research focuses on salient instances like humans and objects. However, the more complex interaction-oriented attention, arising from the comprehension of interactions between instances by human observers,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Yuchen Zhou , Linkai Liu , Chao Gou

Autonomous driving systems require huge amounts of data to train. Manual annotation of this data is time-consuming and prohibitively expensive since it involves human resources. Therefore, active learning emerged as an alternative to ease…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Javad Zolfaghari Bengar , Abel Gonzalez-Garcia , Gabriel Villalonga , Bogdan Raducanu , Hamed H. Aghdam , Mikhail Mozerov , Antonio M. Lopez , Joost van de Weijer

Small object detection (SOD) is a critical yet challenging task in computer vision, with applications like spanning surveillance, autonomous systems, medical imaging, and remote sensing. Unlike larger objects, small objects contain limited…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mahya Nikouei , Bita Baroutian , Shahabedin Nabavi , Fateme Taraghi , Atefe Aghaei , Ayoob Sajedi , Mohsen Ebrahimi Moghaddam

Unlike traditional third-person cameras mounted on robots, a first-person camera, captures a person's visual sensorimotor object interactions from up close. In this paper, we study the tight interplay between our momentary visual attention…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Gedas Bertasius , Hyun Soo Park , Stella X. Yu , Jianbo Shi