English
Related papers

Related papers: Agglomerative Transformer for Human-Object Interac…

200 papers

Local Transformer-based classification models have recently achieved promising results with relatively low computational costs. However, the effect of aggregating spatial global information of local Transformer-based architecture is not…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Krushi Patel , Andres M. Bur , Fengjun Li , Guanghui Wang

Human activity recognition (HAR) is a crucial area of research that involves understanding human movements using computer and machine vision technology. Deep learning has emerged as a powerful tool for this task, with models such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Mohammad Belal , Taimur Hassan , Abdelfatah Ahmed , Ahmad Aljarah , Nael Alsheikh , Irfan Hussain

Short-Term object-interaction Anticipation (STA) consists of detecting the location of the next-active objects, the noun and verb categories of the interaction, and the time to contact from the observation of egocentric video. We propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lorenzo Mur-Labadia , Ruben Martinez-Cantin , Josechu Guerrero-Campo , Giovanni Maria Farinella

Multi-modal human action segmentation is a critical and challenging task with a wide range of applications. Nowadays, the majority of approaches concentrate on the fusion of dense signals (i.e., RGB, optical flow, and depth maps). However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qi Liu , Xinchen Liu , Kun Liu , Xiaoyan Gu , Wu Liu

3D instance segmentation aims to predict a set of object instances in a scene and represent them as binary foreground masks with corresponding semantic labels. Currently, transformer-based methods are gaining increasing attention due to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Jiahao Lu , Jiacheng Deng , Tianzhu Zhang

In addition to enhancing traffic safety and facilitating prompt emergency response, traffic incident detection plays an indispensable role in intelligent transportation systems by providing real-time traffic status information. This enables…

Machine Learning · Computer Science 2024-03-05 Xinying Lu , Doudou Zhang , Jianli Xiao

Human-Object Interaction (HOI) detection is a task to localize humans and objects in an image and predict the interactions in human-object pairs. In real-world scenarios, HOI detection models need systematic generalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Kentaro Takemoto , Moyuru Yamada , Tomotake Sasaki , Hisanao Akima

Arbitrary-oriented object detection (AOOD) is a challenging task to detect objects in the wild with arbitrary orientations and cluttered arrangements. Existing approaches are mainly based on anchor-based boxes or dense points, which rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Linhui Dai , Hong Liu , Hao Tang , Zhiwei Wu , Pinhao Song

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Short Term object-interaction Anticipation consists in detecting the location of the next active objects, the noun and verb categories of the interaction, as well as the time to contact from the observation of egocentric video. This ability…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lorenzo Mur Labadia , Ruben Martinez-Cantin , Jose J. Guerrero , Giovanni M. Farinella , Antonino Furnari

All-in-one image restoration (AIR) aims to address diverse degradations within a unified model by leveraging informative degradation conditions to guide the restoration process. However, existing methods often rely on implicitly learned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jiawei Wu , Zhifei Yang , Zhe Wang , Zhi Jin

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

Egocentric human-object interaction (Ego-HOI) detection is crucial for intelligent agents to understand and assist human activities from a first-person perspective. However, progress has been hindered by the lack of benchmarks and methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kunyuan Deng , Yi Wang , Lap-Pui Chau

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

We address the challenging task of human reaction generation, which aims to generate a corresponding reaction based on an input action. Most of the existing works do not focus on generating and predicting the reaction and cannot generate…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Baptiste Chopin , Hao Tang , Naima Otberdout , Mohamed Daoudi , Nicu Sebe

Emotional Intelligence in Human-Computer Interaction has attracted increasing attention from researchers in multidisciplinary research fields including psychology, computer vision, neuroscience, artificial intelligence, and related…

Human-Computer Interaction · Computer Science 2020-02-25 Amine Djerghri , Ahmed Rachid Hazourli , Alice Othmani

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Human-Object Interaction (HOI) detection plays a crucial role in activity understanding. Though significant progress has been made, interactiveness learning remains a challenging problem in HOI detection: existing methods usually generate…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Xiaoqian Wu , Yong-Lu Li , Xinpeng Liu , Junyi Zhang , Yuzhe Wu , Cewu Lu

Human-object interaction (HOI) detection plays a key role in high-level visual understanding, facilitating a deep comprehension of human activities. Specifically, HOI detection aims to locate the humans and objects involved in interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yuxiao Wang , Yu Lei , Li Cui , Weiying Xue , Qi Liu , Zhenao Wei

Recently, object detection models have witnessed notable performance improvements, particularly with transformer-based models. However, new objects frequently appear in the real world, requiring detection models to continually learn without…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Duc Thanh Pham , Hong Dang Nguyen , Nhat Minh Nguyen Quoc , Linh Ngo Van , Sang Dinh Viet , Duc Anh Nguyen