English
Related papers

Related papers: Spatio-temporal Relation Modeling for Few-shot Act…

200 papers

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Steve Andreas Immanuel , Hagai Raja Sinulingga

This paper introduces a simple but highly efficient ensemble for robust texture classification, which can effectively deal with translation, scale and changes of significant viewpoint problems. The proposed method first inherits the spirit…

Computer Vision and Pattern Recognition · Computer Science 2012-03-06 Shu Kong , Donghui Wang

Weakly-supervised temporal action localization aims to recognize and localize action segments in untrimmed videos given only video-level action labels for training. Without the boundary information of action segments, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Le Kang , Zhiyu Cheng , Xin Zhou , Abhinav Shrivastava

Spatio-temporal convolution often fails to learn motion dynamics in videos and thus an effective motion representation is required for video understanding in the wild. In this paper, we propose a rich and robust motion representation based…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Heeseung Kwon , Manjin Kim , Suha Kwak , Minsu Cho

Current methods for few-shot action recognition mainly fall into the metric learning framework following ProtoNet, which demonstrates the importance of prototypes. Although they achieve relatively good performance, the effect of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Xinzhe Ni , Yong Liu , Hao Wen , Yatai Ji , Jing Xiao , Yujiu Yang

Human motion prediction (HMP) has emerged as a popular research topic due to its diverse applications, but it remains a challenging task due to the stochastic and aperiodic nature of future poses. Traditional methods rely on hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiexin Wang , Yujie Zhou , Wenwen Qiang , Ying Ba , Bing Su , Ji-Rong Wen

First-person action recognition is a challenging task in video understanding. Because of strong ego-motion and a limited field of view, many backgrounds or noisy frames in a first-person video can distract an action recognition model during…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Lijin Yang , Yifei Huang , Yusuke Sugano , Yoichi Sato

Spatially Resolved Transcriptomics (SRT) is a cutting-edge technique that captures the spatial context of cells within tissues, enabling the study of complex biological networks. Recent graph-based methods leverage both gene expression and…

Machine Learning · Computer Science 2025-06-24 Yunhak Oh , Junseok Lee , Yeongmin Kim , Sangwoo Seo , Namkyeong Lee , Chanyoung Park

Adaptive sampling that exploits the spatiotemporal redundancy in videos is critical for always-on action recognition on wearable devices with limited computing and battery resources. The commonly used fixed sampling strategy is not…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Khoi-Nguyen C. Mac , Minh N. Do , Minh P. Vo

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Tiantian Xie , Pengpai Wang , Rosa H. M. Chan

Advancements in cross-modal feature extraction and integration have significantly enhanced performance in few-shot learning tasks. However, current multi-modal object detection (MM-OD) methods often experience notable performance…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zeyu Shangguan , Daniel Seita , Mohammad Rostami

Video action recognition has made significant strides, but challenges remain in effectively using both spatial and temporal information. While existing methods often focus on either spatial features (e.g., object appearance) or temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Huilin Chen , Lei Wang , Yifan Chen , Tom Gedeon , Piotr Koniusz

Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge.…

Sound · Computer Science 2022-05-27 Chendong Zhao , Jianzong Wang , Leilai Li , Xiaoyang Qu , Jing Xiao

This study addresses the issues of semantic entanglement, unclear label structure, and insufficient feature representation in few-shot text classification, and proposes an optimization framework based on structured prompts to enhance…

Computation and Language · Computer Science 2026-03-02 Jiasen Zheng , Zijun Zhou , Huajun Zhang , Junjiang Lin , Jingyun Jia , Qi Wang

Few-shot relation extraction aims to recognize novel relations with few labeled sentences in each relation. Previous metric-based few-shot relation extraction algorithms identify relationships by comparing the prototypes generated by the…

Computation and Language · Computer Science 2023-05-12 Zhongju Yuan , Zhenkun Wang , Genghui Li

Data scarcity is a common problem in NLP, especially when the annotation pertains to nuanced socio-linguistic concepts that require specialized knowledge. As a result, few-shot identification of these concepts is desirable. Few-shot…

Computation and Language · Computer Science 2023-02-07 Shamik Roy , Nishanth Sridhar Nakshatri , Dan Goldwasser

In this paper we propose a novel Temporal Attentive Relation Network (TARN) for the problems of few-shot and zero-shot action recognition. At the heart of our network is a meta-learning approach that learns to compare representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Mina Bishay , Georgios Zoumpourlis , Ioannis Patras

Recognizing discriminative details such as eyes and beaks is important for distinguishing fine-grained classes since they have similar overall appearances. In this regard, we introduce Task Discrepancy Maximization (TDM), a simple module…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 SuBeen Lee , WonJun Moon , Jae-Pil Heo

Few-Shot Segmentation (FSS) aims to learn class-agnostic segmentation on few classes to segment arbitrary classes, but at the risk of overfitting. To address this, some methods use the well-learned knowledge of foundation models (e.g., SAM)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Qianxiong Xu , Lanyun Zhu , Xuanyi Liu , Guosheng Lin , Cheng Long , Ziyue Li , Rui Zhao