English
Related papers

Related papers: Spatial-Temporal Cross-View Contrastive Pre-traini…

200 papers

Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yingjie Feng , Yi Wang , Jiaze Wang , Anfeng Liu , Zhuotao Tian

Ensuring the safety of vulnerable road users through accurate prediction of pedestrian crossing intention (PCI) plays a crucial role in the context of autonomous and assisted driving. Analyzing the set of observation video frames in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hongbin Liang , Hezhe Qiao , Wei Huang , Qizhou Wang , Mingsheng Shang , Lin Chen

Contrastive learning has gained significant attention in skeleton-based action recognition for its ability to learn robust representations from unlabeled data. However, existing methods rely on a single skeleton convention, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Mert Kiray , Alvaro Ritter , Nassir Navab , Benjamin Busam

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

Video representation learning has been successful in video-text pre-training for zero-shot transfer, where each sentence is trained to be close to the paired video clips in a common feature space. For long videos, given a paragraph of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuncong Yang , Jiawei Ma , Shiyuan Huang , Long Chen , Xudong Lin , Guangxing Han , Shih-Fu Chang

Intelligent medical diagnosis has shown remarkable progress based on the large-scale datasets with precise annotations. However, fewer labeled images are available due to significantly expensive cost for annotating data by experts. To fully…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Wentao Lei , Lei Liu , Li Liu

Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and…

Machine Learning · Computer Science 2018-07-13 Bing Yu , Haoteng Yin , Zhanxing Zhu

Predicting the future paths of an agent's neighbors accurately and in a timely manner is central to the autonomous applications for collision avoidance. Conventional approaches, e.g., LSTM-based models, take considerable computational costs…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chengxin Wang , Shaofeng Cai , Gary Tan

The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another.…

Machine Learning · Computer Science 2021-05-18 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Robust prediction of citywide traffic flows at different time periods plays a crucial role in intelligent transportation systems. While previous work has made great efforts to model spatio-temporal correlations, existing methods still…

Machine Learning · Computer Science 2024-03-07 Jiahao Ji , Jingyuan Wang , Chao Huang , Junjie Wu , Boren Xu , Zhenhe Wu , Junbo Zhang , Yu Zheng

Contrastive learning has been frequently investigated to learn effective representations for text clustering tasks. While existing contrastive learning-based text clustering methods only focus on modeling instance-wise semantic similarity…

Computation and Language · Computer Science 2024-08-27 Qian Yong , Chen Chen , Xiabing Zhou

Contrastive learning has shown great potential in video representation learning. However, existing approaches fail to sufficiently exploit short-term motion dynamics, which are crucial to various down-stream video understanding tasks. In…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Jingcheng Ni , Nan Zhou , Jie Qin , Qian Wu , Junqi Liu , Boxun Li , Di Huang

We propose a framework for sequence-to-sequence contrastive learning (SeqCLR) of visual representations, which we apply to text recognition. To account for the sequence-to-sequence structure, each feature map is divided into different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Aviad Aberdam , Ron Litman , Shahar Tsiper , Oron Anschel , Ron Slossberg , Shai Mazor , R. Manmatha , Pietro Perona

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin

Accurate acquisition of crowd flow at Points of Interest (POIs) is pivotal for effective traffic management, public service, and urban planning. Despite this importance, due to the limitations of urban sensing techniques, the data quality…

Machine Learning · Computer Science 2023-09-13 Songyu Ke , Ting Li , Li Song , Yanping Sun , Qintian Sun , Junbo Zhang , Yu Zheng

In the realm of human mobility, the decision-making process for selecting the next-visit location is intricately influenced by a trade-off between spatial and temporal constraints, which are reflective of individual needs and preferences.…

Artificial Intelligence · Computer Science 2023-12-27 Zhaofan Zhang , Yanan Xiao , Lu Jiang , Dingqi Yang , Minghao Yin , Pengyang Wang

Recently, there have been efforts to improve the performance in sign language recognition by designing self-supervised learning methods. However, these methods capture limited information from sign pose data in a frame-wise learning manner,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Weichao Zhao , Wengang Zhou , Hezhen Hu , Min Wang , Houqiang Li

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

Machine Learning · Computer Science 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy

In order to model the evolution of user preference, we should learn user/item embeddings based on time-ordered item purchasing sequences, which is defined as Sequential Recommendation (SR) problem. Existing methods leverage sequential…

Information Retrieval · Computer Science 2021-08-24 Ziwei Fan , Zhiwei Liu , Jiawei Zhang , Yun Xiong , Lei Zheng , Philip S. Yu

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

Machine Learning · Computer Science 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong