中文
相关论文

相关论文: Contrastive Learning for Multimodal Human Activity…

200 篇论文

Human Activity Recognition (HAR) aims to recognize activities by training models on massive sensor data. In real-world deployment, a crucial aspect of HAR that has been largely overlooked is that the test sets may have different…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Di Xiong , Shuoyuan Wang , Lei Zhang , Wenbo Huang , Chaolei Han

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Learning representations that transfer well to diverse downstream tasks remains a central challenge in representation learning. Existing paradigms -- contrastive learning, self-supervised masking, and denoising auto-encoders -- balance this…

机器学习 · 计算机科学 2025-09-29 Micha Livne

In business analysis, providing effective recommendations is essential for enhancing company profits. The utilization of graph-based structures, such as bipartite graphs, has gained popularity for their ability to analyze complex data…

信息检索 · 计算机科学 2025-01-14 Jiayang Wu , Wensheng Gan , Huashen Lu , Philip S. Yu

Recently, multi-view and multi-label classification have become significant domains for comprehensive data analysis and exploration. However, incompleteness both in views and labels is still a real-world scenario for multi-view multi-label…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Bingyan Nie , Wulin Xie , Jiang Long , Xiaohuan Lu

For pursuing accurate skeleton-based action recognition, most prior methods use the strategy of combining Graph Convolution Networks (GCNs) with attention-based methods in a serial way. However, they regard the human skeleton as a complete…

计算机视觉与模式识别 · 计算机科学 2023-01-30 Chen Pang , Xuequan Lu , Lei Lyu

Human Activity Recognition has gained significant attention due to its diverse applications, including ambient assisted living and remote sensing. Wearable sensor-based solutions often suffer from user discomfort and reliability issues,…

The self-supervised pretraining paradigm has achieved great success in skeleton-based action recognition. However, these methods treat the motion and static parts equally, and lack an adaptive design for different parts, which has a…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Lilang Lin , Jiahang Zhang , Jiaying Liu

Driven by large-scale contrastive vision-language pre-trained models such as CLIP, recent advancements in the image-text matching task have achieved remarkable success in representation learning. Due to image-level visual-language…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Mengxiao Tian , Xinxiao Wu , Shuo Yang

In spite of the great progress in human motion prediction, it is still a challenging task to predict those aperiodic and complicated motions. We believe that to capture the correlations among human body components is the key to understand…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Honghong Zhou , Caili Guo , Hao Zhang , Yanjun Wang

Generalist Vision-Language-Action models are currently hindered by the scarcity of robotic data compared to the abundance of human video demonstrations. Existing Latent Action Models attempt to leverage video data but often suffer from…

机器人学 · 计算机科学 2026-01-08 Chubin Zhang , Jianan Wang , Zifeng Gao , Yue Su , Tianru Dai , Cai Zhou , Jiwen Lu , Yansong Tang

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

The acquisition of large-scale, precisely labeled datasets for person re-identification (ReID) poses a significant challenge. Weakly supervised ReID has begun to address this issue, although its performance lags behind fully supervised…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Jacob Tyo , Zachary C. Lipton

WiFi Channel State Information (CSI)-based activity recognition has sparked numerous studies due to its widespread availability and privacy protection. However, when applied in practical applications, general CSI-based recognition models…

网络与互联网体系结构 · 计算机科学 2024-08-13 Chunjing Xiao , Yanhui Han , Wei Yang , Yane Hou , Fangzhan Shi , Kevin Chetty

Smart mobile devices have become indispensable in modern daily life, where sensitive information is frequently processed, stored, and transmitted-posing critical demands for robust security controls. Given that touchscreens are the primary…

密码学与安全 · 计算机科学 2025-04-25 Mengyu Qiao , Yunpeng Zhai , Yang Wang

The underlying correlation between audio and visual modalities can be utilized to learn supervised information for unlabeled videos. In this paper, we propose an end-to-end self-supervised framework named Audio-Visual Contrastive Learning…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Yang Liu , Ying Tan , Haoyuan Lan

Multi-modal Contrastive Representation learning aims to encode different modalities into a semantically aligned shared space. This paradigm shows remarkable generalization ability on numerous downstream tasks across various modalities.…

机器学习 · 计算机科学 2023-10-20 Zehan Wang , Yang Zhao , Xize Cheng , Haifeng Huang , Jiageng Liu , Li Tang , Linjun Li , Yongqi Wang , Aoxiong Yin , Ziang Zhang , Zhou Zhao

The pre-training for language models captures general language understanding but fails to distinguish the affective impact of a particular context to a specific word. Recent works have sought to introduce contrastive learning (CL) for…

计算与语言 · 计算机科学 2024-05-06 Jin Wang , Liang-Chih Yu , Xuejie Zhang

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

机器学习 · 计算机科学 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang