中文
相关论文

相关论文: Contrastive Learning for Multimodal Human Activity…

200 篇论文

Cross-modal retrieval has become a highlighted research topic for retrieval across multimedia data such as image and text. A two-stage learning framework is widely adopted by most existing methods based on Deep Neural Network (DNN): The…

多媒体 · 计算机科学 2017-08-09 Yuxin Peng , Jinwei Qi , Xin Huang , Yuxin Yuan

We introduce CommerceMM - a multimodal model capable of providing a diverse and granular understanding of commerce topics associated to the given piece of content (image, text, image+text), and having the capability to generalize to a wide…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Licheng Yu , Jun Chen , Animesh Sinha , Mengjiao MJ Wang , Hugo Chen , Tamara L. Berg , Ning Zhang

In this paper, we propose a self-supervised learning solution for human activity recognition with smartphone accelerometer data. We aim to develop a model that learns strong representations from accelerometer signals, in order to perform…

信号处理 · 电气工程与系统科学 2024-10-28 Setareh Rahimi Taghanaki , Michael Rainbow , Ali Etemad

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Personalized recommender systems play a crucial role in capturing users' evolving preferences over time to provide accurate and effective recommendations on various online platforms. However, many recommendation models rely on a single type…

信息检索 · 计算机科学 2023-10-23 Wei Wei , Lianghao Xia , Chao Huang

Self-supervised learning has proved effective for skeleton-based human action understanding, which is an important yet challenging topic. Previous works mainly rely on contrastive learning or masked motion modeling paradigm to model the…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Jiahang Zhang , Lilang Lin , Jiaying Liu

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

In the realm of ubiquitous computing, Human Activity Recognition (HAR) is vital for the automation and intelligent identification of human actions through data from diverse sensors. However, traditional machine learning approaches by…

机器学习 · 计算机科学 2024-07-18 Ensieh Khazaei , Alireza Esmaeilzehi , Bilal Taha , Dimitrios Hatzinakos

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

机器学习 · 计算机科学 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

For anomaly detection (AD), early approaches often train separate models for individual classes, yielding high performance but posing challenges in scalability and resource management. Recent efforts have shifted toward training a single…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Lei Fan , Junjie Huang , Donglin Di , Anyang Su , Tianyou Song , Maurice Pagnucco , Yang Song

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

Human activity recognition is one of the most important tasks in computer vision and has proved useful in different fields such as healthcare, sports training and security. There are a number of approaches that have been explored to solve…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Sheryl Mathew , Annapoorani Subramanian , Pooja , Balamurugan MS , Manoj Kumar Rajagopal

In this work, we propose a Cross-view Contrastive Learning framework for unsupervised 3D skeleton-based action Representation (CrosSCLR), by leveraging multi-view complementary supervision signal. CrosSCLR consists of both single-view…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Linguo Li , Minsi Wang , Bingbing Ni , Hang Wang , Jiancheng Yang , Wenjun Zhang

Robotic detection of people in crowded and/or cluttered human-centered environments including hospitals, long-term care, stores and airports is challenging as people can become occluded by other people or objects, and deform due to…

机器人学 · 计算机科学 2024-02-15 Angus Fung , Beno Benhabib , Goldie Nejat

Pressure-sensitive smart textiles are widely applied in the fields of healthcare, sports monitoring, and intelligent homes. The integration of devices embedded with pressure sensing arrays is expected to enable comprehensive scene coverage…

信号处理 · 电气工程与系统科学 2024-09-13 Yunkang Zhang , Ziyu Wu , Zhen Liang , Fangting Xie , Quan Wan , Mingjie Zhao , Xiaohui Cai

Image clustering, which involves grouping images into different clusters without labels, is a key task in unsupervised learning. Although previous deep clustering methods have achieved remarkable results, they only explore the intrinsic…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Haixin Zhang , Yongjun Li , Dong Huang

Cross-modal retrieval (CMR) has been extensively applied in various domains, such as multimedia search engines and recommendation systems. Most existing CMR methods focus on image-to-text retrieval, whereas audio-to-text retrieval, a less…

声音 · 计算机科学 2023-09-19 Kaiyi Luo , Xulong Zhang , Jianzong Wang , Huaxiong Li , Ning Cheng , Jing Xiao

Recently, Long Short-Term Memory (LSTM) has become a popular choice to model individual dynamics for single-person action recognition due to its ability of modeling the temporal information in various ranges of dynamic contexts. However,…

计算机视觉与模式识别 · 计算机科学 2022-04-26 Xiangbo Shu

Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises…

信号处理 · 电气工程与系统科学 2021-01-05 Tanvir Mahmud , A. Q. M. Sazzad Sayyed , Shaikh Anowarul Fattah , Sun-Yuan Kung