English
Related papers

Related papers: Transformer-Based Contrastive Meta-Learning For Lo…

200 papers

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

Wearable sensors in Internet of Things (IoT) ecosystems increasingly support applications such as remote health monitoring, elderly care, and smart home automation, all of which rely on robust human activity recognition (HAR). Continual…

Non-autoregressive Transformers (NATs) reduce the inference latency of Autoregressive Transformers (ATs) by predicting words all at once rather than in sequential order. They have achieved remarkable progress in machine translation as well…

Computation and Language · Computer Science 2023-06-05 Chenxin An , Jiangtao Feng , Fei Huang , Xipeng Qiu , Lingpeng Kong

How can we teach a computer to recognize 10,000 different actions? Deep learning has evolved from supervised and unsupervised to self-supervised approaches. In this paper, we present a new contrastive learning-based framework for decision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Mindi Ruan , Xiangxu Yu , Na Zhang , Chuanbo Hu , Shuo Wang , Xin Li

Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evidence that disentangled representations coupled with sparse…

Recent advances in molecular machine learning, especially deep neural networks such as Graph Neural Networks (GNNs) for predicting structure activity relationships (SAR) have shown tremendous potential in computer-aided drug discovery.…

Machine Learning · Computer Science 2022-03-14 Vishal Dey , Raghu Machiraju , Xia Ning

Wearable sensor-based human activity recognition (HAR) has been a research focus in the field of ubiquitous and mobile computing for years. In recent years, many deep models have been applied to HAR problems. However, deep learning methods…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Yujiao Hao , Boyu Wang , Rong Zheng

Unsupervised meta-learning aims to learn generalizable knowledge across a distribution of tasks constructed from unlabeled data. Here, the main challenge is how to construct diverse tasks for meta-learning without label information; recent…

Machine Learning · Computer Science 2023-03-03 Huiwon Jang , Hankook Lee , Jinwoo Shin

Human activity recognition (HAR) in wearable computing is typically based on direct processing of sensor data. Sensor readings are translated into representations, either derived through dedicated preprocessing, or integrated into…

Machine Learning · Computer Science 2023-06-05 Harish Haresamudram , Irfan Essa , Thomas Ploetz

Recent studies in Human Activity Recognition (HAR) have shown that Deep Learning methods are able to outperform classical Machine Learning algorithms. One popular Deep Learning architecture in HAR is the DeepConvLSTM. In this paper we…

Human-Computer Interaction · Computer Science 2023-04-03 Marius Bock , Alexander Hoelzemann , Michael Moeller , Kristof Van Laerhoven

Vision-language-action models have gained significant attention for their ability to model multimodal sequences in embodied instruction following tasks. However, most existing models rely on causal attention, which we find suboptimal for…

Robotics · Computer Science 2026-01-21 Yueen Ma , Dafeng Chi , Shiguang Wu , Yuecheng Liu , Yuzheng Zhuang , Irwin King

Facial Action Unit (AU) detection is a crucial task for emotion analysis from facial movements. The apparent differences of different subjects sometimes mislead changes brought by AUs, resulting in inaccurate results. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jiyuan Cao , Zhilei Liu , Yong Zhang

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Deep learning (DL) techniques are highly effective for defect detection from images. Training DL classification models, however, requires vast amounts of labeled data which is often expensive to collect. In many cases, not only the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Shuai Li , Elisa Bertino , Rih-Teng Wu , Ting-Yan Wu

The primary objective of human activity recognition (HAR) is to infer ongoing human actions from sensor data, a task that finds broad applications in health monitoring, safety protection, and sports analysis. Despite proliferating research,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Hang Xiao , Ying Yu , Jiarui Li , Zhifan Yang , Haotian Tang , Hanyu Liu , Chao Li

Test-time adaptation is a special setting of unsupervised domain adaptation where a trained model on the source domain has to adapt to the target domain without accessing source data. We propose a novel way to leverage self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Dian Chen , Dequan Wang , Trevor Darrell , Sayna Ebrahimi

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

Machine Learning · Computer Science 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Due to its widespread applications, human action recognition is one of the most widely studied research problems in Computer Vision. Recent studies have shown that addressing it using multimodal data leads to superior performance as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Muhammad Bilal Shaikh , Syed Mohammed Shamsul Islam , Douglas Chai , Naveed Akhtar

User dependence remains one of the most difficult general problems in Human Activity Recognition (HAR), in particular when using wearable sensors. This is due to the huge variability of the way different people execute even the simplest…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Sungho Suh , Vitor Fortes Rey , Paul Lukowicz