English
Related papers

Related papers: STARS: Self-supervised Tuning for 3D Action Recogn…

200 papers

We develop a novel learning scheme named Self-Prediction for 3D instance and semantic segmentation of point clouds. Distinct from most existing methods that focus on designing convolutional operators, our method designs a new learning…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Jinxian Liu , Minghui Yu , Bingbing Ni , Ye Chen

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

Thermal infrared (TIR) target tracking methods often adopt the correlation filter (CF) framework due to its computational efficiency. However, the low resolution of TIR images, along with tracking interference, significantly limits the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shang Zhang , Xiaobo Ding , Huanbin Zhang , Ruoyan Xiong , Yue Zhang

While supervised object detection methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this in scenarios where annotating data is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Isinsu Katircioglu , Helge Rhodin , Victor Constantin , Jörg Spörri , Mathieu Salzmann , Pascal Fua

In recent years, zero-shot learning has attracted the focus of many researchers, due to its flexibility and generality. Many approaches have been proposed to achieve the zero-shot classification of the point clouds for 3D object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Zidi Cao , Weibo Zheng , Xiangguo Zhou , Xiangjian He , Yuanfang Zhang , Daisen Wei

This paper tackles the challenging problem of estimating the intensity of Facial Action Units with few labeled images. Contrary to previous works, our method does not require to manually select key frames, and produces state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Enrique Sanchez , Adrian Bulat , Anestis Zaganidis , Georgios Tzimiropoulos

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Human action recognition is a crucial task for intelligent robotics, particularly within the context of human-robot collaboration research. In self-supervised skeleton-based action recognition, the mask-based reconstruction paradigm learns…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wei Wei , Shaojie Zhang , Yonghao Dang , Jianqin Yin

To date, various 3D scene understanding tasks still lack practical and generalizable pre-trained models, primarily due to the intricate nature of 3D scene understanding tasks and their immense variations introduced by camera views,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Siyuan Huang , Yichen Xie , Song-Chun Zhu , Yixin Zhu

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consistency across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bin Yang , Mohamed Abdelsamad , Miao Zhang , Alexandru Paul Condurache

Semantic segmentation and activity classification are key components to creating intelligent surgical systems able to understand and assist clinical workflow. In the Operating Room, semantic segmentation is at the core of creating robots…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Idris Hamoud , Alexandros Karargyris , Aidean Sharghi , Omid Mohareri , Nicolas Padoy

We propose an unsupervised adaptation framework, Self-TAught Recognizer (STAR), which leverages unlabeled data to enhance the robustness of automatic speech recognition (ASR) systems in diverse target domains, such as noise and accents.…

Computation and Language · Computer Science 2024-05-24 Yuchen Hu , Chen Chen , Chao-Han Huck Yang , Chengwei Qin , Pin-Yu Chen , Eng Siong Chng , Chao Zhang

Self-supervised music foundation models underperform on key detection, which requires pitch-sensitive representations. In this work, we present the first systematic study showing that the design of self-supervised pretraining directly…

Sound · Computer Science 2026-04-14 Ori Yonay , Tracy Hammond , Tianbao Yang

To integrate action recognition into autonomous robotic systems, it is essential to address challenges such as person occlusions-a common yet often overlooked scenario in existing self-supervised skeleton-based action recognition methods.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yifei Chen , Kunyu Peng , Alina Roitberg , David Schneider , Jiaming Zhang , Junwei Zheng , Yufan Chen , Ruiping Liu , Kailun Yang , Rainer Stiefelhagen

Gesture is an important mean of non-verbal communication, with visual modality allows human to convey information during interaction, facilitating peoples and human-machine interactions. However, it is considered difficult to automatically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Fabien Allemand , Alessio Mazzela , Jun Villette , Decky Aspandi , Titus Zaharia

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Self-supervised learning presents a remarkable performance to utilize unlabeled data for various video tasks. In this paper, we focus on applying the power of self-supervised methods to improve semi-supervised action proposal generation.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Yuanjie Shao , Changxin Gao , Nong Sang

This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips each consisting of several…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Qiuhong Ke , Mohammed Bennamoun , Senjian An , Ferdous Sohel , Farid Boussaid