English
Related papers

Related papers: UTICA: Multi-Objective Self-Distllation Foundation…

200 papers

Self-supervised pre-training strategies have recently shown impressive results for training general-purpose feature extraction backbones in computer vision. In combination with the Vision Transformer architecture, the DINO self-distillation…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Alexander Koenig , Maximilian Schambach , Johannes Otterbach

Point cloud classification is a popular task in 3D vision. However, previous works, usually assume that point clouds at test time are obtained with the same procedure or sensor as those at training time. Unsupervised Domain Adaptation (UDA)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Unsupervised Contrastive learning has gained prominence in fields such as vision, and biology, leveraging predefined positive/negative samples for representation learning. Data augmentation, categorized into hand-designed and model-based…

Machine Learning · Computer Science 2024-05-28 Zelin Zang , Hao Luo , Kai Wang , Panpan Zhang , Fan Wang , Stan. Z Li , Yang You

Scientific time series are central to scientific AI but are typically sparse, highly heterogeneous, and limited in scale, making unified representation learning particularly challenging. Meanwhile, foundation models pretrained on relevant…

Machine Learning · Computer Science 2026-03-20 Chen Zhang , Liwei Liu , Jun Tao , Xiaoyu Yang , Xuenan Xu , Kai Chen , Bowen Zhou , Wen Wu , Chao Zhang

Time-unconditional generative models learn time-independent denoising vector fields. But without time conditioning, the same noisy input may correspond to multiple noise levels and different denoising directions, which interferes with the…

Machine Learning · Computer Science 2026-02-04 Zimo Wang , Ishit Mehta , Haolin Lu , Chung-En Sun , Ge Yan , Tsui-Wei Weng , Tzu-Mao Li

Machine learning has emerged as a powerful tool for time series analysis. Existing methods are usually customized for different analysis tasks and face challenges in tackling practical problems such as partial labeling and domain shift. To…

Machine Learning · Computer Science 2024-08-20 Zhiyu Liang , Chen Liang , Zheng Liang , Hongzhi Wang , Bo Zheng

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

Face deepfake detection has seen impressive results recently. Nearly all existing deep learning techniques for face deepfake detection are fully supervised and require labels during training. In this paper, we design a novel deepfake…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Sheldon Fung , Xuequan Lu , Chao Zhang , Chang-Tsun Li

Self-supervised representation learning has shown significant improvement in Natural Language Processing and 2D Computer Vision. However, existing methods face difficulties in representing 3D data because of its unordered and uneven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Pengbo Li , Yiding Sun , Haozhe Cheng

Causal discovery from time series data encompasses many existing solutions, including those based on deep learning techniques. However, these methods typically do not endorse one of the most prevalent paradigms in deep learning: End-to-end…

Machine Learning · Computer Science 2024-02-15 Gideon Stein , Maha Shadaydeh , Joachim Denzler

Deep neural networks, including transformers and convolutional neural networks, have significantly improved multivariate time series classification (MTSC). However, these methods often rely on supervised learning, which does not fully…

Machine Learning · Computer Science 2024-05-28 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

Deep time series metric learning is challenging due to the difficult trade-off between temporal invariance to nonlinear distortion and discriminative power in identifying non-matching sequences. This paper proposes a novel neural…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Shinnosuke Matsuo , Xiaomeng Wu , Gantugs Atarsaikhan , Akisato Kimura , Kunio Kashino , Brian Kenji Iwana , Seiichi Uchida

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

Self-supervised learning (SSL) has made rapid progress, yet learned features often over-rely on contextual shortcuts-background textures and co-occurrence statistics. While video provides rich temporal variation, dense in-the-wild streams…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Seul-Ki Yeom , Marcel Simon , Eunbin Lee , Tae-Ho Kim

Analyzing time series data is crucial to a wide spectrum of applications, including economics, online marketplaces, and human healthcare. In particular, time series classification plays an indispensable role in segmenting different phases…

Machine Learning · Computer Science 2025-05-12 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Hao Wang , Huayu Li , Zihan Li , Yalin Wang , Aristeidis Sotiras , Abolfazl Razi

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Fundus photography is the primary method for retinal imaging and essential for diabetic retinopathy prevention. Automated segmentation of fundus photographs would improve the quality, capacity, and cost-effectiveness of eye care screening…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Jan Kukačka , Anja Zenz , Marcel Kollovieh , Dominik Jüstel , Vasilis Ntziachristos

Time series anomaly detection holds notable importance for risk identification and fault detection across diverse application domains. Unsupervised learning methods have become popular because they have no requirement for labels. However,…

Machine Learning · Computer Science 2025-05-05 Wenxin Zhang , Xiaojian Lin , Wenjun Yu , Guangzhen Yao , jingxiang Zhong , Yu Li , Renda Han , Songcheng Xu , Hao Shi , Cuicui Luo

Deep learning models are widely used for time series classification (TSC) due to their scalability and efficiency. However, their performance degrades under challenging data conditions such as class similarity, multimodal distributions, and…

Machine Learning · Computer Science 2025-07-30 Yaoyu Zhang , Chi-Guhn Lee