English
Related papers

Related papers: AimTS: Augmented Series and Image Contrastive Lear…

200 papers

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect time series to uncover…

Machine Learning · Computer Science 2025-10-10 Qinghua Liu , Sam Heshmati , Zheda Mai , Zubin Abraham , John Paparrizos , Liu Ren

Acoustic scene classification (ASC) models on edge devices typically operate under fixed class assumptions, lacking the transferability needed for real-world applications that require adaptation to new or refined acoustic categories. We…

Sound · Computer Science 2026-02-13 Kuang Yuan , Yang Gao , Xilin Li , Xinhao Mei , Syavosh Zadissa , Tarun Pruthi , Saeed Bagheri Sereshki

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Machine Learning · Statistics 2022-03-18 Kristoffer Wickstrøm , Michael Kampffmeyer , Karl Øyvind Mikalsen , Robert Jenssen

Some deep convolutional neural networks were proposed for time-series classification and class imbalanced problems. However, those models performed degraded and even failed to recognize the minority class of an imbalanced temporal sequences…

Machine Learning · Computer Science 2018-01-16 Yue Geng , Xinyu Luo

Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and…

Machine Learning · Computer Science 2024-05-29 Robert Leppich , Vanessa Borst , Veronika Lesch , Samuel Kounev

Time series classification (TSC) is fundamental in numerous domains, including finance, healthcare, and environmental monitoring. However, traditional TSC methods often struggle with the inherent complexity and variability of time series…

Machine Learning · Computer Science 2026-02-06 Marcell T. Kurbucz , Balázs Hajós , Balázs P. Halmos , Vince Á. Molnár , Antal Jakovác

In medical time series disease diagnosis, two key challenges are identified. First, the high annotation cost of medical data leads to overfitting in models trained on label-limited, single-center datasets. To address this, we propose…

Human-Computer Interaction · Computer Science 2025-08-08 Yifan Wang , Hongfeng Ai , Ruiqi Li , Maowei Jiang , Ruiyuan Kang , Jiahua Dong , Cheng Jiang , Chenzhong Li

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

A two-stage training paradigm consisting of sequential pre-training and meta-training stages has been widely used in current few-shot learning (FSL) research. Many of these methods use self-supervised learning and contrastive learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zhanyuan Yang , Jinghua Wang , Yingying Zhu

Deep learning has potential to automate screening, monitoring and grading of disease in medical images. Pretraining with contrastive learning enables models to extract robust and generalisable features from natural image datasets,…

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Text spotting, a task involving the extraction of textual information from image or video sequences, faces challenges in cross-domain adaption, such as image-to-image and image-to-video generalization. In this paper, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yuliang Liu , Mingxin Huang , Hao Yan , Linger Deng , Weijia Wu , Hao Lu , Chunhua Shen , Lianwen Jin , Xiang Bai

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu

Recent advances in deep forecasting models have achieved remarkable performance, yet most approaches still struggle to provide both accurate predictions and interpretable insights into temporal dynamics. This paper proposes CaReTS, a novel…

Machine Learning · Computer Science 2025-11-14 Fulong Yao , Wanqing Zhao , Chao Zheng , Xiaofei Han

Citation classification, which identifies the intention behind academic citations, is pivotal for scholarly analysis. Previous works suggest fine-tuning pretrained language models (PLMs) on citation classification datasets, reaping the…

Computation and Language · Computer Science 2025-05-29 Tong Li , Jiachuan Wang , Yongqi Zhang , Shuangyin Li , Lei Chen

Time series classification is a critical task in various domains, such as finance, healthcare, and sensor data analysis. Unsupervised contrastive learning has garnered significant interest in learning effective representations from time…

Machine Learning · Computer Science 2025-03-24 Huili Cai , Xiang Zhang , Xiaofeng Liu

In this work, we tackle the challenging problem of arbitrary image style transfer using a novel style feature representation learning method. A suitable style representation, as a key component in image stylization tasks, is essential to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yuxin Zhang , Fan Tang , Weiming Dong , Haibin Huang , Chongyang Ma , Tong-Yee Lee , Changsheng Xu

Deep neural networks, including transformers and convolutional neural networks, have significantly improved multivariate time series classification (MTSC). However, these methods often rely on supervised learning, which does not fully…

Machine Learning · Computer Science 2024-05-28 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi