English
Related papers

Related papers: TSPulse: Tiny Pre-Trained Models with Disentangled…

200 papers

Meta-learning represents a strong class of approaches for solving few-shot learning tasks. Nonetheless, recent research suggests that simply pre-training a generic encoder can potentially surpass meta-learning algorithms. In this paper, we…

Machine Learning · Computer Science 2025-03-14 Wei Cui , Tongzi Wu , Jesse C. Cresswell , Yi Sui , Keyvan Golestan

Time series foundation models (TSFMs) promise to be powerful tools for a wide range of applications. However, their internal representations and learned concepts are still not well understood. In this study, we investigate the structure and…

Machine Learning · Computer Science 2025-06-09 Michał Wiliński , Mononito Goswami , Willa Potosnak , Nina Żukowska , Artur Dubrawski

Learning meaningful representations from medical time series (MedTS) such as ECG or EEG signals is a critical challenge. These signals are often high-dimensional, variable-length and rife with noise. Existing self-supervised approaches,…

Machine Learning · Computer Science 2026-05-04 Huayu Li , ZhengXiao He , Xiwen Chen , Jingjing Wang , Siyuan Tian , Jinghao Wen , Ao Li

Unsupervised representation learning approaches aim to learn discriminative feature representations from unlabeled data, without the requirement of annotating every sample. Enabling unsupervised representation learning is extremely crucial…

Machine Learning · Computer Science 2023-08-04 Qianwen Meng , Hangwei Qian , Yong Liu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks. Prior methods are mainly based on pre-training techniques well-acknowledged in vision or…

Machine Learning · Computer Science 2024-06-10 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Yunzhong Qiu , Li Zhang , Jianmin Wang , Mingsheng Long

Time-series data is a vital modality within data science communities. This is particularly valuable in financial applications, where it helps in detecting patterns, understanding market behavior, and making informed decisions based on…

Statistical Finance · Quantitative Finance 2025-06-10 Xueying Ding , Aakriti Mittal , Achintya Gopal

Planning with pretrained diffusion models has emerged as a promising approach for solving test-time guided control problems. Standard gradient guidance typically performs optimally under convex, differentiable reward landscapes. However, it…

Artificial Intelligence · Computer Science 2025-11-11 Hyeonseong Jeon , Cheolhong Min , Jaesik Park

Multivariate Time Series (MTS) forecasting plays a vital role in a wide range of applications. Recently, Spatial-Temporal Graph Neural Networks (STGNNs) have become increasingly popular MTS forecasting methods. STGNNs jointly model the…

Machine Learning · Computer Science 2022-08-17 Zezhi Shao , Zhao Zhang , Fei Wang , Yongjun Xu

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

Diffusion models have achieved state-of-the-art performance in generative modeling tasks across various domains. Prior works on time series diffusion models have primarily focused on developing conditional models tailored to specific…

Machine Learning · Computer Science 2023-11-23 Marcel Kollovieh , Abdul Fatir Ansari , Michael Bohlke-Schneider , Jasper Zschiegner , Hao Wang , Yuyang Wang

Self-supervised learning has garnered increasing attention in time series analysis for benefiting various downstream tasks and reducing reliance on labeled data. Despite its effectiveness, existing methods often struggle to comprehensively…

Machine Learning · Computer Science 2025-06-12 Daoyu Wang , Mingyue Cheng , Zhiding Liu , Qi Liu

Time series data, characterized by its intrinsic long and short-range dependencies, poses a unique challenge across analytical applications. While Transformer-based models excel at capturing long-range dependencies, they face limitations in…

Machine Learning · Computer Science 2024-05-07 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Xiaoli Li

Novel view synthesis from sparse-view inputs poses a significant challenge in 3D computer vision, particularly for achieving high-quality scene reconstructions with limited viewpoints. We introduce TWINGS, a framework that enhances 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hyeseong Kim , Geonhui Son , Deukhee Lee , Dosik Hwang

Zero-shot text-to-speech (TTS) has gained significant attention due to its powerful voice cloning capabilities, requiring only a few seconds of unseen speaker voice prompts. However, all previous work has been developed for cloud-based…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-04 Shengpeng Ji , Ziyue Jiang , Hanting Wang , Jialong Zuo , Zhou Zhao

Reconstructing a sequence of sharp images from the blurry input is crucial for enhancing our insights into the captured scene and poses a significant challenge due to the limited temporal features embedded in the image. Spike cameras,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Kang Chen , Shiyan Chen , Jiyuan Zhang , Baoyue Zhang , Yajing Zheng , Tiejun Huang , Zhaofei Yu

Learning decent representations from unlabeled time-series data with temporal dynamics is a very challenging task. In this paper, we propose an unsupervised Time-Series representation learning framework via Temporal and Contextual…

Machine Learning · Computer Science 2021-06-29 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee Keong Kwoh , Xiaoli Li , Cuntai Guan

Dynamic extensions of 3D Gaussian Splatting (3DGS) achieve high-quality reconstructions through neural motion fields, but per-Gaussian neural inference makes these models computationally expensive. Building on DeformableGS, we introduce…

Graphics · Computer Science 2026-03-31 Allen Tu , Haiyang Ying , Alex Hanson , Yonghan Lee , Tom Goldstein , Matthias Zwicker

Time series forecasting is traditionally dominated by sequence-based architectures such as recurrent neural networks and attention mechanisms, which process all time steps uniformly and often incur substantial computational cost. However,…

Signal Processing · Electrical Eng. & Systems 2026-04-21 K. A. Shahriar

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Diffusion models are the go-to method for Text-to-Image generation, but their iterative denoising processes has high inference latency. Quantization reduces compute time by using lower bitwidths, but applies a fixed precision across all…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Basile Lewandowski , Simon Kurz , Aditya Shankar , Robert Birke , Jian-Jia Chen , Lydia Y. Chen