English
Related papers

Related papers: TSPulse: Tiny Pre-Trained Models with Disentangled…

200 papers

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Prompting off-the-shelf Large Language Models (LLMs) demonstrates strong zero-shot TSF capabilities while preserving computational efficiency. However, existing…

Computation and Language · Computer Science 2024-02-27 Haoxin Liu , Zhiyuan Zhao , Jindong Wang , Harshavardhan Kamarthi , B. Aditya Prakash

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Deep model training on extensive datasets is increasingly becoming cost-prohibitive, prompting the widespread adoption of deep model fusion techniques to leverage knowledge from pre-existing models. From simple weight averaging to more…

Machine Learning · Computer Science 2024-08-27 Anke Tang , Li Shen , Yong Luo , Shuai Xie , Han Hu , Lefei Zhang , Bo Du , Dacheng Tao

Time series segmentation (TSS) is one of the time series (TS) analysis techniques, that has received considerably less attention compared to other TS related tasks. In recent years, deep learning architectures have been introduced for TSS,…

Machine Learning · Computer Science 2026-02-20 Ivana Kesić , Carolina Fortuna , Mihael Mohorčič , Blaž Bertalanič

In this paper we develop a method capable of modeling the space-time focusing of nondiffracting pulses. The new pulses can possess arbitrary peak velocities and, in addition to being resistant to diffraction, can have their peak intensities…

Optics · Physics 2016-10-19 Michel Zamboni-Rached , Ioannis M. Besieris

In healthcare applications, temporal variables that encode movement, health status and longitudinal patient evolution are often accompanied by rich structured information such as demographics, diagnostics and medical exam data. However,…

There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a…

Computation and Language · Computer Science 2022-03-18 Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer

The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature. While…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshe Lichtenstein , Prasanna Sattigeri , Rogerio Feris , Raja Giryes , Leonid Karlinsky

This paper proposes a zero-shot text-to-speech (TTS) conditioned by a self-supervised speech-representation model acquired through self-supervised learning (SSL). Conventional methods with embedding vectors from x-vector or global style…

Sound · Computer Science 2023-12-19 Kenichi Fujita , Takanori Ashihara , Hiroki Kanagawa , Takafumi Moriya , Yusuke Ijima

Recent advances in Gaussian Splatting have significantly advanced the field, achieving both panoptic and interactive segmentation of 3D scenes. However, existing methodologies often overlook the critical need for reconstructing specified…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Liang Zhao , Zehan Bao , Yi Xie , Hong Chen , Yaohui Chen , Weifu Li

Learning time-series representations when only unlabeled data or few labeled samples are available can be a challenging task. Recently, contrastive self-supervised learning has shown great improvement in extracting useful representations…

Machine Learning · Computer Science 2023-09-06 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li , Cuntai Guan

Time series, spatial data, and images are natural applications of Neural Processes. However, when such data exhibit strong periodicity and quasi-periodicity, existing methods often suffer from underfitting and generalise poorly beyond the…

Machine Learning · Computer Science 2026-05-12 Xianhe Chen , Hao Chen , Yingzhen Li

Time series foundational models (TSFM) have gained prominence in time series forecasting, promising state-of-the-art performance across various applications. However, their application in anomaly detection and prediction remains…

Machine Learning · Computer Science 2024-12-30 Chathurangi Shyalika , Harleen Kaur Bagga , Ahan Bhatt , Renjith Prasad , Alaa Al Ghazo , Amit Sheth

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density ($n_e$) and electron temperature ($T_e$). Deep neural networks can provide accurate…

Contrastive representation learning is crucial in time series analysis as it alleviates the issue of data noise and incompleteness as well as sparsity of supervision signal. However, existing constrastive learning frameworks usually focus…

Machine Learning · Computer Science 2024-06-26 Haozhi Gao , Qianqian Ren , Jinbao Li

Time-series classification (TSC) has advanced significantly with deep learning, yet most models rely solely on raw numerical inputs, overlooking alternative representations. While texture-based encodings such as Gramian Angular Fields (GAF)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Madhumitha Venkatesan , Xuyang Chen , Dongyu Liu

Time series analysis is used to understand and predict dynamic processes, including evolving demands in business, weather, markets, and biological rhythms. Exponential smoothing is used in all these domains to obtain simple interpretable…

Machine Learning · Statistics 2017-10-02 Avner Abrami , Aleksandr Y. Aravkin , Younghun Kim

Pre-training on time series poses a unique challenge due to the potential mismatch between pre-training and target domains, such as shifts in temporal dynamics, fast-evolving trends, and long-range and short-cyclic effects, which can lead…

Machine Learning · Computer Science 2022-10-18 Xiang Zhang , Ziyuan Zhao , Theodoros Tsiligkaridis , Marinka Zitnik

Texture-space shading (TSS) methods decouple shading and rasterization, allowing shading to be performed at a different framerate and spatial resolution than rasterization. TSS has many potential applications, including streaming shading…

Zero-shot speaker cloning aims to synthesize speech for any target speaker unseen during TTS system building, given only a single speech reference of the speaker at hand. Although more practical in real applications, the current zero-shot…

Sound · Computer Science 2023-10-09 Tao Li , Zhichao Wang , Xinfa Zhu , Jian Cong , Qiao Tian , Yuping Wang , Lei Xie