English
Related papers

Related papers: Scalable Numerical Embeddings for Multivariate Tim…

200 papers

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

Machine Learning · Computer Science 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

Multivariate Time Series Forecasting (MTSF) involves predicting future values of multiple interrelated time series. Recently, deep learning-based MTSF models have gained significant attention for their promising ability to mine semantics…

Machine Learning · Computer Science 2025-06-17 Chengqing Yu , Fei Wang , Chuanguang Yang , Zezhi Shao , Tao Sun , Tangwen Qian , Wei Wei , Zhulin An , Yongjun Xu

We propose $SCONE$ ($S$calable, $C$ontextualized, $O$ffloaded, $N$-gram $E$mbedding), a new method for extending input embedding layers to enhance language model performance. To avoid increased decoding costs, $SCONE$ retains the original…

Computation and Language · Computer Science 2025-10-27 Da Yu , Edith Cohen , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Daogao Liu , Chiyuan Zhang

In recent times, the field of unsupervised representation learning (URL) for time series data has garnered significant interest due to its remarkable adaptability across diverse downstream applications. Unsupervised learning goals differ…

Machine Learning · Computer Science 2025-05-12 Chen Liang , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Zheng Liang , Xiyang Zhang , Jianfeng Huang

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Machine Learning · Computer Science 2023-04-11 Yangjun Ruan , Saurabh Singh , Warren Morningstar , Alexander A. Alemi , Sergey Ioffe , Ian Fischer , Joshua V. Dillon

Medical image segmentation faces critical challenges in semi-supervised learning scenarios due to severe annotation scarcity requiring expert radiological knowledge, significant inter-annotator variability across different viewpoints and…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Zihan Li , Dandan Shan , Yunxiang Li , Paul E. Kinahan , Qingqi Hong

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

Machine Learning · Computer Science 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li

The demand for high-resolution, non-invasive imaging continues to drive innovation in magnetic resonance imaging (MRI), but long acquisition times remain a major practical limitation. Although deep learning-based reconstruction methods have…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Siying Xu , Kerstin Hammernik , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

Running machine learning analytics over geographically distributed datasets is a rapidly arising problem in the world of data management policies ensuring privacy and data security. Visualizing high dimensional data using tools such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-13 Viska Wei , Nikita Ivkin , Vladimir Braverman , Alexander Szalay

Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a single modeling perspective, either treating series data as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Liuqing Chen , Shuhong Xiao , Shixian Ding , Shanhai Hu , Lingyun Sun

Missing data is a major challenge in clinical research. In electronic medical records, often a large fraction of the values in laboratory tests and vital signs are missing. The missingness can lead to biased estimates and limit our ability…

Machine Learning · Computer Science 2023-04-18 Omer Noy , Ron Shamir

Time series data are collected in temporal order and are widely used to train systems for prediction, modeling and classification to name a few. These systems require large amounts of data to improve generalization and prevent over-fitting.…

Signal Processing · Electrical Eng. & Systems 2024-06-26 T. K. M. Lee , H. W. Chan , K. H. Leo , E. Chew , Ling Zhao , S. Sanei

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

Machine Learning · Computer Science 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

We propose Scalable Mechanistic Neural Network (S-MNN), an enhanced neural network framework designed for scientific machine learning applications involving long temporal sequences. By reformulating the original Mechanistic Neural Network…

Machine Learning · Computer Science 2026-05-15 Jiale Chen , Dingling Yao , Adeel Pervez , Dan Alistarh , Francesco Locatello

Time-series analysis is often affected by missing data, a common problem across several fields, including healthcare and environmental monitoring. Multiple Imputation by Chained Equations (MICE) has been prominent for imputing missing…

Machine Learning · Statistics 2026-04-10 Amuche Ibenegbu , Pierre Lafaye de Micheaux , Rohitash Chandra

Despite several signs of progress have been made recently, limited research has been conducted for an inductive setting where embeddings are required for newly unseen nodes -- a setting encountered commonly in practical applications of deep…

Machine Learning · Computer Science 2020-06-23 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

Traditional time series models are task-specific and often depend on dataset-specific training and extensive feature engineering. While Transformer-based architectures have improved scalability, foundation models, commonplace in text,…

Machine Learning · Computer Science 2025-05-21 Utsav Dutta , Sina Khoshfetrat Pakazad , Henrik Ohlsson

Incomplete multi-view clustering presents significant challenges due to missing views. Although many existing graph-based methods aim to recover missing instances or complete similarity matrices with promising results, they still face…

Machine Learning · Computer Science 2025-01-22 Xinxin Wang , Yongshan Zhang , Yicong Zhou

Multivariate time series (MTS) anomaly detection identifies abnormal patterns where each timestamp contains multiple variables. Existing MTS anomaly detection methods fall into three categories: reconstruction-based, prediction-based, and…

Machine Learning · Computer Science 2025-10-03 Yuanyuan Yao , Yuhan Shi , Lu Chen , Ziquan Fang , Yunjun Gao , Leong Hou U , Yushuai Li , Tianyi Li