English
Related papers

Related papers: Scalable Numerical Embeddings for Multivariate Tim…

200 papers

Multiple Sclerosis (MS) is a chronic disease characterized by progressive or alternate impairment of neurological functions (motor, sensory, visual, and cognitive). Predicting disease progression with a probabilistic and time-dependent…

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

Test-time compute scaling has emerged as a powerful paradigm for enhancing mathematical reasoning in large language models (LLMs) by allocating additional computational resources during inference. However, current methods employ uniform…

Computation and Language · Computer Science 2025-12-02 Yang Xiao , Chunpu Xu , Ruifeng Yuan , Jiashuo Wang , Wenjie Li , Pengfei Liu

Irregular Multivariate Time Series (IMTS) forecasting is challenging due to the unaligned nature of multi-channel signals and the prevalence of extensive missing data. Existing methods struggle to capture reliable temporal patterns from…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Zhangyi Hu , Jiemin Wu , Hua Xu , Mingqian Liao , Ninghui Feng , Bo Gao , Songning Lai , Yutao Yue

Spiking Neural Networks (SNNs), as a biologically plausible alternative to Artificial Neural Networks (ANNs), have demonstrated advantages in terms of energy efficiency, temporal processing, and biological plausibility. However, SNNs are…

Machine Learning · Computer Science 2025-09-22 Xinyu Luo , Kecheng Chen , Pao-Sheng Vincent Sun , Chris Xing Tian , Arindam Basu , Haoliang Li

Environmental monitoring is crucial to our understanding of climate change, biodiversity loss and pollution. The availability of large-scale spatio-temporal data from sources such as sensors and satellites allows us to develop sophisticated…

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

Machine Learning · Computer Science 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu

Scientific discovery increasingly requires learning on federated datasets, fed by streams from high-resolution instruments, that have extreme class imbalance. Current ML approaches either require impractical data aggregation or fail due to…

Machine Learning · Computer Science 2026-03-16 Md Anwar Hossen , Nathan R. Tallent , Luanzheng Guo , Ali Jannesary

Multivariate Time Series (MTS) forecasting plays a vital role in a wide range of applications. Recently, Spatial-Temporal Graph Neural Networks (STGNNs) have become increasingly popular MTS forecasting methods due to their state-of-the-art…

Machine Learning · Computer Science 2022-08-22 Zezhi Shao , Zhao Zhang , Fei Wang , Wei Wei , Yongjun Xu

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang

Real-world time series often exhibit strong non-stationarity, complex nonlinear dynamics, and behavior expressed across multiple temporal scales, from rapid local fluctuations to slow-evolving long-range trends. However, many contemporary…

Machine Learning · Computer Science 2026-05-19 Sumit S Shevtekar , Chandresh K Maurya

Recent foundation models are capable of handling multiple tasks and multiple data modalities with the unified base model structure and several specialized model components. However, efficient training of such multi-task (MT) multi-modal…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-12 Yujie Wang , Shenhan Zhu , Fangcheng Fu , Xupeng Miao , Jie Zhang , Juan Zhu , Fan Hong , Yong Li , Bin Cui

Data mining, particularly the analysis of multivariate time series data, plays a crucial role in extracting insights from complex systems and supporting informed decision-making across diverse domains. However, assessing the similarity of…

Machine Learning · Computer Science 2025-07-15 Franck Tonle , Henri Tonnang , Milliam Ndadji , Maurice Tchendji , Armand Nzeukou , Kennedy Senagi , Saliou Niassy

An increasing number of multi-view data are being published by studies in several fields. This type of data corresponds to multiple data-views, each representing a different aspect of the same set of samples. We have recently proposed…

Machine Learning · Computer Science 2021-11-08 Theodoulos Rodosthenous , Vahid Shahrezaei , Marina Evangelou

The ubiquity of dynamic data in domains such as weather, healthcare, and energy underscores a growing need for effective interpretation and retrieval of time-series data. These data are inherently tied to domain-specific contexts, such as…

Machine Learning · Computer Science 2026-02-03 Jialin Chen , Ziyu Zhao , Gaukhar Nurbek , Aosong Feng , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

Time Series Foundation Models (TSFMs) excel at numerical forecasting but operate as black boxes lacking qualitative reasoning. Conversely, applying LLMs directly to temporal data introduces a modality gap: text tokenizers fragment…

Machine Learning · Computer Science 2026-05-12 Md Atik Ahamed , Mihir Parmar , Palash Goyal , Chun-Liang Li , Qiang Cheng , Tomas Pfister , Jinsung Yoon

Multivariate time series present challenges to standard machine learning techniques, as they are often unlabeled, high dimensional, noisy, and contain missing data. To address this, we propose T-Rep, a self-supervised method to learn time…

Machine Learning · Computer Science 2024-05-10 Archibald Fraikin , Adrien Bennetot , Stéphanie Allassonnière

Shared embedding spaces are widely used for multimodal search and data curation. In practice, two problems often limit how well this works. First, embeddings can reflect modality more than meaning, so examples cluster by input type even…

Information Retrieval · Computer Science 2026-05-05 Pratyush Muthukumar , Harshil Kotamreddy , Sarah Amiraslani , Tomo Kanazawa , Ramani Akkati , Shaan Jain , Andrew Mathau

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabelled data is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yezhen Cong , Samar Khanna , Chenlin Meng , Patrick Liu , Erik Rozi , Yutong He , Marshall Burke , David B. Lobell , Stefano Ermon

Mobile technology enables unprecedented continuous monitoring of an individual's behavior, social interactions, symptoms, and other health conditions, presenting an enormous opportunity for therapeutic advancements and scientific…