中文
相关论文

相关论文: Scalable Numerical Embeddings for Multivariate Tim…

200 篇论文

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

机器学习 · 计算机科学 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

机器学习 · 计算机科学 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

Multivariate Time Series Forecasting (MTSF) involves predicting future values of multiple interrelated time series. Recently, deep learning-based MTSF models have gained significant attention for their promising ability to mine semantics…

机器学习 · 计算机科学 2025-06-17 Chengqing Yu , Fei Wang , Chuanguang Yang , Zezhi Shao , Tao Sun , Tangwen Qian , Wei Wei , Zhulin An , Yongjun Xu

We propose $SCONE$ ($S$calable, $C$ontextualized, $O$ffloaded, $N$-gram $E$mbedding), a new method for extending input embedding layers to enhance language model performance. To avoid increased decoding costs, $SCONE$ retains the original…

计算与语言 · 计算机科学 2025-10-27 Da Yu , Edith Cohen , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Daogao Liu , Chiyuan Zhang

In recent times, the field of unsupervised representation learning (URL) for time series data has garnered significant interest due to its remarkable adaptability across diverse downstream applications. Unsupervised learning goals differ…

机器学习 · 计算机科学 2025-05-12 Chen Liang , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Zheng Liang , Xiyang Zhang , Jianfeng Huang

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Medical image segmentation faces critical challenges in semi-supervised learning scenarios due to severe annotation scarcity requiring expert radiological knowledge, significant inter-annotator variability across different viewpoints and…

图像与视频处理 · 电气工程与系统科学 2026-01-06 Zihan Li , Dandan Shan , Yunxiang Li , Paul E. Kinahan , Qingqi Hong

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

机器学习 · 计算机科学 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li

The demand for high-resolution, non-invasive imaging continues to drive innovation in magnetic resonance imaging (MRI), but long acquisition times remain a major practical limitation. Although deep learning-based reconstruction methods have…

图像与视频处理 · 电气工程与系统科学 2026-05-07 Siying Xu , Kerstin Hammernik , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

Running machine learning analytics over geographically distributed datasets is a rapidly arising problem in the world of data management policies ensuring privacy and data security. Visualizing high dimensional data using tools such as…

分布式、并行与集群计算 · 计算机科学 2020-11-13 Viska Wei , Nikita Ivkin , Vladimir Braverman , Alexander Szalay

Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a single modeling perspective, either treating series data as…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Liuqing Chen , Shuhong Xiao , Shixian Ding , Shanhai Hu , Lingyun Sun

Missing data is a major challenge in clinical research. In electronic medical records, often a large fraction of the values in laboratory tests and vital signs are missing. The missingness can lead to biased estimates and limit our ability…

机器学习 · 计算机科学 2023-04-18 Omer Noy , Ron Shamir

Time series data are collected in temporal order and are widely used to train systems for prediction, modeling and classification to name a few. These systems require large amounts of data to improve generalization and prevent over-fitting.…

信号处理 · 电气工程与系统科学 2024-06-26 T. K. M. Lee , H. W. Chan , K. H. Leo , E. Chew , Ling Zhao , S. Sanei

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

机器学习 · 计算机科学 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

We propose Scalable Mechanistic Neural Network (S-MNN), an enhanced neural network framework designed for scientific machine learning applications involving long temporal sequences. By reformulating the original Mechanistic Neural Network…

机器学习 · 计算机科学 2026-05-15 Jiale Chen , Dingling Yao , Adeel Pervez , Dan Alistarh , Francesco Locatello

Time-series analysis is often affected by missing data, a common problem across several fields, including healthcare and environmental monitoring. Multiple Imputation by Chained Equations (MICE) has been prominent for imputing missing…

机器学习 · 统计学 2026-04-10 Amuche Ibenegbu , Pierre Lafaye de Micheaux , Rohitash Chandra

Despite several signs of progress have been made recently, limited research has been conducted for an inductive setting where embeddings are required for newly unseen nodes -- a setting encountered commonly in practical applications of deep…

机器学习 · 计算机科学 2020-06-23 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

Traditional time series models are task-specific and often depend on dataset-specific training and extensive feature engineering. While Transformer-based architectures have improved scalability, foundation models, commonplace in text,…

机器学习 · 计算机科学 2025-05-21 Utsav Dutta , Sina Khoshfetrat Pakazad , Henrik Ohlsson

Incomplete multi-view clustering presents significant challenges due to missing views. Although many existing graph-based methods aim to recover missing instances or complete similarity matrices with promising results, they still face…

机器学习 · 计算机科学 2025-01-22 Xinxin Wang , Yongshan Zhang , Yicong Zhou

Multivariate time series (MTS) anomaly detection identifies abnormal patterns where each timestamp contains multiple variables. Existing MTS anomaly detection methods fall into three categories: reconstruction-based, prediction-based, and…

机器学习 · 计算机科学 2025-10-03 Yuanyuan Yao , Yuhan Shi , Lu Chen , Ziquan Fang , Yunjun Gao , Leong Hou U , Yushuai Li , Tianyi Li