English
Related papers

Related papers: CoRA: Boosting Time Series Foundation Models for M…

200 papers

Recent studies have demonstrated the great power of Transformer models for time series forecasting. One of the key elements that lead to the transformer's success is the channel-independent (CI) strategy to improve the training robustness.…

Machine Learning · Computer Science 2024-02-19 Wang Xue , Tian Zhou , Qingsong Wen , Jinyang Gao , Bolin Ding , Rong Jin

Time-series foundation models (TSFMs) have achieved strong univariate forecasting through large-scale pre-training, yet effectively extending this success to multivariate forecasting remains challenging. To address this, we propose…

Machine Learning · Computer Science 2026-02-26 Jinpeng Li , Zhongyi Pei , Huaze Xue , Bojian Zheng , Chen Wang , Jianmin Wang

Test-Time Adaptation (TTA) enables pre-trained models to adjust to distribution shift by learning from unlabeled test-time streams. However, existing methods typically treat these streams as independent samples, overlooking the supervisory…

Machine Learning · Computer Science 2026-01-30 Young Kyung Kim , Oded Schlesinger , Qiangqiang Wu , J. Matías Di Martino , Guillermo Sapiro

A multivariate time series refers to observations of two or more variables taken from a device or a system simultaneously over time. There is an increasing need to monitor multivariate time series and detect anomalies in real time to ensure…

Machine Learning · Computer Science 2023-05-29 Ming-Chang Lee , Jia-Chun Lin

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

Machine Learning · Computer Science 2025-07-15 Seokmin Ko

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

How to adapt a pre-trained model continuously for sequential tasks with different prediction class labels and domains and finally learn a generalizable model across diverse tasks is a long-lasting challenge. Continual learning (CL) has…

Machine Learning · Computer Science 2025-04-15 Xiaobing Yu , Jin Yang , Xiao Wu , Peijie Qiu , Xiaofeng Liu

Due to their inherent capabilities of capturing non-local dependencies, Transformer neural networks have quickly been established as the paradigmatic architecture for large language models and image processing. Next to these traditional…

Quantum Gases · Physics 2024-08-01 Abhinav Suresh , Henning Schlömer , Baran Hashemi , Annabelle Bohrdt

Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). LoRA essentially describes the projection of an input space into a low-dimensional output space, with the…

Computation and Language · Computer Science 2025-10-28 Shiwei Li , Xiandi Luo , Haozhao Wang , Xing Tang , Ziqiang Cui , Dugang Liu , Yuhua Li , Xiuqiang He , Ruixuan Li

Wrong labeling problem and long-tail relations are two main challenges caused by distant supervision in relation extraction. Recent works alleviate the wrong labeling by selective attention via multi-instance learning, but cannot well…

Computation and Language · Computer Science 2020-11-03 Yang Li , Tao Shen , Guodong Long , Jing Jiang , Tianyi Zhou , Chengqi Zhang

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

Machine Learning · Computer Science 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Adapting machine learning models to medical time series across different domains remains a challenge due to complex temporal dependencies and dynamic distribution shifts. Current approaches often focus on isolated feature representations,…

Machine Learning · Computer Science 2025-09-23 YongKyung Oh , Alex Bui

Coral reef ecosystems provide essential ecosystem services, but face significant threats from climate change and human activities. Although advances in deep learning have enabled automatic classification of coral reef conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Xinlei Shao , Hongruixuan Chen , Fan Zhao , Kirsty Magson , Jundong Chen , Peiran Li , Jiaqi Wang , Jun Sasaki

Low-Rank Adaptation (LoRA) has proven effective in reducing computational costs while maintaining performance comparable to fully fine-tuned foundation models across various tasks. However, its fixed low-rank structure restricts its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Chuyan Zhang , Kefan Wang , Yun Gu

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Time series forecasting presents a significant challenge, particularly when its accuracy relies on external data sources rather than solely on historical values. This issue is prevalent in the financial sector, where the future behavior of…

Machine Learning · Computer Science 2024-03-22 Hajar Emami , Xuan-Hong Dang , Yousaf Shah , Petros Zerfos

Multiple Object Tracking (MOT) has long been a fundamental task in computer vision, with broad applications in various real-world scenarios. However, due to distribution shifts in appearance, motion pattern, and catagory between the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wen Guo , Pengfei Zhao , Zongmeng Wang , Yufan Hu , Junyu Gao

In always-on HAR deployments, model accuracy erodes silently as domain shift accumulates over time. Addressing this challenge requires moving beyond one-off updates toward instance-driven adaptation from streaming data. However, continuous…

Machine Learning · Computer Science 2026-04-10 Minghui Qiu , Jun Chen , Lin Chen , Shuxin Zhong , Yandao Huang , Lu Wang , Kaishun Wu

Repeated measures analyses require proper choice of the correlation model to ensure accurate inference and optimal efficiency. The linear exponent autoregressive (LEAR) correlation model provides a flexible two-parameter correlation…

Methodology · Statistics 2017-07-27 Sean L. Simpson , Min Zhu , Keith E. Muller

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

Machine Learning · Computer Science 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao