English
Related papers

Related papers: Time-o1: Time-Series Forecasting Needs Transformed…

200 papers

Accuracy and timeliness are indeed often conflicting goals in prediction tasks. Premature predictions may yield a higher rate of false alarms, whereas delaying predictions to gather more information can render them too late to be useful. In…

Machine Learning · Computer Science 2024-06-19 Wei Shao , Yufan Kang , Ziyan Peng , Xiao Xiao , Lei Wang , Yuhui Yang , Flora D Salim

The goal of meta-learning is to learn to adapt to a new task with only a few labeled examples. To tackle this problem in NLP, we propose $\textit{in-context tuning}$, which recasts adaptation and prediction as a simple sequence prediction…

Computation and Language · Computer Science 2022-04-13 Yanda Chen , Ruiqi Zhong , Sheng Zha , George Karypis , He He

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

Machine Learning · Computer Science 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng

While large volumes of unlabeled data are usually available, associated labels are often scarce. The unsupervised domain adaptation problem aims at exploiting labels from a source domain to classify data from a related, yet different,…

Machine Learning · Computer Science 2023-08-28 François Painblanc , Laetitia Chapel , Nicolas Courty , Chloé Friguet , Charlotte Pelletier , Romain Tavenard

Recent studies have demonstrated the great power of Transformer models for time series forecasting. One of the key elements that lead to the transformer's success is the channel-independent (CI) strategy to improve the training robustness.…

Machine Learning · Computer Science 2024-02-19 Wang Xue , Tian Zhou , Qingsong Wen , Jinyang Gao , Bolin Ding , Rong Jin

Time-series anomaly detection is an important task and has been widely applied in the industry. Since manual data annotation is expensive and inefficient, most applications adopt unsupervised anomaly detection methods, but the results are…

Machine Learning · Computer Science 2023-01-02 Hong Guo , Yujing Wang , Jieyu Zhang , Zhengjie Lin , Yunhai Tong , Lei Yang , Luoxing Xiong , Congrui Huang

Time series forecasting faces two important but often overlooked challenges. Firstly, the inherent random noise in the time series labels sets a theoretical lower bound for the forecasting error, which is positively correlated with the…

Machine Learning · Computer Science 2025-09-26 Tianyi Shi , Zhu Meng , Yue Chen , Siyang Zheng , Fei Su , Jin Huang , Changrui Ren , Zhicheng Zhao

Person re-identification is an open and challenging problem in computer vision. Majority of the efforts have been spent either to design the best feature representation or to learn the optimal matching metric. Most approaches have neglected…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Niki Martinel , Abir Das , Christian Micheloni , Amit K. Roy-Chowdhury

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language…

Computation and Language · Computer Science 2025-08-05 Taibiao Zhao , Xiaobing Chen , Mingxuan Sun

Acquiring and training on large-scale labeled data can be impractical due to cost constraints. Additionally, the use of small training datasets can result in considerable variability in model outcomes, overfitting, and learning of spurious…

Machine Learning · Computer Science 2025-07-08 Jiashu Tao , Reza Shokri

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

Machine Learning · Computer Science 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

Extreme classification tasks are multi-label tasks with an extremely large number of labels (tags). These tasks are hard because the label space is usually (i) very large, e.g. thousands or millions of labels, (ii) very sparse, i.e. very…

Machine Learning · Computer Science 2020-12-04 Elham J. Barezi , Iacer Calixto , Kyunghyun Cho , Pascale Fung

In the object detection task, merging various datasets from similar contexts but with different sets of Objects of Interest (OoI) is an inexpensive way (in terms of labor cost) for crafting a large-scale dataset covering a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mahdieh Abbasi , Denis Laurendeau , Christian Gagne

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

Machine Learning · Computer Science 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

Transfer learning is a promising method for AOI applications since it can significantly shorten sample collection time and improve efficiency in today's smart manufacturing. However, related research enhanced the network models by applying…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Erik Isai Valle Salgado , Haoxin Yan , Yue Hong , Peiyuan Zhu , Shidong Zhu , Chengwei Liao , Yanxiang Wen , Xiu Li , Xiang Qian , Xiaohao Wang , Xinghui Li

A persistent paradox in time-series forecasting is that structurally simple MLP and linear models often outperform high-capacity Transformers. We argue that this gap arises from a mismatch in the sequence-modeling primitive: while many…

Machine Learning · Computer Science 2026-05-13 Jevon Twitty , Vinh Pham , Nitiwith Rotchanarak , Viresh Pati , Yubin Kim , Shihao Yang , Jiecheng Lu

The unsupervised pretraining of object detectors has recently become a key component of object detector training, as it leads to improved performance and faster convergence during the supervised fine-tuning stage. Existing unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ioannis Maniadis Metaxas , Adrian Bulat , Ioannis Patras , Brais Martinez , Georgios Tzimiropoulos

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

The label shift problem refers to the supervised learning setting where the train and test label distributions do not match. Existing work addressing label shift usually assumes access to an \emph{unlabelled} test sample. This sample may be…

Machine Learning · Computer Science 2021-08-18 Jingzhao Zhang , Aditya Menon , Andreas Veit , Srinadh Bhojanapalli , Sanjiv Kumar , Suvrit Sra