English
Related papers

Related papers: MRMS-Net and LMRMS-Net: Scalable Multi-Representat…

200 papers

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

Computation and Language · Computer Science 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Learned representations are a central component in modern ML systems, serving a multitude of downstream tasks. When training such representations, it is often the case that computational and statistical constraints for each downstream task…

In current research, machine and deep learning solutions for the classification of temporal data are shifting from single-channel datasets (univariate) to problems with multiple channels of information (multivariate). The majority of these…

Machine Learning · Computer Science 2023-04-13 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

Shifted-and-Duplicated-Kernel (SDK) mapping has emerged as an effective strategy to accelerate convolutional layers on compute-in-memory (CIM) hardware. However, existing SDK variants (e.g., VWC-SDK) merely optimize mapping for a single CIM…

Hardware Architecture · Computer Science 2026-04-29 Ke Dong , Kejie Huang , Tao Luo , Bo Wang

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

Artificial Intelligence · Computer Science 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Recent work has shown the efficiency of deep learning models such as Fully Convolutional Networks (FCN) or Recurrent Neural Networks (RNN) to deal with Time Series Regression (TSR) problems. These models sometimes need a lot of data to be…

Machine Learning · Computer Science 2021-11-03 Sebastian Pineda Arango , Felix Heinrich , Kiran Madhusudhanan , Lars Schmidt-Thieme

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In…

Machine Learning · Computer Science 2020-10-28 Aya Abdelsalam Ismail , Mohamed Gunady , Héctor Corrada Bravo , Soheil Feizi

Parallel test-time scaling, which generates multiple candidate solutions for a single problem, is a powerful technique for improving large language model performance. However, it is hindered by two key bottlenecks: accurately selecting the…

Cryptography and Security · Computer Science 2026-03-05 Yegon Kim , Seungyoo Lee , Chaeyun Jang , Hyungi Lee , Juho Lee

Network representation learning (NRL) technique has been successfully adopted in various data mining and machine learning applications. Random walk based NRL is one popular paradigm, which uses a set of random walks to capture the network…

Machine Learning · Computer Science 2021-01-12 Xingyu Yao , Yingxia Shao , Bin Cui , Lei Chen

A plethora of multi-view subspace clustering (MVSC) methods have been proposed over the past few years. Researchers manage to boost clustering accuracy from different points of view. However, many state-of-the-art MVSC algorithms, typically…

Machine Learning · Computer Science 2019-11-22 Zhao Kang , Wangtao Zhou , Zhitong Zhao , Junming Shao , Meng Han , Zenglin Xu

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting…

Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory…

Machine Learning · Computer Science 2018-03-20 Fazle Karim , Somshubra Majumdar , Houshang Darabi , Shun Chen

Recent advancements in language modeling have shown promising results when applied to time series data. In particular, fine-tuning pre-trained large language models (LLMs) for time series classification tasks has achieved state-of-the-art…

Machine Learning · Computer Science 2025-06-03 Rachneet Kaur , Zhen Zeng , Tucker Balch , Manuela Veloso

In this study, we present aLLM4TS, an innovative framework that adapts Large Language Models (LLMs) for time-series representation learning. Central to our approach is that we reconceive time-series forecasting as a self-supervised,…

Machine Learning · Computer Science 2024-03-12 Yuxuan Bian , Xuan Ju , Jiangtong Li , Zhijian Xu , Dawei Cheng , Qiang Xu

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Multivariate time-series (MTS) forecasting is a paramount and fundamental problem in many real-world applications. The core issue in MTS forecasting is how to effectively model complex spatial-temporal patterns. In this paper, we develop a…

Machine Learning · Computer Science 2024-02-16 Jinliang Deng , Xiusi Chen , Renhe Jiang , Du Yin , Yi Yang , Xuan Song , Ivor W. Tsang

Over the past decade, multivariate time series classification has received great attention. Machine learning (ML) models for multivariate time series classification have made significant strides and achieved impressive success in a wide…

Machine Learning · Computer Science 2024-11-06 Peiyu Li , Omar Bahri , Soukaina Filali Boubrahimi , Shah Muhammad Hamdi

Learning from Multivariate Time Series (MTS) has attracted widespread attention in recent years. In particular, label shortage is a real challenge for the classification task on MTS, considering its complex dimensional and sequential data…

Machine Learning · Computer Science 2021-10-12 Jingwei Zuo , Karine Zeitouni , Yehia Taher