中文
相关论文

相关论文: Transformer Encoder and Multi-features Time2Vec fo…

200 篇论文

The multivariate time series generated from merchant transaction history can provide critical insights for payment processing companies. The capability of predicting merchants' future is crucial for fraud detection and recommendation…

机器学习 · 计算机科学 2021-09-22 Chin-Chia Michael Yeh , Zhongfang Zhuang , Wei Zhang , Liang Wang

This paper compares different Transformer model architectures for stock index prediction. While many studies have shown that Transformers perform well in stock price forecasting, few have explored how different structural designs impact…

计算工程、金融与科学 · 计算机科学 2025-04-24 Qizhao Chen

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

机器学习 · 计算机科学 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

In this paper, we present a new tracking architecture with an encoder-decoder transformer as the key component. The encoder models the global spatio-temporal feature dependencies between target objects and search regions, while the decoder…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Bin Yan , Houwen Peng , Jianlong Fu , Dong Wang , Huchuan Lu

Forecasting multivariate time series remains challenging due to complex cross-variable dependencies and the presence of heterogeneous external influences. This paper presents Spectrogram-Enhanced Multimodal Fusion (SEMF), which combines…

机器学习 · 计算机科学 2026-03-31 Soyeon Park , Doohee Chung , Charmgil Hong

Real-world time series data are inherently multivariate, often exhibiting complex inter-channel dependencies. Each channel is typically sampled at its own period and is prone to missing values due to various practical and operational…

机器学习 · 计算机科学 2026-03-11 Jinkwan Jang , Hyungjin Park , Jinmyeong Choi , Taesup Kim

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

机器学习 · 计算机科学 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

We propose a transformer architecture for time series forecasting with a focus on time series tokenisation and apply it to a real-world prediction problem from the pricing domain. Our architecture aims to learn effective representations at…

机器学习 · 计算机科学 2025-04-22 Egon Peršak , Miguel F. Anjos , Sebastian Lautz , Aleksandar Kolev

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

机器学习 · 计算机科学 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Encoder-decoder-based recurrent neural network (RNN) has made significant progress in sequence-to-sequence learning tasks such as machine translation and conversational models. Recent works have shown the advantage of this type of network…

机器学习 · 计算机科学 2023-05-10 Jing Xiong , Pengyang Zhou , Alan Chen , Yu Zhang

A recent variation of Transformer, Performer, scales Transformer to longer sequences with a linear attention mechanism. However, it is not compatible with relative position encoding, which has advantages over absolute position encoding. In…

计算与语言 · 计算机科学 2021-09-09 Peng Chen

This paper studies forward-looking stock-stock correlation forecasting for S\&P 500 constituents and evaluates whether learned correlation forecasts can improve graph-based clustering used in basket trading strategies. We cast 10-day ahead…

计算金融 · 定量金融 2026-01-09 Jack Fanshawe , Rumi Masih , Alexander Cameron

Recent advances in neural forecasting have produced major improvements in accuracy for probabilistic demand prediction. In this work, we propose novel improvements to the current state of the art by incorporating changes inspired by recent…

机器学习 · 计算机科学 2022-01-28 Carson Eisenach , Yagna Patel , Dhruv Madeka

Much of modern practice in financial forecasting relies on technicals, an umbrella term for several heuristics applying visual pattern recognition to price charts. Despite its ubiquity in financial media, the reliability of its signals…

计算金融 · 定量金融 2018-07-12 Sid Ghoshal , Stephen J. Roberts

The challenging task of multi-object tracking (MOT) requires simultaneous reasoning about track initialization, identity, and spatio-temporal trajectories. We formulate this task as a frame-to-frame set prediction problem and introduce…

计算机视觉与模式识别 · 计算机科学 2022-05-02 Tim Meinhardt , Alexander Kirillov , Laura Leal-Taixe , Christoph Feichtenhofer

Temporal modeling in complex systems requires capturing dependencies across multiple time scales while managing inherent uncertainties. We propose HierCVAE, a novel architecture that integrates hierarchical attention mechanisms with…

机器学习 · 计算机科学 2025-08-27 Yao Wu

There is a recent growing interest in applying Deep Learning techniques to tabular data, in order to replicate the success of other Artificial Intelligence areas in this structured domain. Specifically interesting is the case in which…

机器学习 · 计算机科学 2025-05-06 Simone Luetto , Fabrizio Garuti , Enver Sangineto , Lorenzo Forni , Rita Cucchiara

This research proposes a cutting-edge ensemble deep learning framework for stock price prediction by combining three advanced neural network architectures: The particular areas of interest for the research include but are not limited to:…

计算金融 · 定量金融 2025-03-31 Anindya Sarkar , G. Vadivu

This work addresses the problem of analyzing multi-channel time series data %. In this paper, we by proposing an unsupervised fusion framework based on %the recently proposed convolutional transform learning. Each channel is processed by a…

机器学习 · 计算机科学 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

机器学习 · 计算机科学 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty