English
Related papers

Related papers: Hierarchical Light Transformer Ensembles for Multi…

200 papers

A well-known approach to describe the dynamics of an open quantum system is to compute the master equation evolving the reduced density matrix of the system. This approach plays an important role in describing excitation transfer through…

Quantum Physics · Physics 2022-10-25 Kimara Naicker , Ilya Sinayskiy , Francesco Petruccione

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Traffic forecasting is vital for Intelligent Transportation Systems, for which Machine Learning (ML) methods have been extensively explored to develop data-driven Artificial Intelligence (AI) solutions. Recent research focuses on modelling…

Machine Learning · Computer Science 2025-05-01 Xiao Zheng , Saeed Asadi Bagloee , Majid Sarvi

The control of nonlinear dynamical systems remains a major challenge for autonomous agents. Current trends in reinforcement learning (RL) focus on complex representations of dynamics and policies, which have yielded impressive results in…

Machine Learning · Computer Science 2020-05-13 Hany Abdulsamad , Jan Peters

This paper presents a novel approach in wildfire prediction through the integration of multisource spatiotemporal data, including satellite data, and the application of deep learning techniques. Specifically, we utilize an ensemble model…

Machine Learning · Computer Science 2025-01-07 Ayoub Jadouli , Chaker El Amrani

A large amount of research on Convolutional Neural Networks has focused on flat Classification in the multi-class domain. In the real world, many problems are naturally expressed as problems of hierarchical classification, in which the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Riccardo La Grassa , Ignazio Gallo , Nicola Landro

Predicting crowd intentions and trajectories is critical for a range of real-world applications, involving social robotics and autonomous driving. Accurately modeling such behavior remains challenging due to the complexity of pairwise…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Weizheng Wang , Baijian Yang , Sungeun Hong , Wenhai Sun , Byung-Cheol Min

Deep learning has achieved remarkable success in modeling sequential data, including event sequences, temporal point processes, and irregular time series. Recently, transformers have largely replaced recurrent networks in these tasks.…

Machine Learning · Computer Science 2025-08-05 Ivan Karpukhin , Andrey Savchenko

Deep learning-based trajectory prediction models have demonstrated promising capabilities in capturing complex interactions. However, their out-of-distribution generalization remains a significant challenge, particularly due to unbalanced…

Machine Learning · Computer Science 2025-09-30 Kumar Manas , Christian Schlauch , Adrian Paschke , Christian Wirth , Nadja Klein

Predicting the trajectories of surrounding agents is still considered one of the most challenging tasks for autonomous driving. In this paper, we introduce a multi-modal trajectory prediction framework based on the transformer network. The…

Robotics · Computer Science 2024-02-27 Zhenning Li , Hao Yu

Recent years have seen a shift towards learning-based methods for trajectory prediction, with challenges remaining in addressing uncertainty and capturing multi-modal distributions. This paper introduces Temporal Ensembling with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kai-Yin Hong , Chieh-Chih Wang , Wen-Chieh Lin

In this paper, we introduce the first machine learning framework for predicting optimal processing times in Single-Level Tree Network (SLTN) architectures for the Divisible Load Theory (DLT) paradigm. Using a feedforward neural network(FNN)…

Machine Learning · Computer Science 2026-05-25 Bharadwaj Veeravalli

Accurate electrical load forecasting is crucial for optimizing power system operations, planning, and management. As power systems become increasingly complex, traditional forecasting methods may fail to capture the intricate patterns and…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Elias Raffoul , Mingjian Tuo , Cunzhi Zhao , Tianxia Zhao , Meng Ling , Xingpeng Li

This work explores the application of ensemble modeling to the multidimensional regression problem of trajectory prediction for vehicles in urban environments. As newer and bigger state-of-the-art prediction models for autonomous driving…

Machine Learning · Computer Science 2025-09-18 Divya Thuremella , Yi Yang , Simon Wanna , Lars Kunze , Daniele De Martini

Time series forecasting has widespread applications in urban life ranging from air quality monitoring to traffic analysis. However, accurate time series forecasting is challenging because real-world time series suffer from the distribution…

Machine Learning · Computer Science 2022-07-15 Wenying Duan , Xiaoxi He , Lu Zhou , Lothar Thiele , Hong Rao

Model ensembling is a well-established technique for improving the performance of machine learning models. Conventionally, this involves averaging the output distributions of multiple models and selecting the most probable label. This idea…

Machine Learning · Computer Science 2026-05-26 Jiale Fu , Yuchu Jiang , Peijun Wu , Chonghan Liu , Joey Tianyi Zhou , Xu Yang

Training large neural networks with data-parallel stochastic gradient descent allocates N GPU replicas to compute effectively identical updates -- a practice that leaves the rich space of learning rate configurations entirely unexplored…

Machine Learning · Computer Science 2026-04-28 Hailing Cheng , Tao Huang , Chen Zhu , Antonio Alonso

Deep learning has significantly advanced time series forecasting through its powerful capacity to capture sequence relationships. However, training these models with the Mean Square Error (MSE) loss often results in over-smooth predictions,…

Machine Learning · Computer Science 2024-12-25 Yanru Sun , Zongxia Xie , Dongyue Chen , Emadeldeen Eldele , Qinghua Hu

Recent progress in neural forecasting accelerated improvements in the performance of large-scale forecasting systems. Yet, long-horizon forecasting remains a very difficult task. Two common challenges afflicting the task are the volatility…