English
Related papers

Related papers: Hierarchical Light Transformer Ensembles for Multi…

200 papers

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Accurate weather forecasting holds significant importance, serving as a crucial tool for decision-making in various industrial sectors. The limitations of statistical models, assuming independence among data points, highlight the need for…

Machine Learning · Computer Science 2025-01-22 Anuvab Sen , Udayon Sen , Mayukhi Paul , Apurba Prasad Padhy , Sujith Sai , Aakash Mallik , Chhandak Mallick

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Images are composed as a hierarchy of object parts. We use this insight to create a generative graphical model that defines a hierarchical distribution over image parts. Typically, this leads to intractable inference due to loops in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Sebastian Kaltwang , Sina Samangooei , John Redford , Andrew Blake

Machine Learning (ML) inspired algorithms provide a flexible set of tools for analyzing and forecasting chaotic dynamical systems. We here analyze the performance of one algorithm for the prediction of extreme events in the two-dimensional…

Machine Learning · Computer Science 2020-02-25 Martin Lellep , Jonathan Prexl , Moritz Linkmann , Bruno Eckhardt

The forecasting of entity trajectories at future points in time is a critical capability gap in applications across both Commercial and Defense sectors. Transformers, and specifically Generative Pre-trained Transformer (GPT) networks have…

Machine Learning · Computer Science 2024-02-02 Nicholas Stroh

Hierarchical forecasting with intermittent time series is a challenge in both research and empirical studies. Extensive research focuses on improving the accuracy of each hierarchy, especially the intermittent time series at bottom levels.…

Machine Learning · Statistics 2022-02-22 Matthias Anderer , Feng Li

This paper presents a novel hybrid approach for modeling the voltage gain of LLC resonant converters by combining deep-learning neural networks with the polynomial based Group Method of Data Handling (GMDH). While deep learning offers high…

Systems and Control · Electrical Eng. & Systems 2025-02-19 Parham Mohammadi

The Hilbert-Huang transform (HHT) consists of empirical mode decomposition (EMD), which is a template-free method that represents the combination of different intrinsic modes on a time-frequency map (i.e., the Hilbert spectrum). The…

Instrumentation and Methods for Astrophysics · Physics 2025-06-05 Lupin Chun-Che Lin , Chin-Ping Hu , Chien-Chang Yen , Kuo-Chuan Pan , C. Y. Hui , Kwan-Lok Li , Yu-Chiung Lin , Yi-Sheng Huang , Albert K. H. Kong

Holographic Metasurface Transceivers (HMTs) are emerging as cost-effective substitutes to large antenna arrays for beamforming in Millimeter and TeraHertz wave communication. However, to achieve desired channel gains through beamforming in…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Debamita Ghosh , Manjesh Kumar Hanawal , Nikola Zlatanova

Wind power is attracting increasing attention around the world due to its renewable, pollution-free, and other advantages. However, safely and stably integrating the high permeability intermittent power energy into electric power systems…

Machine Learning · Computer Science 2023-05-31 Yang Zhang , Lingbo Liu , Xinyu Xiong , Guanbin Li , Guoli Wang , Liang Lin

Training Long-Context Large Language Models (LLMs) is challenging, as hybrid training with long-context and short-context data often leads to workload imbalances. Existing works mainly use data packing to alleviate this issue, but fail to…

Machine Learning · Computer Science 2025-10-14 Yongqiang Yao , Jingru Tan , Kaihuan Liang , Feizhao Zhang , Jiahao Hu , Shuo Wu , Yazhe Niu , Ruihao Gong , Dahua Lin , Ningyi Xu

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction. Existing approaches explore the discrete nature of human intent before predicting continuous trajectories, to improve accuracy and support…

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

Machine Learning · Computer Science 2021-11-17 Hung Nguyen , Morris Chang

Video-Text Retrieval has been a hot research topic with the growth of multimedia data on the internet. Transformer for video-text learning has attracted increasing attention due to its promising performance. However, existing cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Song Liu , Haoqi Fan , Shengsheng Qian , Yiru Chen , Wenkui Ding , Zhongyuan Wang

We present the method of complementary ensemble empirical mode decomposition (CEEMD) and Hilbert-Huang transform (HHT) for analyzing nonstationary financial time series. This noise-assisted approach decomposes any time series into a number…

Computational Finance · Quantitative Finance 2021-05-25 Tim Leung , Theodore Zhao

A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their…

Machine Learning · Statistics 2019-02-11 Shujian Yu , Zubin Abraham , Heng Wang , Mohak Shah , Yantao Wei , José C. Príncipe

Hierarchical multi-label classification (HMLC) is essential for modeling complex label dependencies in remote sensing. Existing methods, however, struggle with multi-path hierarchies where instances belong to multiple branches, and they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Marjan Stoimchev , Boshko Koloski , Jurica Levatić , Dragi Kocev , Sašo Džeroski