English
Related papers

Related papers: Are We Winning the Wrong Game? Revisiting Evaluati…

200 papers

The evaluation of generative or discriminative large language model (LLM)-based systems is often a complex multi-dimensional problem. Typically, a set of system configuration alternatives are evaluated on one or more benchmark datasets,…

Applications · Statistics 2025-01-31 Samuel Ackerman , Eitan Farchi , Orna Raz , Assaf Toledo

RNN-based methods have faced challenges in the Long-term Time Series Forecasting (LTSF) domain when dealing with excessively long look-back windows and forecast horizons. Consequently, the dominance in this domain has shifted towards…

Machine Learning · Computer Science 2023-08-23 Shengsheng Lin , Weiwei Lin , Wentai Wu , Feiyu Zhao , Ruichao Mo , Haotong Zhang

Large language models are increasingly used to evaluate other models, yet these judgments typically lack any representation of confidence. This pilot study tests whether framing an evaluation task as a betting game (a fictional prediction…

Artificial Intelligence · Computer Science 2025-12-09 Michael Todasco

Measurements are fundamental to knowledge creation in science, enabling consistent sharing of findings and serving as the foundation for scientific discovery. As machine learning systems increasingly transform scientific fields, the…

Materials Science · Physics 2025-05-07 Nawaf Alampara , Mara Schilling-Wilhelmi , Kevin Maik Jablonka

Time series forecasting is essential for operational intelligence in the hospitality industry, and particularly challenging in large-scale, distributed systems. This study evaluates the performance of statistical, machine learning (ML),…

Machine Learning · Computer Science 2025-02-06 Issar Arab , Rodrigo Benitez

Providing long-range forecasts is a fundamental challenge in time series modeling, which is only compounded by the challenge of having to form such forecasts when a time series has never previously been observed. The latter challenge is the…

Machine Learning · Statistics 2018-08-28 Christopher Xie , Alex Tank , Alec Greaves-Tunnell , Emily Fox

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

Machine Learning · Computer Science 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Time Series Foundation Models (TSFMs) represent a new paradigm for time-series forecasting, promising zero-shot predictions without the need for task-specific training or fine-tuning. However, similar to Large Language Models (LLMs), the…

Machine Learning · Computer Science 2026-02-26 Marcel Meyer , Sascha Kaltenpoth , Kevin Zalipski , Oliver Müller

Short-term industrial enterprises power system forecasting is an important issue for both load control and machine protection. Scientists focus on load forecasting but ignore other valuable electric-meters which should provide guidance of…

Machine Learning · Computer Science 2024-06-04 Xiaoqiao Chen

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs…

Machine Learning · Computer Science 2025-05-02 Jongseon Kim , Hyungjoon Kim , HyunGi Kim , Dongjun Lee , Sungroh Yoon

This paper presents a study on the prediction of outcomes in matches of the electronic game League of Legends (LoL) using machine learning techniques. With the aim of exploring the ability to predict real-time results, considering different…

Machine Learning · Computer Science 2026-05-01 Jailson B. S. Junior , Claudio E. C. Campelo

Machine learning (ML) has demonstrated remarkable capabilities across many real-world systems, from predictive modeling to intelligent automation. However, the widespread integration of machine learning also makes it necessary to ensure…

Machine Learning · Computer Science 2024-01-08 Ruijie Du , Deepan Muthirayan , Pramod P. Khargonekar , Yanning Shen

The field of time series forecasting has garnered significant attention in recent years, prompting the development of advanced models like TimeSieve, which demonstrates impressive performance. However, an analysis reveals certain…

Machine Learning · Computer Science 2025-03-31 Songning Lai , Ninghui Feng , Haochen Sui , Ze Ma , Hao Wang , Zichen Song , Hang Zhao , Yutao Yue

Long-term time series forecasting (LTSF) is important for various domains but is confronted by challenges in handling the complex temporal-contextual relationships. As multivariate input models underperforming some recent univariate…

Machine Learning · Statistics 2026-02-06 Jiecheng Lu , Xu Han , Shihao Yang

Multivariate time series forecasting (MTSF) is a critical task with broad applications in domains such as meteorology, transportation, and economics. Nevertheless, pervasive missing values caused by sensor failures or human errors…

Machine Learning · Computer Science 2025-06-23 Kai Tang , Ji Zhang , Hua Meng , Minbo Ma , Qi Xiong , Fengmao Lv , Jie Xu , Tianrui Li

With the advent of Big Data, nowadays in many applications databases containing large quantities of similar time series are available. Forecasting time series in these domains with traditional univariate forecasting procedures leaves great…

Machine Learning · Computer Science 2018-09-13 Kasun Bandara , Christoph Bergmeir , Slawek Smyl

Time series forecasting (TSF) is crucial in fields like economic forecasting, weather prediction, traffic flow analysis, and public health surveillance. Real-world time series data often include noise, outliers, and missing values, making…

Machine Learning · Computer Science 2024-07-09 Quangao Liu , Ruiqi Li , Maowei Jiang , Wei Yang , Chen Liang , LongLong Pang , Zhuozhang Zou

Autocorrelation is a defining characteristic of time-series data, where each observation is statistically dependent on its predecessors. In the context of deep time-series forecasting, autocorrelation arises in both the input history and…

The explosion of Time Series (TS) data, driven by advancements in technology, necessitates sophisticated analytical methods. Modern management systems increasingly rely on analyzing this data, highlighting the importance of effcient…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang