中文
相关论文

相关论文: Fixing the Double Penalty in Data-Driven Weather F…

200 篇论文

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

统计理论 · 数学 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

Educational policymakers often lack data on student outcomes where standardized tests were not administered. Machine learning can predict unobserved outcomes in target populations using source population data. However, covariate…

Data-driven weather prediction models exhibit promising performance and advance continuously. In particular, diffusion models represent fine-scale details without spatial smoothing, which is crucial for mesoscale predictions, such as heavy…

机器学习 · 计算机科学 2025-03-26 Yuta Hirabayashi , Daisuke Matsuoka

Overlapping asymmetric datasets are common in data science and pose questions of how they can be incorporated together into a predictive analysis. In healthcare datasets there is often a small amount of information that is available for a…

统计方法学 · 统计学 2023-11-21 Matthew McTeer , Robin Henderson , Quentin M Anstee , Paolo Missier

When training a machine learning model with observational data, it is often encountered that some values are systemically missing. Learning from the incomplete data in which the missingness depends on some covariates may lead to biased…

机器学习 · 计算机科学 2018-12-24 Kanghoon Lee , Jihye Choi , Moonsu Cha , Jung-Kwon Lee , Taeyoon Kim

Time series forecasting holds significant value in various domains such as economics, traffic, energy, and AIOps, as accurate predictions facilitate informed decision-making. However, the existing Mean Squared Error (MSE) loss function…

机器学习 · 计算机科学 2025-10-29 Xiangfei Qiu , Xingjian Wu , Hanyin Cheng , Xvyuan Liu , Chenjuan Guo , Jilin Hu , Bin Yang

Spatiotemporal matrix-valued data arise frequently in modern applications, yet performing effective regression analysis remains challenging due to complex, dimension-specific dependencies. In this work, we propose a regularized framework…

最优化与控制 · 数学 2026-02-17 Meixia Lin , Ziyang Zeng , Yangjing Zhang

Short-term forecasting models typically assume the availability of input data (features) when they are deployed and in use. However, equipment failures, disruptions, cyberattacks, may lead to missing features when such models are used…

机器学习 · 统计学 2025-06-30 Akylas Stratigakos , Panagiotis Andrianesis

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

统计理论 · 数学 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

Doubly-stochastic point processes model the occurrence of events over a spatial domain as an inhomogeneous Poisson process conditioned on the realization of a random intensity function. They are flexible tools for capturing spatial…

统计方法学 · 统计学 2024-06-28 Si Cheng , Jon Wakefield , Ali Shojaie

Asymmetry along with heteroscedasticity or contamination often occurs with the growth of data dimensionality. In ultra-high dimensional data analysis, such irregular settings are usually overlooked for both theoretical and computational…

统计理论 · 数学 2022-07-20 Bin Luo , Xiaoli Gao

Accurate high-resolution spatial and temporal wind speed data is critical for estimating the wind energy potential of a location. For real-time wind speed prediction, statistical models typically depend on high-quality (near) real-time data…

应用统计 · 统计学 2026-02-24 Eamonn Organ , Maeve Upton , Denis Allard , Lionel Benoit , James Sweeney

The design of training objective is central to training time-series forecasting models. Existing training objectives such as mean squared error mostly treat each future step as an independent, equally weighted task, which we found leading…

机器学习 · 计算机科学 2026-03-20 Hao Wang , Licheng Pan , Yuan Lu , Zhichao Chen , Tianqiao Liu , Shuting He , Zhixuan Chu , Qingsong Wen , Haoxuan Li , Zhouchen Lin

This article addresses the challenge of adapting data-based models over time. We propose a novel two-fold modelling architecture designed to correct plant-model mismatch caused by two types of uncertainty. Out-of-domain uncertainty arises…

系统与控制 · 电气工程与系统科学 2025-07-17 Laura Boca de Giuli , Alessio La Bella , Riccardo Scattolini

In the realm of large-scale spatiotemporal data, abrupt changes are commonly occurring across both spatial and temporal domains. This study aims to address the concurrent challenges of detecting change points and identifying spatial…

统计方法学 · 统计学 2025-05-05 Zerui Zhang , Xin Wang , Xin Zhang , Jing Zhang

Forecasting future weather and climate is inherently difficult. Machine learning offers new approaches to increase the accuracy and computational efficiency of forecasts, but current methods are unable to accurately model uncertainty in…

机器学习 · 计算机科学 2023-02-02 Yusuke Hatanaka , Yannik Glaser , Geoff Galgon , Giuseppe Torri , Peter Sadowski

Deep probabilistic forecasting is gaining attention in numerous applications ranging from weather prognosis, through electricity consumption estimation, to autonomous vehicle trajectory prediction. However, existing approaches focus on…

机器学习 · 计算机科学 2022-03-04 Jedrzej Kozerawski , Mayank Sharan , Rose Yu

Accurate medium-range precipitation forecasting is crucial for hydrometeorological risk management and disaster mitigation, yet remains challenging for current numerical weather prediction (NWP) systems. Traditional ensemble systems such as…

大气与海洋物理 · 物理学 2025-10-24 Tianyi Xiong , Haonan Chen

Single-parameter summaries of variable effects in regression settings are desirable for ease of interpretation. However (partially) linear models for example, which would deliver these, may fit poorly to the data. On the other hand, an…

统计理论 · 数学 2025-07-28 Harvey Klyne , Rajen D. Shah

We investigate robust direction-of-arrival (DoA) estimation for sensor arrays operating in adverse weather conditions, where weather-induced distortions degrade estimation accuracy. Building on a physics-based $S$-matrix model established…

信号处理 · 电气工程与系统科学 2026-01-28 Chenyang Yan , Geert Leus , Mats Bengtsson