English
Related papers

Related papers: Probabilistic data quality assessment for structur…

200 papers

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM).…

Machine Learning · Computer Science 2024-04-09 Wenlu Tang , Zicheng Liu

Modelling partial differential equations (PDEs) is of crucial importance in science and engineering, and it includes tasks ranging from forecasting to inverse problems, such as data assimilation. However, most previous numerical and machine…

Anomaly detection in multivariate time series data is of paramount importance for ensuring the efficient operation of large-scale systems across diverse domains. However, accurately detecting anomalies in such data poses significant…

Machine Learning · Computer Science 2023-11-15 Yuhang Chen , Chaoyun Zhang , Minghua Ma , Yudong Liu , Ruomeng Ding , Bowen Li , Shilin He , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

Subsampling is an important technique to tackle the computational challenges brought by big data. Many subsampling procedures fall within the framework of importance sampling, which assigns high sampling probabilities to the samples…

Machine Learning · Statistics 2022-03-07 Tieliang Gong , Yuxin Dong , Hong Chen , Bo Dong , Chen Li

Medical data often exhibit characteristics that make cluster analysis particularly challenging, such as missing values, outliers, and cluster features like skewness. Typically, such data would need to be preprocessed -- by cleaning outliers…

Methodology · Statistics 2025-12-16 Jason Pillay , Cristina Tortora , Antonio Punzo , Andriette Bekker

Outlying observations are frequently encountered across a wide spectrum of scientific domains, posing notable challenges to the generalizability of statistical models and the reproducibility of downstream analysis. They are identified…

Methodology · Statistics 2026-03-17 Dongliang Zhang , Masoud Asgharian , Martin A. Lindquist

We introduce a universal diffusion-based downscaling framework that lifts deterministic low-resolution weather forecasts into probabilistic high-resolution predictions without any model-specific fine-tuning. A single conditional diffusion…

Machine Learning · Computer Science 2026-04-21 Roberto Molinaro , Niall Siegenheim , Henry Martin , Mark Frey , Niels Poulsen , Philipp Seitz , Marvin Vincent Gabler

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Outlier detection (OD) aims to identify abnormal instances, known as outliers or anomalies, by learning typical patterns of normal data, or inliers. Performing OD under an unsupervised regime-without any information about anomalous…

Machine Learning · Statistics 2026-01-21 Minseo Kang , Seunghwan Park , Dongha Kim

Conditional density estimation (CDE) is a fundamental task in machine learning that aims to model the full conditional law $\mathbb{P}(\mathbf{y} \mid \mathbf{x})$, beyond mere point prediction (e.g., mean, mode). A core challenge is…

Machine Learning · Computer Science 2026-03-27 Chenglong Song , Mazharul Islam , Lin Wang , Bing Chen , Bo Yang

Diffusion models (DMs) have emerged as powerful tools for modeling complex data distributions and generating realistic new samples. Over the years, advanced architectures and sampling methods have been developed to make these models…

Machine Learning · Computer Science 2025-12-11 Roi Benita , Michael Elad , Joseph Keshet

Machine Learning (ML) models are being increasingly employed for credit risk evaluation, with their effectiveness largely hinging on the quality of the input data. In this paper we investigate the impact of several data quality issues,…

Machine Learning · Computer Science 2025-11-18 Andrea Maurino

State-space models (SSMs) provide a flexible framework for modelling time series data, but their reliance on Gaussian error assumptions makes them highly sensitive to outliers. We propose a robust estimation method, ROAMS, that mitigates…

Methodology · Statistics 2025-11-20 Rajan Shankar , Ines Wilms , Jakob Raymaekers , Garth Tarr

Cloud contamination severely degrades the usability of remote sensing imagery and poses a fundamental challenge for downstream Earth observation tasks. Recently, diffusion-based models have emerged as a dominant paradigm for remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifan Zhang , Qian Chen , Yi Liu , Wengen Li , Jihong Guan

Out-of-distribution (OOD) detection is indispensable for machine learning models deployed in the open world. Recently, the use of an auxiliary outlier dataset during training (also known as outlier exposure) has shown promising performance.…

Machine Learning · Computer Science 2022-06-29 Yifei Ming , Ying Fan , Yixuan Li

Given coarser-resolution projections from global climate models or satellite data, the downscaling problem aims to estimate finer-resolution regional climate data, capturing fine-scale spatial patterns and variability. Downscaling is any…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Subhankar Ghosh , Arun Sharma , Jayant Gupta , Aneesh Subramanian , Shashi Shekhar

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

Seismic imaging from sparsely acquired data faces challenges such as low image quality, discontinuities, and migration swing artifacts. Existing convolutional neural network (CNN)-based methods struggle with complex feature distributions…

Geophysics · Physics 2024-08-01 Xingchen Shi , Shijun Cheng , Weijian Mao , Wei Ouyang

We consider the task of counterfactual estimation from observational imaging data given a known causal structure. In particular, quantifying the causal effect of interventions for high-dimensional data with neural networks remains an open…

Machine Learning · Computer Science 2022-02-22 Pedro Sanchez , Sotirios A. Tsaftaris

Health data are often not symmetric to be adequately modeled through the usual normal distributions; most of them exhibit skewed patterns. They can indeed be modeled better through the larger family of skew-normal distributions covering…

Applications · Statistics 2019-09-24 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh
‹ Prev 1 3 4 5 6 7 10 Next ›