English
Related papers

Related papers: Overcoming set imbalance in data driven parameteri…

200 papers

Imbalanced datasets are ubiquitous. Classification performance on imbalanced datasets is generally poor for the minority class as the classifier cannot learn decision boundaries well. However, in sensitive applications like fraud detection,…

Machine Learning · Computer Science 2019-10-25 Vishwa Karia , Wenhao Zhang , Arash Naeim , Ramin Ramezani

Histogram-based template fits are the main technique used for estimating parameters of high energy physics Monte Carlo generators. Parametrized neural network reweighting can be used to extend this fitting procedure to many dimensions and…

High Energy Physics - Phenomenology · Physics 2021-04-08 Anders Andreassen , Shih-Chieh Hsu , Benjamin Nachman , Natchanon Suaysom , Adi Suresh

The introduction of new generation hyperspectral satellite sensors, combined with advancements in deep learning methodologies, has significantly enhanced the ability to discriminate detailed land-cover classes at medium-large scales.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Mattia Ferrari , Lorenzo Bruzzone

Weighted ensemble (WE) is an enhanced path-sampling method that is conceptually simple, widely applicable, and statistically exact. In a WE simulation, an ensemble of trajectories is periodically pruned or replicated to enhance sampling of…

Estimating the parameters of compact binaries which coalesce and produce gravitational waves is a challenging Bayesian inverse problem. Gravitational-wave parameter estimation lies within the class of multifidelity problems, where a variety…

General Relativity and Quantum Cosmology · Physics 2024-05-31 Bassel Saleh , Aaron Zimmerman , Peng Chen , Omar Ghattas

Geological parameterization entails the representation of a geomodel using a small set of latent variables and a mapping from these variables to grid-block properties such as porosity and permeability. Parameterization is useful for data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guido Di Federico , Louis J. Durlofsky

In recent years, graph neural networks (GNNs) have achieved state-of-the-art performance for node classification. However, most existing GNNs would suffer from the graph imbalance problem. In many real-world scenarios, node classes are…

Machine Learning · Computer Science 2022-06-14 Tianxiang Zhao , Xiang Zhang , Suhang Wang

We consider the problem of learning linear prediction models with model misspecification bias. In such case, the collinearity among input variables may inflate the error of parameter estimation, resulting in instability of prediction…

Machine Learning · Computer Science 2019-12-02 Zheyan Shen , Peng Cui , Tong Zhang , Kun Kuang

Posterior distributions on parameters computed from experimental data using Bayesian techniques are only as accurate as the models used to construct them. In many applications these models are incomplete, which both reduces the prospects of…

General Relativity and Quantum Cosmology · Physics 2015-06-23 Christopher J. Moore , Jonathan R. Gair

Modeling the risk of extreme weather events in a changing climate is essential for developing effective adaptation and mitigation strategies. Although the available low-resolution climate models capture different scenarios, accurate risk…

Atmospheric and Oceanic Physics · Physics 2022-12-06 Anamitra Saha , Sai Ravela

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Despite over two decades of progress, imbalanced data is still considered a significant challenge for contemporary machine learning models. Modern advances in deep learning have magnified the importance of the imbalanced data problem. The…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Damien Dablain , Bartosz Krawczyk , Nitesh V. Chawla

Improving the representation of precipitation in Earth system models (ESMs) is critical for assessing the impacts of climate change and especially of extreme events like floods and droughts. In existing ESMs, precipitation is not resolved…

Machine Learning · Computer Science 2026-05-27 Michael Aich , Sebastian Bathiany , Philipp Hess , Yu Huang , Niklas Boers

Sampling from high-dimensional distributions is a fundamental problem in statistical research and practice. However, great challenges emerge when the target density function is unnormalized and contains isolated modes. We tackle this…

Methodology · Statistics 2023-04-11 Yixuan Qiu , Xiao Wang

Data collection in economically constrained countries often necessitates using approximate and biased measurements due to the low-cost of the sensors used. This leads to potentially invalid predictions and poor policies or decision making.…

Machine Learning · Computer Science 2019-12-02 Michael T. Smith , Joel Ssematimba , Mauricio A. Alvarez , Engineer Bainomugisha

Quantifying the impacts of anthropogenic global warming requires accurate Earth system model (ESM) simulations. Statistical bias correction and downscaling can be applied to reduce errors and increase the resolution of ESMs. However,…

Geophysics · Physics 2024-06-24 Philipp Hess , Niklas Boers

The rare-event sampling problem has long been the central limiting factor in molecular dynamics (MD), especially in biomolecular simulation. Recently, diffusion models such as BioEmu have emerged as powerful equilibrium samplers that…

Dealing with severe class imbalance poses a major challenge for real-world applications, especially when the accurate classification and generalization of minority classes is of primary interest. In computer vision, learning from long…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Zidi Xiu , Junya Chen , Ricardo Henao , Benjamin Goldstein , Lawrence Carin , Chenyang Tao

In many scenarios, one uses a large training set to train a model with the goal of performing well on a smaller testing set with a different distribution. Learning a weight for each data point of the training set is an appealing solution,…

Machine Learning · Statistics 2023-10-27 Anastasia Ivanova , Pierre Ablin

When presented with a binary classification problem where the data exhibits severe class imbalance, most standard predictive methods may fail to accurately model the minority class. We present a model based on Generative Adversarial…

Machine Learning · Computer Science 2022-04-20 Jonathan Gradstein , Moshe Salhov , Yoav Tulpan , Ofir Lindenbaum , Amir Averbuch