English
Related papers

Related papers: Replica Analysis for Ensemble Techniques in Variab…

200 papers

Data selection is essential for any data-based optimization technique, such as Reinforcement Learning. State-of-the-art sampling strategies for the experience replay buffer improve the performance of the Reinforcement Learning agent.…

Deep reinforcement learning (RL) has gained widespread adoption in recent years but faces significant challenges, particularly in unknown and complex environments. Among these, high-dimensional action selection stands out as a critical…

Machine Learning · Statistics 2025-07-08 Wenbo Zhang , Hengrui Cai

Deep neural networks have amply demonstrated their prowess but estimating the reliability of their predictions remains challenging. Deep Ensembles are widely considered as being one of the best methods for generating uncertainty estimates…

Machine Learning · Computer Science 2021-06-28 Nikita Durasov , Timur Bagautdinov , Pierre Baque , Pascal Fua

Advances in variational inference enable parameterisation of probabilistic models by deep neural networks. This combines the statistical transparency of the probabilistic modelling framework with the representational power of deep learning.…

Computation and Language · Computer Science 2020-05-05 Tom Pelsmaeker , Wilker Aziz

Studying the reliability of complex systems using machine learning techniques involves facing a series of technical and practical challenges, ranging from the intrinsic nature of the system and data to the difficulties in modeling and…

Machine Learning · Computer Science 2024-10-08 Maria Luz Gamiz , Fernando Navas-Gomez , Rafael Nozal-Cañadas , Rocio Raya-Miranda

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case…

Machine Learning · Computer Science 2013-09-20 Sean Whalen , Gaurav Pandey

The amount of large-scale real data around us increase in size very quickly and so does the necessity to reduce its size by obtaining a representative sample. Such sample allows us to use a great variety of analytical methods, whose direct…

Social and Information Networks · Computer Science 2014-02-10 Milos Kudelka , Sarka Zehnalova , Jan Platos

Deep Neural Networks (DNNs) are prone to overfitting and hence have high variance. Overfitted networks do not perform well for a new data instance. So instead of using a single DNN as classifier we propose an ensemble of seven independent…

Machine Learning · Computer Science 2021-05-11 Anmol Jain , Aishwary Kumar , Seba Susan

We describe a number of strategies for minimizing and calculating accurately the statistical uncertainty in quantum Monte Carlo calculations. We investigate the impact of the sampling algorithm on the efficiency of the variational Monte…

Computational Physics · Physics 2012-02-14 R. M. Lee , G. J. Conduit , N. Nemec , P. Lopez Rios , N. D. Drummond

Adaptive importance sampling is a widely spread Monte Carlo technique that uses a re-weighting strategy to iteratively estimate the so-called target distribution. A major drawback of adaptive importance sampling is the large variance of the…

Statistics Theory · Mathematics 2021-11-01 Anna Korba , François Portier

Convex regression is a promising area for bridging statistical estimation and deterministic convex optimization. New piecewise linear convex regression methods are fast and scalable, but can have instability when used to approximate…

Machine Learning · Computer Science 2012-06-22 Lauren Hannah , David Dunson

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Balanced data is required for deep neural networks (DNNs) when learning to perform power system stability assessment. However, power system measurement data contains relatively few events from where power system dynamics can be learnt. To…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Tetiana Bogodorova , Denis Osipov , Luigi Vanfretti

Large-scale replication studies like the Reproducibility Project: Psychology (RP:P) provide invaluable systematic data on scientific replicability, but most analyses and interpretations of the data fail to agree on the definition of…

Methodology · Statistics 2022-03-08 Kenneth Hung , William Fithian

Methods for analyzing representations in neural systems have become a popular tool in both neuroscience and mechanistic interpretability. Having measures to compare how similar activations of neurons are across conditions, architectures,…

Machine Learning · Computer Science 2024-12-24 Quentin Guilhot , Michał Wójcik , Jascha Achterberg , Rui Ponte Costa

Solutions of symbolic regression problems are expressions that are composed of input variables and operators from a finite set of function symbols. One measure for evaluating symbolic regression algorithms is their ability to recover…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Markus Fischer , Joachim Giesen

In this paper, we consider the problem of column subset selection. We present a novel analysis of the spectral norm reconstruction for a simple randomized algorithm and establish a new bound that depends explicitly on the sampling…

Numerical Analysis · Mathematics 2015-05-05 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

Model-X knockoffs is a wrapper that transforms essentially any feature importance measure into a variable selection algorithm, which discovers true effects while rigorously controlling the expected fraction of false positives. A frequently…

Methodology · Statistics 2024-03-12 Stephen Bates , Emmanuel Candès , Lucas Janson , Wenshuo Wang

We consider the problem of offline reinforcement learning where only a set of system transitions is made available for policy optimization. Following recent advances in the field, we consider a model-based reinforcement learning algorithm…

Machine Learning · Computer Science 2024-02-06 Abdelhakim Benechehab , Albert Thomas , Balázs Kégl

Modern machine learning models (such as deep neural networks and boosting decision tree models) have become increasingly popular in financial market prediction, due to their superior capacity to extract complex non-linear patterns. However,…

Machine Learning · Computer Science 2021-02-02 Chuheng Zhang , Yuanqi Li , Xi Chen , Yifei Jin , Pingzhong Tang , Jian Li