English
Related papers

Related papers: Likelihood-free inference with an improved cross-e…

200 papers

In this paper, we develop a novel efficient and robust nonparametric regression estimator under a framework of feedforward neural network. There are several interesting characteristics for the proposed estimator. First, the loss function is…

Methodology · Statistics 2023-09-25 Xuancheng Wang , Ling Zhou , Huazhen Lin

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

Probabilistic user modeling is essential for building machine learning systems in the ubiquitous cases with humans in the loop. However, modern advanced user models, often designed as cognitive behavior simulators, are incompatible with…

Machine Learning · Computer Science 2023-06-29 Alex Hämäläinen , Mustafa Mert Çelikok , Samuel Kaski

We introduce a framework using Generative Adversarial Networks (GANs) for likelihood--free inference (LFI) and Approximate Bayesian Computation (ABC) where we replace the black-box simulator model with an approximator network and generate a…

Machine Learning · Computer Science 2018-08-24 Vinay Jethava , Devdatt Dubhashi

Recent developments of advanced driver-assistance systems necessitate an increasing number of tests to validate new technologies. These tests cannot be carried out on track in a reasonable amount of time and automotive groups rely on…

Machine Learning · Statistics 2022-12-16 Clara Carlier , Arnaud Franju , Matthieu Lerasle , Mathias Obrebski

In this work, we study the learning theory of reward modeling with pairwise comparison data using deep neural networks. We establish a novel non-asymptotic regret bound for deep reward estimators in a non-parametric setting, which depends…

Machine Learning · Statistics 2025-05-13 Yuanhang Luo , Yeheng Ge , Ruijian Han , Guohao Shen

Surrogate endpoints are used in place of long-term outcomes in randomized experiments when observing the real outcome for a large enough cohort is prohibitively expensive or impractical. A short-term surrogate is good if the result of an…

Classical semiparametric inference with missing outcome data is not robust to contamination of the observed data and a single observation can have arbitrarily large influence on estimation of a parameter of interest. This sensitivity is…

Methodology · Statistics 2021-03-02 Eva Cantoni , Xavier de Luna

Work in the classification literature has shown that in computing a classification function, one need not know the class membership of all observations in the training set; the unlabeled observations still provide information on the…

Machine Learning · Statistics 2015-10-07 Norman Matloff

Modeling the evolution of physical systems is critical to many applications in science and engineering. As the evolution of these systems is governed by partial differential equations (PDEs), there are a number of computational simulations…

Machine Learning · Computer Science 2025-03-17 Bharat Srikishan , Daniel O'Malley , Mohamed Mehana , Nicholas Lubbers , Nikhil Muralidhar

We introduce a probability distribution, combined with an efficient sampling algorithm, for weights and biases of fully-connected neural networks. In a supervised learning context, no iterative optimization or gradient computations of…

Machine Learning · Computer Science 2023-11-14 Erik Lien Bolager , Iryna Burak , Chinmay Datar , Qing Sun , Felix Dietrich

In deep neural network, the cross-entropy loss function is commonly used for classification. Minimizing cross-entropy is equivalent to maximizing likelihood under assumptions of uniform feature and class distributions. It belongs to…

Machine Learning · Computer Science 2018-05-01 Donglai Zhu , Hengshuai Yao , Bei Jiang , Peng Yu

Conventional deep reinforcement learning methods are sample-inefficient and usually require a large number of training trials before convergence. Since such methods operate on an unconstrained action set, they can lead to useless actions. A…

Artificial Intelligence · Computer Science 2021-03-04 Daiki Kimura , Subhajit Chaudhury , Akifumi Wachi , Ryosuke Kohita , Asim Munawar , Michiaki Tatsubori , Alexander Gray

One of the central challenges in modern machine learning is understanding how neural networks generalize knowledge learned from training data to unseen test data. While numerous empirical techniques have been proposed to improve…

Machine Learning · Computer Science 2025-04-18 Entao Yang , Xiaotian Zhang , Yue Shang , Ge Zhang

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

Statistical significance testing of neural coherence is essential for distinguishing genuine cross-signal coupling from spurious correlations. A widely accepted approach uses surrogate-based inference, where null distributions are generated…

Signal Processing · Electrical Eng. & Systems 2026-05-13 Md Rakibul Mowla , Sukhbinder Kumar , Ariane E. Rhone , Brian J. Dlouhy , Christopher K. Kovach

Using Neuroevolution combined with Novelty Search to promote behavioural diversity is capable of constructing high-performing ensembles for classification. However, using gradient descent to train evolved architectures during the search can…

Machine Learning · Computer Science 2022-02-09 Rui P. Cardoso , Emma Hart , David Burth Kurka , Jeremy V. Pitt

In this article, we construct empirical likelihood (EL)-weighted estimators of linear functionals of a probability measure in the presence of side information. Motivated by nuisance parameters in semiparametric models with possibly infinite…

Statistics Theory · Mathematics 2023-01-25 Shan Wang , Hanxiang Peng

Variational inference is a powerful paradigm for approximate Bayesian inference with a number of appealing properties, including support for model learning and data subsampling. By contrast MCMC methods like Hamiltonian Monte Carlo do not…

Machine Learning · Statistics 2022-07-14 Martin Jankowiak , Du Phan

The increasing penetration of renewable generation introduces uncertainty into power systems, challenging traditional deterministic optimization methods. Chance-constrained optimization offers an approach to balancing cost and risk;…

Optimization and Control · Mathematics 2025-11-06 Amir Bahador Javadi , Amin Kargarian