English
Related papers

Related papers: Deep Neural Networks Guided Ensemble Learning for …

200 papers

This article proposes a meta-learning method for estimating the conditional average treatment effect (CATE) from a few observational data. The proposed method learns how to estimate CATEs from multiple tasks and uses the knowledge for…

Machine Learning · Statistics 2023-05-22 Tomoharu Iwata , Yoichi Chikahara

Variance reduction is a family of powerful mechanisms for stochastic optimization that appears to be helpful in many machine learning tasks. It is based on estimating the exact gradient with some recursive sequences. Previously, many papers…

Optimization and Control · Mathematics 2025-11-07 Aleksandr Shestakov , Valery Parfenov , Aleksandr Beznosikov

Equivariant neural networks are designed to respect symmetries through their architecture, boosting generalization and sample efficiency when those symmetries are present in the data distribution. Real-world data, however, often departs…

Machine Learning · Computer Science 2025-12-12 Andrei Manolache , Luiz F. O. Chamon , Mathias Niepert

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable…

Machine Learning · Statistics 2020-06-03 Jie Chen , Joel Vaughan , Vijayan N. Nair , Agus Sudjianto

Despite increasing popularity in empirical studies, the integration of machine learning generated variables into regression models for statistical inference suffers from the measurement error problem, which can bias estimation and threaten…

Econometrics · Economics 2024-12-23 Gordon Burtch , Edward McFowland , Mochen Yang , Gediminas Adomavicius

This work introduces a novel interpretable machine learning method called Mixture of Decision Trees (MoDT). It constitutes a special case of the Mixture of Experts ensemble architecture, which utilizes a linear model as gating function and…

Machine Learning · Computer Science 2022-11-29 Simeon Brüggenjürgen , Nina Schaaf , Pascal Kerschke , Marco F. Huber

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

We consider the problem of variance reduction in randomized controlled trials, through the use of covariates correlated with the outcome but independent of the treatment. We propose a machine learning regression-adjusted treatment effect…

Machine Learning · Statistics 2022-01-07 Yongyi Guo , Dominic Coey , Mikael Konutgan , Wenting Li , Chris Schoener , Matt Goldman

There is a growing interest in studying sequential neural posterior estimation (SNPE) techniques due to their advantages for simulation-based models with intractable likelihoods. The methods aim to learn the posterior from adaptively…

Computation · Statistics 2025-10-16 Xiliang Yang , Yifei Xiong , Zhijian He

Deep neural networks (DNNs) have recently achieved great success in a multitude of classification tasks. Ensembles of DNNs have been shown to improve the performance. In this paper, we explore the recent state-of-the-art DNNs used for image…

Sound · Computer Science 2017-10-04 Venkatesh Duppada , Sushant Hiray

Recent studies have shown that ensemble approaches could not only improve accuracy and but also estimate model uncertainty in deep learning. However, it requires a large number of parameters according to the increase of ensemble models for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hong Joo Lee , Seong Tae Kim , Hakmin Lee , Nassir Navab , Yong Man Ro

Deep Ensemble (DE) approach is a straightforward technique used to enhance the performance of deep neural networks by training them from different initial points, converging towards various local optima. However, a limitation of this…

Machine Learning · Computer Science 2024-04-25 Hyunsu Kim , Jongmin Yoon , Juho Lee

Estimating the conditional average treatment effects (CATE) is very important in causal inference and has a wide range of applications across many fields. In the estimation process of CATE, the unconfoundedness assumption is typically…

Machine Learning · Computer Science 2024-12-16 Pengfei Shi , Wei Zhong , Xinyu Zhang , Ningtao Wang , Xing Fu , Weiqiang Wang , Yin Jin

Deep metric learning aims to learn an embedding function, modeled as deep neural network. This embedding function usually puts semantically similar images close while dissimilar images far from each other in the learned embedding space.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Wonsik Kim , Bhavya Goyal , Kunal Chawla , Jungmin Lee , Keunjoo Kwon

It is well recognized that the project productivity is a key driver in estimating software project effort from Use Case Point size metric at early software development stages. Although, there are few proposed models for predicting…

Machine Learning · Computer Science 2018-12-18 Mohammad Azzeh , Ali Bou Nassif , Shadi Banitaan , Cuauhtemoc Lopez-Martin

Due to the dominant position of deep learning (mostly deep neural networks) in various artificial intelligence applications, recently, ensemble learning based on deep neural networks (ensemble deep learning) has shown significant…

Machine Learning · Computer Science 2022-11-07 Yongquan Yang , Haijun Lv , Ning Chen

In the field of machine learning, ensemble learning is widely recognized as a pivotal strategy for pushing the boundaries of predictive performance. Traditional static ensemble methods typically assign weights by treating each base learner…

Machine Learning · Computer Science 2026-03-06 Yanxin Liu , Yunqi Zhang