English
Related papers

Related papers: Ensemble of heterogeneous flexible neural trees us…

200 papers

Meta learning with multiple objectives can be formulated as a Multi-Objective Bi-Level optimization Problem (MOBLP) where the upper-level subproblem is to solve several possible conflicting targets for the meta learner. However, existing…

Machine Learning · Computer Science 2021-02-16 Feiyang Ye , Baijiong Lin , Zhixiong Yue , Pengxin Guo , Qiao Xiao , Yu Zhang

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Evolutionary Multitasking (EMT) paradigm, an emerging research topic in evolutionary computation, has been successfully applied in solving high-dimensional feature selection (FS) problems recently. However, existing EMT-based FS methods…

Neural and Evolutionary Computing · Computer Science 2024-01-04 Yinglan Feng , Liang Feng , Songbai Liu , Sam Kwong , Kay Chen Tan

In solving multi-modal, multi-objective optimization problems (MMOPs), the objective is not only to find a good representation of the Pareto-optimal front (PF) in the objective space but also to find all equivalent Pareto-optimal subsets…

Neural and Evolutionary Computing · Computer Science 2022-10-24 Tapabrata Ray , Mohammad Mohiuddin Mamun , Hemant Kumar Singh

Large Language Models (LLMs) have the ability to solve a variety of tasks, such as text summarization and mathematical questions, just out of the box, but they are often trained with a single task in mind. Due to high computational costs,…

Computation and Language · Computer Science 2025-01-22 Chen Dun , Mirian Hipolito Garcia , Guoqing Zheng , Ahmed Hassan Awadallah , Anastasios Kyrillidis , Robert Sim

Convolutional Neural Networks have achieved state-of-the-art performance on a wide range of tasks. Most benchmarks are led by ensembles of these powerful learners, but ensembling is typically treated as a post-hoc procedure implemented by…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Stefan Lee , Senthil Purushwalkam , Michael Cogswell , David Crandall , Dhruv Batra

While hardware-software co-design has significantly improved the efficiency of neural network inference, modeling the training phase remains a critical yet underexplored challenge. Training workloads impose distinct constraints,…

Machine Learning · Computer Science 2026-03-17 Jérémy Morlier , Robin Geens , Stef Cuyckens , Arne Symons , Marian Verhelst , Vincent Gripon , Mathieu Léonardon

We consider feature representation learning problem of molecular graphs. Graph Neural Networks have been widely used in feature representation learning of molecular graphs. However, most existing methods deal with molecular graphs…

Machine Learning · Computer Science 2022-06-08 Zhaoning Yu , Hongyang Gao

Integrating multi-omics data, such as DNA methylation, mRNA expression, and microRNA (miRNA) expression, offers a comprehensive view of the biological mechanisms underlying disease. However, the high dimensionality of multi-omics data, the…

Machine Learning · Computer Science 2026-02-12 Tiantian Yang , Zhiqian Chen

The performance of any Machine Learning (ML) algorithm is impacted by the choice of its hyperparameters. As training and evaluating a ML algorithm is usually expensive, the hyperparameter optimization (HPO) method needs to be…

Machine Learning · Computer Science 2022-09-12 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Gonzalo Nápoles

Two important characteristics of multi-objective evolutionary algorithms are distribution and convergency. As a classic multi-objective genetic algorithm, NSGA-II is widely used in multi-objective optimization fields. However, in NSGA-II,…

Neural and Evolutionary Computing · Computer Science 2019-01-04 Xinwu Yang , Guizeng You , Chong Zhao , Mengfei Dou , Xinian Guo

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

The supertree construction problem is about combining several phylogenetic trees with possibly conflicting information into a single tree that has all the leaves of the source trees as its leaves and the relationships between the leaves are…

Computational Engineering, Finance, and Science · Computer Science 2020-02-19 Laura Koponen , Emilia Oikarinen , Tomi Janhunen , Laura Säilä

Model-heterogeneous personalized federated learning (MHPFL) enables FL clients to train structurally different personalized models on non-independent and identically distributed (non-IID) local data. Existing MHPFL methods focus on…

Machine Learning · Computer Science 2024-04-30 Liping Yi , Han Yu , Chao Ren , Heng Zhang , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

This paper focuses on the data-insufficiency problem in multi-task learning within an episodic training setup. Specifically, we explore the potential of heterogeneous information across tasks and meta-knowledge among episodes to effectively…

Machine Learning · Computer Science 2023-10-31 Jiayi Shen , Xiantong Zhen , Qi , Wang , Marcel Worring

The traditional Multilayer Perceptron (MLP) using McCulloch-Pitts neuron model is inherently limited to a set of neuronal activities, i.e., linear weighted sum followed by nonlinear thresholding step. Previously, Generalized Operational…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Dat Thanh Tran , Serkan Kiranyaz , Moncef Gabbouj , Alexandros Iosifidis

Evolutionary Computation algorithms have been used to solve optimization problems in relation with architectural, hyper-parameter or training configuration, forging the field known today as Neural Architecture Search. These algorithms have…

Neural and Evolutionary Computing · Computer Science 2024-02-06 Javier Poyatos , Daniel Molina , Aitor Martínez , Javier Del Ser , Francisco Herrera

Many crucial scientific problems involve designing novel molecules with desired properties, which can be formulated as a black-box optimization problem over the discrete chemical space. In practice, multiple conflicting objectives and…

Machine Learning · Computer Science 2023-11-03 Yiheng Zhu , Jialu Wu , Chaowen Hu , Jiahuan Yan , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

In recent years, graph neural networks (GNNs) have gained increasing attention, as they possess the excellent capability of processing graph-related problems. In practice, hyperparameter optimisation (HPO) is critical for GNNs to achieve…

Machine Learning · Computer Science 2021-04-29 Yingfang Yuan , Wenjun Wang , Wei Pang