English
Related papers

Related papers: Designing Kernel Scheme for Classifiers Fusion

200 papers

We propose a simple scheme for merging two neural networks trained with different starting initialization into a single one with the same size as the original ones. We do this by carefully selecting channels from each input network. Our…

Machine Learning · Computer Science 2022-08-23 Martin Pašen , Vladimír Boža

We propose a Gradient Boosting algorithm for learning an ensemble of kernel functions adapted to the task at hand. Unlike state-of-the-art Multiple Kernel Learning techniques that make use of a pre-computed dictionary of kernel functions to…

Machine Learning · Statistics 2019-06-17 Léo Gautheron , Pascal Germain , Amaury Habrard , Emilie Morvant , Marc Sebban , Valentina Zantedeschi

We propose a new segmentation model combining common regularization energies, e.g. Markov Random Field (MRF) potentials, and standard pairwise clustering criteria like Normalized Cut (NC), average association (AA), etc. These clustering and…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Meng Tang , Dmitrii Marin , Ismail Ben Ayed , Yuri Boykov

Modern GPUs are able to perform significantly more arithmetic operations than transfers of a single word to or from global memory. Hence, many GPU kernels are limited by memory bandwidth and cannot exploit the arithmetic power of GPUs.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-13 J. Filipovič , M. Madzin , J. Fousek , L. Matyska

Similarity-based clustering and semi-supervised learning methods separate the data into clusters or classes according to the pairwise similarity between the data, and the pairwise similarity is crucial for their performance. In this paper,…

Machine Learning · Statistics 2017-09-06 Yingzhen Yang , Feng Liang , Nebojsa Jojic , Shuicheng Yan , Jiashi Feng , Thomas S. Huang

Quantum machine learning with quantum kernels for classification problems is a growing area of research. Recently, quantum kernel alignment techniques that parameterise the kernel have been developed, allowing the kernel to be trained and…

In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques,…

Signal Processing · Electrical Eng. & Systems 2018-08-21 A. Flores , R. C. de Lamare

To cluster data that are not linearly separable in the original feature space, $k$-means clustering was extended to the kernel version. However, the performance of kernel $k$-means clustering largely depends on the choice of kernel…

Machine Learning · Computer Science 2018-11-02 Yaqiang Yao , Huanhuan Chen

Collaborative filtering is the simplest but oldest machine learning algorithm in the field of recommender systems. In spite of its long history, it remains a discussion topic in research venues. Usually people use users/items whose…

Information Retrieval · Computer Science 2023-03-09 Hao Wang

Deep Convolutional Neural Networks (CNNs) are capable of learning unprecedentedly effective features from images. Some researchers have struggled to enhance the parameters' efficiency using grouped convolution. However, the relation between…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Yujia Chen , Ce Li

Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a…

Machine Learning · Computer Science 2018-11-06 Hui-Ling Zhen , Xi Lin , Alan Z. Tang , Zhenhua Li , Qingfu Zhang , Sam Kwong

Kernel methods are widely used in machine learning, especially for classification problems. However, the theoretical analysis of kernel classification is still limited. This paper investigates the statistical performances of kernel…

Statistics Theory · Mathematics 2024-02-05 Jianfa Lai , Zhifan Li , Dongming Huang , Qian Lin

Improving the performance of classifiers is the realm of feature mapping, prototype selection, and kernel function transformations; these techniques aim for reducing the complexity, and also, improving the accuracy of models. In particular,…

Machine Learning · Computer Science 2019-10-04 Jose Ortiz-Bejar , Eric S. Tellez , Mario Graff

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

The main flaw of neural network ensembling is that it is exceptionally demanding computationally, especially, if the individual sub-models are large neural networks, which must be trained separately. Having in mind that modern DNNs can be…

Machine Learning · Computer Science 2020-03-31 Ludwik Bukowski , Witold Dzwinel

Network pruning is widely used to lighten and accelerate neural network models. Structured network pruning discards the whole neuron or filter, leading to accuracy loss. In this work, we propose a novel concept of neuron merging applicable…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Woojeong Kim , Suhyun Kim , Mincheol Park , Geonseok Jeon

We introduce a new procedure for training of artificial neural networks by using the approximation of an objective function by arithmetic mean of an ensemble of selected randomly generated neural networks, and apply this procedure to the…

Neural and Evolutionary Computing · Computer Science 2012-02-21 S. V. Kozyrev

In this paper we extend an earlier result within Dempster-Shafer theory ["Fast Dempster-Shafer Clustering Using a Neural Network Structure," in Proc. Seventh Int. Conf. Information Processing and Management of Uncertainty in Knowledge-Based…

Artificial Intelligence · Computer Science 2007-05-23 Johan Schubert

Fusion is a technique for merging multiple independently-trained neural networks in order to combine their capabilities. Past attempts have been restricted to the case of fully-connected, convolutional, and residual networks. This paper…

Machine Learning · Computer Science 2024-04-23 Moritz Imfeld , Jacopo Graldi , Marco Giordano , Thomas Hofmann , Sotiris Anagnostidis , Sidak Pal Singh

Quantum machine learning has the potential to enable advances in artificial intelligence, such as solving problems intractable on classical computers. Some fundamental ideas behind quantum machine learning are similar to kernel methods in…

Quantum Physics · Physics 2023-08-15 Samuel Bosch , Bobak Kiani , Rui Yang , Adrian Lupascu , Seth Lloyd