English
Related papers

Related papers: Efficiency versus Convergence of Boolean Kernels f…

200 papers

Random features is one of the most popular techniques to speed up kernel methods in large-scale problems. Related works have been recognized by the NeurIPS Test-of-Time award in 2017 and the ICML Best Paper Finalist in 2019. The body of…

Machine Learning · Statistics 2021-07-13 Fanghui Liu , Xiaolin Huang , Yudong Chen , Johan A. K. Suykens

Convolutional Neural Networks are extensively used in a wide range of applications, commonly including computer vision tasks like image and video classification, recognition, and segmentation. Recent research results demonstrate that…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Marco Carreras , Gianfranco Deriu , Luigi Raffo , Luca Benini , Paolo Meloni

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

These lecture notes develop the theory of learning in deep and recurrent neuronal networks from the point of view of Bayesian inference. The aim is to enable the reader to understand typical computations found in the literature in this…

Disordered Systems and Neural Networks · Physics 2026-02-16 Moritz Helias , Javed Lindner , Lars Schutzeichel , Zohar Ringel

Many popular machine learning models scale poorly when deployed on CPUs. In this paper we explore the reasons why and propose a simple, yet effective approach based on the well-known Divide-and-Conquer Principle to tackle this problem of…

Machine Learning · Computer Science 2023-03-03 Alex Kogan

Metric and kernel learning are important in several machine learning applications. However, most existing metric learning algorithms are limited to learning metrics over low-dimensional data, while existing kernel learning algorithms are…

Machine Learning · Computer Science 2009-11-02 Prateek Jain , Brian Kulis , Jason V. Davis , Inderjit S. Dhillon

Mathematical definitions of polyhedrons and perceptron networks are discussed. The formalization of polyhedrons is done in a rather traditional way. For networks, previously proposed systems are developed. Perceptron networks in disjunctive…

Neural and Evolutionary Computing · Computer Science 2013-11-06 Daniel Crespin

While deep neural networks (DNN) have become an effective computational tool, the prediction results are often criticized by the lack of interpretability, which is essential in many real-world applications such as health informatics.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Mengnan Du , Ninghao Liu , Qingquan Song , Xia Hu

In this paper we consider the problems of supervised classification and regression in the case where attributes and labels are functions: a data is represented by a set of functions, and the label is also a function. We focus on the use of…

Machine Learning · Computer Science 2016-11-03 Hachem Kadri , Emmanuel Duflos , Philippe Preux , Stéphane Canu , Alain Rakotomamonjy , Julien Audiffren

We consider binary classification problems using local features of objects. One of motivating applications is time-series classification, where features reflecting some local closeness measure between a time series and a pattern sequence…

Machine Learning · Computer Science 2017-09-08 Daiki Suehiro , Kohei Hatano , Eiji Takimoto , Shuji Yamamoto , Kenichi Bannai , Akiko Takeda

A key property of neural networks driving their success is their ability to learn features from data. Understanding feature learning from a theoretical viewpoint is an emerging field with many open questions. In this work we capture…

Disordered Systems and Neural Networks · Physics 2024-05-20 Kirsten Fischer , Javed Lindner , David Dahmen , Zohar Ringel , Michael Krämer , Moritz Helias

Large scale online kernel learning aims to build an efficient and scalable kernel-based predictive model incrementally from a sequence of potentially infinite data points. A current key approach focuses on ways to produce an approximate…

Machine Learning · Computer Science 2019-09-25 Kai Ming Ting , Jonathan R. Wells , Takashi Washio

According to the Hughes phenomenon, the major challenges encountered in computations with learning models comes from the scale of complexity, e.g. the so-called curse of dimensionality. There are various approaches for accelerate learning…

Machine Learning · Computer Science 2024-10-15 Luisa D'Amore

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

Machine Learning · Computer Science 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

Deep Convolutional Neural Networks (CNNs) are capable of learning unprecedentedly effective features from images. Some researchers have struggled to enhance the parameters' efficiency using grouped convolution. However, the relation between…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Yujia Chen , Ce Li

The predominant success of diffusion models in generative modeling has spurred significant interest in understanding their theoretical foundations. In this work, we propose a feature learning framework aimed at analyzing and comparing the…

Machine Learning · Statistics 2025-03-04 Andi Han , Wei Huang , Yuan Cao , Difan Zou

In many personalized recommendation problems available data consists only of positive interactions (implicit feedback) between users and items. This problem is also known as One-Class Collaborative Filtering (OC-CF). Linear models usually…

Information Retrieval · Computer Science 2017-07-19 Mirko Polato , Fabio Aiolli

Dominant areas of computer science and computation systems are intensively linked to the hypercube-related studies and interpretations. This article presents some transformations and analytics for some example algorithms and Boolean domain…

Discrete Mathematics · Computer Science 2024-02-05 Levon Aslanyan , Irina Arsenyan , Vilik Karakhanyan , Hasmik Sahakyan

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Few-shot models aim at making predictions using a minimal number of labeled examples from a given task. The main challenge in this area is the one-shot setting where only one element represents each class. We propose HyperShot - the fusion…