English
Related papers

Related papers: Generalized support vector regression: duality and…

200 papers

With advances in data collection technologies, tensor data is assuming increasing prominence in many applications and the problem of supervised tensor learning has emerged as a topic of critical significance in the data mining and machine…

Machine Learning · Computer Science 2014-08-06 Lifang He , Xiangnan Kong , Philip S. Yu , Ann B. Ragin , Zhifeng Hao , Xiaowei Yang

Generalization beyond a training dataset is a main goal of machine learning, but theoretical understanding of generalization remains an open problem for many models. The need for a new theory is exacerbated by recent observations in deep…

Machine Learning · Statistics 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

We examine the duality theory for a class of non-convex functions obtained by composing a convex function with a continuous one. Using Fenchel duality, we derive a dual problem that satisfies weak duality under general assumptions. To…

Optimization and Control · Mathematics 2025-10-08 Vittorio Latorre

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

High-dimensional data in the form of tensors are challenging for kernel classification methods. To both reduce the computational complexity and extract informative features, kernels based on low-rank tensor decompositions have been…

Machine Learning · Statistics 2023-02-17 Kirandeep Kour , Sergey Dolgov , Peter Benner , Martin Stoll , Max Pfeffer

Radial Basis Functions Neural Networks (RBFNNs) are tools widely used in regression problems. One of their principal drawbacks is that the formulation corresponding to the training with the supervision of both the centers and the weights is…

Neural and Evolutionary Computing · Computer Science 2013-02-19 Vittorio Latorre , David Yang Gao

Quantum Support Vector Machine is a kernel-based approach to classification problems. We study the applicability of quantum kernels to financial data, specifically our self-curated Dhaka Stock Exchange (DSEx) Broad Index dataset. To the…

Quantum Physics · Physics 2024-12-17 Seemanta Bhattacharjee , MD. Muhtasim Fuad , A. K. M. Fakhrul Hossain

We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ…

Statistics Theory · Mathematics 2022-02-25 Peijun Sang , Zuofeng Shang , Pang Du

In this paper, two generalized algorithms for solving the variational inequality problem in Banach spaces are proposed. Then the strong convergence of the sequences generated by these algorithms will be proved under the suitable conditions.…

Functional Analysis · Mathematics 2021-05-25 M. Ghadampour , E. Soori

The paper presents a novel approach to direct covariance function learning for Bayesian optimisation, with particular emphasis on experimental design problems where an existing corpus of condensed knowledge is present. The method presented…

We investigate a series of learning kernel problems with polynomial combinations of base kernels, which will help us solve regression and classification problems. We also perform some numerical experiments of polynomial kernels with…

Machine Learning · Computer Science 2017-12-27 Chen Li , Luca Venturi , Ruitu Xu

Generalizing classical results of the theory of absolutely summing operators, in this paper we characterize the duals of a quite large class of Banach operator ideals defined or characterized by the transformation of vector-valued…

Functional Analysis · Mathematics 2020-10-06 Geraldo Botelho , Jamilson R. Campos

This paper studies existence and uniqueness of solutions to generalized Volterra integral equations. Since our proof for existence and uniqueness does not make use of Banach fixed point theorem unlike the previous papers focused on this…

Classical Analysis and ODEs · Mathematics 2011-03-01 Basak Karpuz

Set differential equations are usually formulated in terms of the Hukuhara differential, which implies heavy restrictions for the nature of a solution. We propose to reformulate set differential equations as ordinary differential equations…

Classical Analysis and ODEs · Mathematics 2015-08-14 Martin Rasmussen , Janosch Rieger , Kevin Webster

We present an instructive example of using Banach spaces of solutions to (linear, generally, non-scalar) elliptic operator $A$ to investigate variational inverse problems related to neural networks and/or to regularization of solutions to…

Analysis of PDEs · Mathematics 2025-07-01 Alexander Shlapunov , Alexander Polkovnikov , Kseniya Gagelgans

Tensor-based methods are receiving a growing interest in scientific computing for the numerical solution of problems defined in high dimensional tensor product spaces. A family of methods called Proper Generalized Decompositions methods…

Numerical Analysis · Mathematics 2011-12-02 Antonio Falco , Anthony Nouy

This paper addresses the study and characterizations of variational convexity of extended-real-valued functions on Banach spaces. This notion has been recently introduced by Rockafellar, and its importance has been already realized and…

Optimization and Control · Mathematics 2023-08-29 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

Nonlinear kernel regression models are often used in statistics and machine learning because they are more accurate than linear models. Variable selection for kernel regression models is a challenge partly because, unlike the linear…

Methodology · Statistics 2017-06-13 Lorin Crawford , Kris C. Wood , Xiang Zhou , Sayan Mukherjee

Convexity is an important notion in non linear optimization theory as well as in infinite dimensional functional analysis. As will be seen below, very simple and powerful tools will be derived from elementary duality arguments (which are…

Functional Analysis · Mathematics 2020-04-21 Guy Bouchitte