English
Related papers

Related papers: Shape constrained kernel-weighted least squares: A…

200 papers

The least-squares support vector machine is a frequently used kernel method for non-linear regression and classification tasks. Here we discuss several approximation algorithms for the least-squares support vector machine classifier. The…

Machine Learning · Computer Science 2017-03-24 M. Andrecut

We consider functional linear regression models where functional outcomes are associated with scalar predictors by coefficient functions with shape constraints, such as monotonicity and convexity, that apply to sub-domains of interest. To…

Methodology · Statistics 2025-05-09 Kyunghee Han , Yeonjoo Park , Soo-Young Kim

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

Methodology · Statistics 2025-10-31 Zhiqiang Liao , Zhaonan Qu

Motivated by the need for the rigorous analysis of the numerical stability of variational least-squares kernel-based methods for solving second-order elliptic partial differential equations, we provide previously lacking stability…

Numerical Analysis · Mathematics 2024-12-17 Meng Chen , Leevan Ling , Dongfang Yun

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy…

Machine Learning · Statistics 2020-10-16 Jackson Gorham , Lester Mackey

We investigate the time-varying ARCH (tvARCH) process. It is shown that it can be used to describe the slow decay of the sample autocorrelations of the squared returns often observed in financial time series, which warrants the further…

Statistics Theory · Mathematics 2008-12-18 Piotr Fryzlewicz , Theofanis Sapatinas , Suhasini Subba Rao

We study kernel quadrature rules with convex weights. Our approach combines the spectral properties of the kernel with recombination results about point measures. This results in effective algorithms that construct convex quadrature rules…

Numerical Analysis · Mathematics 2022-10-12 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

We present a geometric formulation of the Multiple Kernel Learning (MKL) problem. To do so, we reinterpret the problem of learning kernel weights as searching for a kernel that maximizes the minimum (kernel) distance between two convex…

Machine Learning · Computer Science 2014-03-18 John Moeller , Parasaran Raman , Avishek Saha , Suresh Venkatasubramanian

A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation…

Optimization and Control · Mathematics 2020-05-29 Rachel E. Keil , Alexander T. Miller , Mrinal Kumar , Anil V. Rao

We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares…

Methodology · Statistics 2023-10-24 Somabha Mukherjee , Rohit K. Patra , Andrew L. Johnson , Hiroshi Morita

It is proposed to revisit the inverse problem associated with Smoluchowski's coagulation equation. The objective is to reconstruct the functional form of the collision kernel from observations of the time evolution of the cluster size…

Statistical Mechanics · Physics 2015-05-27 Colm Connaughton , Peter P. Jones

Large language models (LLMs) have spurred development in multiple industries. However, the growing number of their parameters brings substantial storage and computing burdens, making it essential to explore model compression techniques for…

Machine Learning · Computer Science 2025-01-16 Binrui Zeng , Yongtao Tang , Xiaodong Liu , Xiaopeng Li

We propose a novel nonparametric regression method that models complex input-output relationships as the sum of convex and concave components. The method-Identifiable Convex-Concave Nonparametric Least Squares (ICCNLS)-decomposes the target…

Machine Learning · Statistics 2025-06-24 William Chung

The K-means algorithm is among the most commonly used data clustering methods. However, the regular K-means can only be applied in the input space and it is applicable when clusters are linearly separable. The kernel K-means, which extends…

Machine Learning · Computer Science 2020-12-08 Amir Aradnia , Maryam Amir Haeri , Mohammad Mehdi Ebadzadeh

Least squares kernel based methods have been widely used in regression problems due to the simple implementation and good generalization performance. Among them, least squares support vector regression (LS-SVR) and extreme learning machine…

Machine Learning · Computer Science 2020-06-03 Hongwei Dong , Liming Yang

We define a measure on tuples of partitions, called the symplectic Schur process, that should be regarded as the right analogue of the Schur process of Okounkov-Reshetikhin for the Cartan type C. The weights of our measure include factors…

Mathematical Physics · Physics 2026-04-30 Cesar Cuenca , Matteo Mucciconi

Kernel logistic regression (KLR) is a powerful classification method widely applied across diverse domains. In many real-world scenarios, indefinite kernels capture more domain-specific structural information than positive definite kernels.…

Machine Learning · Statistics 2025-10-31 Shaoxin Wang , Hanjing Yao

In this paper, we are interested in constructing general graph-based regularizers for multiple kernel learning (MKL) given a structure which is used to describe the way of combining basis kernels. Such structures are represented by…

Machine Learning · Statistics 2014-02-14 Ziming Zhang

Multiple kernel clustering (MKC) is committed to achieving optimal information fusion from a set of base kernels. Constructing precise and local kernel matrices is proved to be of vital significance in applications since the unreliable…

Machine Learning · Computer Science 2022-07-08 Liang Li , Siwei Wang , Xinwang Liu , En Zhu , Li Shen , Kenli Li , Keqin Li

This paper introduces a novel constraint adaptive filtering algorithm based on a relative logarithmic cost function which is termed as Constrained Least Mean Logarithmic Square (CLMLS). The proposed CLMLS algorithm elegantly adjusts the…

Systems and Control · Computer Science 2018-01-22 Vinay Chakravarthi Gogineni , Subrahmanyam Mula