English
Related papers

Related papers: Kernel Regression of Multi-Way Data via Tensor Tra…

200 papers

The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn…

Machine Learning · Computer Science 2022-03-22 Jian-Feng Cai , Jingyang Li , Dong Xia

Graph Neural Networks frequently exhibit significant performance degradation in the out-of-distribution test scenario. While test-time training (TTT) offers a promising solution, existing Parameter Finetuning (PaFT) paradigm suffer from…

Machine Learning · Computer Science 2026-01-30 Jiaxin Zhang , Yiqi Wang , Siwei Wang , Xihong Yang , Yu Shi , Xinwang Liu , En Zhu

Kernel methods are an incredibly popular technique for extending linear models to non-linear problems via a mapping to an implicit, high-dimensional feature space. While kernel methods are computationally cheaper than an explicit feature…

Machine Learning · Statistics 2019-02-26 Philip Milton , Emanuele Giorgi , Samir Bhatt

Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to…

Disordered Systems and Neural Networks · Physics 2009-11-13 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

This study presents a hierarchical mining framework for high-dimensional imbalanced data, leveraging a depth graph model to address the inherent performance limitations of conventional approaches in handling complex, high-dimensional data…

Machine Learning · Computer Science 2025-02-07 Yijiashun Qi , Quanchao Lu , Shiyu Dou , Xiaoxuan Sun , Muqing Li , Yankaiqi Li

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

Spatiotemporal data is very common in many applications, such as manufacturing systems and transportation systems. It is typically difficult to be accurately predicted given intrinsic complex spatial and temporal correlations. Most of the…

Machine Learning · Computer Science 2020-04-24 Ziyue Li , Hao Yan , Chen Zhang , Fugee Tsung

Graph problems such as traveling salesman problem, or finding minimal Steiner trees are widely studied and used in data engineering and computer science. Typically, in real-world applications, the features of the graph tend to change over…

Machine Learning · Computer Science 2022-01-14 Udesh Gunarathna , Renata Borovica-Gajic , Shanika Karunasekara , Egemen Tanin

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

Machine Learning · Computer Science 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Modern data sources are typically of large scale and multi-modal natures, and acquired on irregular domains, which poses serious challenges to traditional deep learning models. These issues are partially mitigated by either extending…

Machine Learning · Computer Science 2021-03-30 Yao Lei Xu , Kriton Konstantinidis , Danilo P. Mandic

Currently, existing tensor recovery methods fail to recognize the impact of tensor scale variations on their structural characteristics. Furthermore, existing studies face prohibitive computational costs when dealing with large-scale…

Machine Learning · Computer Science 2025-07-09 Wenjin Qin , Hailin Wang , Jingyao Hou , Jianjun Wang

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

Statistics Theory · Mathematics 2026-05-13 Xin Bing , Chao Wang

This paper proposes an efficient algorithm (HOLRR) to handle regression tasks where the outputs have a tensor structure. We formulate the regression problem as the minimization of a least square criterion under a multilinear rank…

Machine Learning · Computer Science 2016-02-23 Guillaume Rabusseau , Hachem Kadri

Point process modeling is gaining increasing attention, as point process type data are emerging in numerous scientific applications. In this article, motivated by a neuronal spike trains study, we propose a novel point process regression…

Methodology · Statistics 2020-12-10 Xiwei Tang , Lexin Li

We introduce a new regression framework designed to deal with large-scale, complex data that lies around a low-dimensional manifold with noises. Our approach first constructs a graph representation, referred to as the skeleton, to capture…

Machine Learning · Computer Science 2026-03-17 Zeyu Wei , Yen-Chi Chen

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

We consider a least squares regression problem where the data has been generated from a linear model, and we are interested to learn the unknown regression parameters. We consider "sketch-and-solve" methods that randomly project the data…

Statistics Theory · Mathematics 2019-10-08 Edgar Dobriban , Sifan Liu

Graph Representation Learning (GRL) can be fundamentally modeled as a physical process of seeking an energy equilibrium state for a node system on a latent manifold. However, existing Graph Neural Networks (GNNs) often suffer from…

Machine Learning · Computer Science 2026-04-08 Rui Chen , Junjun Guo , Hongbin Wang , Yan Xiang , Yantuan Xian , Zhengtao Yu

Hamiltonian dynamics describe a wide range of physical systems. As such, data-driven simulations of Hamiltonian systems are important for many scientific and engineering problems. In this work, we propose kernel-based methods for…

Numerical Analysis · Mathematics 2025-09-23 Yasamin Jalalian , Mostafa Samir , Boumediene Hamzi , Peyman Tavallali , Houman Owhadi