English
Related papers

Related papers: Nonlinear Granger Causality using Kernel Ridge Reg…

200 papers

Multivariate conformal prediction requires nonconformity scores that compress residual vectors into scalars while preserving certain implicit geometric structure of the residual distribution. We introduce a Multivariate Kernel Score (MKS)…

Machine Learning · Statistics 2026-04-24 Louis Meyer , Wenkai Xu

Detecting unobserved confounders is crucial for reliable causal inference in observational studies. Existing methods require either linearity assumptions or multiple heterogeneous environments, limiting applicability to nonlinear…

Machine Learning · Statistics 2026-01-05 Yikai Chen , Yunxin Mao , Chunyuan Zheng , Hao Zou , Shanzhi Gu , Shixuan Liu , Yang Shi , Wenjing Yang , Kun Kuang , Haotian Wang

High-performance GPU kernels are critical for efficient LLM serving, yet their optimization remains a bottleneck requiring deep system expertise. While code LLMs show promise in generating functionally correct code, kernel optimization is…

Machine Learning · Computer Science 2026-02-12 Dezhi Ran , Shuxiao Xie , Mingfang Ji , Anmin Liu , Mengzhou Wu , Yuan Cao , Yuzhe Guo , Hao Yu , Linyi Li , Yitao Hu , Wei Yang , Tao Xie

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Linear residualization is a common practice for confounding adjustment in machine learning (ML) applications. Recently, causality-aware predictive modeling has been proposed as an alternative causality-inspired approach for adjusting for…

Machine Learning · Statistics 2020-11-10 Elias Chaibub Neto

Gaussian processes offer an attractive framework for predictive modeling from longitudinal data, i.e., irregularly sampled, sparse observations from a set of individuals over time. However, such methods have two key shortcomings: (i) They…

Machine Learning · Statistics 2020-12-09 Junjie Liang , Yanting Wu , Dongkuan Xu , Vasant Honavar

Identifying causal relations among simultaneously acquired signals is an important problem in multivariate time series analysis. For linear stochastic systems Granger proposed a simple procedure called the Granger causality to detect such…

Chaotic Dynamics · Physics 2009-11-10 Yonghong Chen , Govindan Rangarajan , Jianfeng Feng , Mingzhou Ding

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

The choice of the kernel is critical to the success of many learning algorithms but it is typically left to the user. Instead, the training data can be used to learn the kernel by selecting it out of a given family, such as that of…

Machine Learning · Computer Science 2012-05-14 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

Multi-kernel learning (MKL) has been widely used in function approximation tasks. The key problem of MKL is to combine kernels in a prescribed dictionary. Inclusion of irrelevant kernels in the dictionary can deteriorate accuracy of MKL,…

Machine Learning · Computer Science 2021-02-10 Pouya M Ghari , Yanning Shen

Mendelian randomization (MR) is widely used to uncover causal relationships in the presence of unmeasured confounders. However, most existing MR methods presuppose linear causality, risking bias when the true relationships are nonlinear,…

Methodology · Statistics 2025-08-05 Xinpei Wang , Tao Huang , Jinzhu Jia

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

We propose a counterfactual approach to train ``causality-aware" predictive models that are able to leverage causal information in static anticausal machine learning tasks (i.e., prediction tasks where the outcome influences the features).…

Applications · Statistics 2020-12-01 Elias Chaibub Neto

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu

Kernel ridge regression (KRR) is a foundational tool in machine learning, with recent work emphasizing its connections to neural networks. However, existing theory primarily addresses the i.i.d. setting, while real-world data often exhibits…

Machine Learning · Statistics 2025-10-20 Dechen Zhang , Zhenmei Shi , Yi Zhang , Yingyu Liang , Difan Zou

This paper is motivated by studies in neuroscience experiments to understand interactions between nodes in a brain network using different types of data modalities that capture different distinct facets of brain activity. To assess…

A computationally efficient protocol for machine learning in chemical space using Boltzmann ensembles of conformers as input is proposed; the method is based on rewriting Kernel Ridge Regression expressions in terms of Structured Orthogonal…

Chemical Physics · Physics 2025-07-11 Konstantin Karandashev

Multiple kernel methods less consider the intrinsic manifold structure of multiple kernel data and estimate the consensus kernel matrix with quadratic number of variables, which makes it vulnerable to the noise and outliers within multiple…

Machine Learning · Computer Science 2024-10-22 Liang Du , Xin Ren , Haiying Zhang , Peng Zhou

Granger causality and variants of this concept allow the study of complex dynamical systems as networks constructed from multivariate time series. In this work, a large number of Granger causality measures used to form causality networks…

Computation · Statistics 2020-01-08 Elsa Siggiridou , Christos Koutlis , Alkiviadis Tsimpiris , Dimitris Kugiumtzis