English
Related papers

Related papers: Robust Non-Linear Correlations via Polynomial Regr…

200 papers

Kernel ridge regression (KRR) and Gaussian processes (GPs) are fundamental tools in statistics and machine learning, with recent applications to highly over-parameterized deep neural networks. The ability of these tools to learn a target…

Machine Learning · Statistics 2025-02-18 Itay Lavie , Zohar Ringel

Graph Neural Networks (GNNs) have demonstrated impressive performance across various tasks, leading to their increased adoption in high-stakes decision-making systems. However, concerns have arisen about GNNs potentially generating unfair…

Machine Learning · Computer Science 2026-01-09 Anuj Kumar Sirohi , Anjali Gupta , Sandeep Kumar , Amitabha Bagchi , Sayan Ranu

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

Hypergraph neural networks (HGNN) have recently become attractive and received significant attention due to their excellent performance in various domains. However, most existing HGNNs rely on first-order approximations of hypergraph…

Artificial Intelligence · Computer Science 2024-01-11 Maolin Wang , Yaoming Zhen , Yu Pan , Yao Zhao , Chenyi Zhuang , Zenglin Xu , Ruocheng Guo , Xiangyu Zhao

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

The R package RegressionFactory provides expander functions for constructing the high-dimensional gradient vector and Hessian matrix of the log-likelihood function for generalized linear models (GLMs), from the lower-dimensional…

Computation · Statistics 2015-01-27 Alireza S. Mahani , Mansour T. A. Sharabiani

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

Machine Learning · Computer Science 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

We investigate the topics of sensitivity and robustness in feedforward and convolutional neural networks. Combining energy landscape techniques developed in computational chemistry with tools drawn from formal methods, we produce empirical…

Machine Learning · Statistics 2018-12-06 Timothy E. Wang , Yiming Gu , Dhagash Mehta , Xiaojun Zhao , Edgar A. Bernal

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We propose a new class of deep reinforcement learning (RL) algorithms that model latent representations in hyperbolic space. Sequential decision-making requires reasoning about the possible future consequences of current behavior.…

Machine Learning · Computer Science 2022-10-05 Edoardo Cetin , Benjamin Chamberlain , Michael Bronstein , Jonathan J Hunt

Modeling a high-dimensional Hamiltonian system in reduced dimensions with respect to coarse-grained (CG) variables can greatly reduce computational cost and enable efficient bottom-up prediction of main features of the system for many…

Computational Engineering, Finance, and Science · Computer Science 2021-04-09 Shu Wang , Zhan Ma , Wenxiao Pan

Reinforcement Learning (RL) algorithms allow artificial agents to improve their action selections so as to increase rewarding experiences in their environments. Deep Reinforcement Learning algorithms require solving a nonconvex and…

Machine Learning · Computer Science 2019-04-18 Jacob Rafati , Roummel F. Marcia

We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + \epsilon$ (with $X \in \mathbb{R}^d$ and $\epsilon$ independent), in…

Vector autoregressive models characterize a variety of time series in which linear combinations of current and past observations can be used to accurately predict future observations. For instance, each element of an observation vector…

Machine Learning · Statistics 2017-06-27 Eric C. Hall , Garvesh Raskutti , Rebecca Willett

Multi-relational learning has received lots of attention from researchers in various research communities. Most existing methods either suffer from superlinear per-iteration cost, or are sensitive to the given ranks. To address both issues,…

Machine Learning · Computer Science 2016-01-19 Fanhua Shang , James Cheng , Hong Cheng

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

Machine Learning · Computer Science 2019-05-28 Matthew Staib , Stefanie Jegelka

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by…

Machine Learning · Computer Science 2022-04-04 Maximilian Seitzer , Arash Tavakoli , Dimitrije Antic , Georg Martius

Graph Neural Networks (GNNs) have become the standard for graph representation learning but remain vulnerable to structural perturbations. We propose a novel framework that integrates persistent homology features with stability…

Machine Learning · Computer Science 2025-12-17 Jelena Losic

The purpose of this paper is to develop a self-optimized association algorithm based on PGRL (Policy Gradient Reinforcement Learning), which is both scalable, stable and robust. The term robust means that performance degradation in the…

Networking and Internet Architecture · Computer Science 2013-06-12 Richard Combes , Ilham El Bouloumi , Stephane Senecal , Zwi Altman