English
Related papers

Related papers: Local Function Complexity for Active Learning via …

200 papers

The Linear Model of Co-regionalization (LMC) is a very general multitask gaussian process model for regression or classification. While its expressiveness and conceptual simplicity are appealing, naive implementations have cubic complexity…

Machine Learning · Computer Science 2026-03-18 Olivier Truffinet , Karim Ammar , Jean-Philippe Argaud , Bertrand Bouriquet

Modelling the behaviour of highly nonlinear dynamical systems with robust uncertainty quantification is a challenging task which typically requires approaches specifically designed to address the problem at hand. We introduce a…

Machine Learning · Statistics 2024-01-25 Thomas Baldwin-McDonald , Mauricio A. Álvarez

Federated learning (FL) allows multiple clients to collaboratively learn a globally shared model through cycles of model aggregation and local model training, without the need to share data. Most existing FL methods train local models…

Machine Learning · Computer Science 2023-12-05 Liangxi Liu , Xi Jiang , Feng Zheng , Hong Chen , Guo-Jun Qi , Heng Huang , Ling Shao

We study a non linear regression model with functional data as inputs and scalar response. We propose a pointwise estimate of the regression function that maps a Hilbert space onto the real line by a local linear method. We provide the…

Statistics Theory · Mathematics 2013-02-20 Alain Berlinet , Abdallah Elamine , André Mas

In functional data analysis, functional linear regression has attracted significant attention recently. Herein, we consider the case where both the response and covariates are functions. There are two available approaches for addressing…

Methodology · Statistics 2021-09-28 Mauro Bernardi , Antonio Canale , Marco Stefanucci

A Gaussian process is proposed as a model for the posterior distribution of the local predictive ability of a model or expert, conditional on a vector of covariates, from historical predictions in the form of log predictive scores. Assuming…

Methodology · Statistics 2024-10-08 Oscar Oelrich , Mattias Villani

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

The propensity score is widely used for causal inference in observational studies, but common parametric estimators can produce biased and inefficient effect estimates when model assumptions are violated. Nonparametric approaches reduce…

Methodology · Statistics 2026-04-09 Maosen Peng , Yan Li , Chong Wu , Liang Li

Large scale Gaussian process (GP) regression is infeasible for larger data sets due to cubic scaling of flops and quadratic storage involved in working with covariance matrices. Remedies in recent literature focus on divide-and-conquer,…

Methodology · Statistics 2020-05-28 Adam M. Edwards , Robert B. Gramacy

In the domain of combat simulations, the training and deployment of deep reinforcement learning (RL) agents still face substantial challenges due to the dynamic and intricate nature of such environments. Unfortunately, as the complexity of…

Machine Learning · Computer Science 2024-08-27 Scotty Black , Christian Darken

As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP…

Machine Learning · Statistics 2018-11-06 Haitao Liu , Jianfei Cai , Yew-Soon Ong , Yi Wang

Autonomous Land Vehicles (ALV) shall efficiently recognize the ground in unknown environments. A novel $\mathcal{GP}$-based method is proposed for the ground segmentation task in rough driving scenarios. A non-stationary covariance function…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Pouria Mehrabi , Hamid D. Taghirad

Log-linear models are arguably the most successful class of graphical models for large-scale applications because of their simplicity and tractability. Learning and inference with these models require calculating the partition function,…

Machine Learning · Statistics 2017-03-16 Ryan Spring , Anshumali Shrivastava

We initiate a program of average smoothness analysis for efficiently learning real-valued functions on metric spaces. Rather than using the Lipschitz constant as the regularizer, we define a local slope at each point and gauge the function…

Statistics Theory · Mathematics 2020-11-10 Yair Ashlagi , Lee-Ad Gottlieb , Aryeh Kontorovich

Personalized Federated Learning (PFL) enables a collection of agents to collaboratively learn individual models without sharing raw data. We propose a new PFL approach in which each agent optimizes a weighted combination of all agents'…

Machine Learning · Computer Science 2026-03-04 Jean-Baptiste Fermanian , Batiste Le Bars , Aurélien Bellet

The objective of active level set estimation for a black-box function is to precisely identify regions where the function values exceed or fall below a specified threshold by iteratively performing function evaluations to gather more…

Machine Learning · Computer Science 2024-10-10 Giang Ngo , Dang Nguyen , Sunil Gupta

Several pool-based active learning algorithms (AL) were employed to model potential energy surfaces (PESs) with a minimum number of electronic structure calculations. Theoretical and empirical results suggest that superior strategies can be…

Chemical Physics · Physics 2021-10-27 Yahya Saleh , Vishnu Sanjay , Armin Iske , Andrey Yachmenev , Jochen Küpper

Many applications that use empirically estimated functions face a curse of dimensionality, because the integrals over most function classes must be approximated by sampling. This paper introduces a novel regression-algorithm that learns…

Machine Learning · Computer Science 2015-03-31 Wendelin Böhmer , Klaus Obermayer

Researchers are exploring novel computational paradigms such as sparse coding and neuromorphic computing to bridge the efficiency gap between the human brain and conventional computers in complex tasks. A key area of focus is neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Soufiyan Bahadi , Eric Plourde , Jean Rouat

Laplace approximations are a standard tool for computationally efficient inference in latent Gaussian models, but they fail for quantile regression with the asymmetric Laplace likelihood because the observed Hessian vanishes almost…

Methodology · Statistics 2026-05-21 Andrea Nava , Fabio Sigrist