English
Related papers

Related papers: Functional Analysis of Loss-development Patterns i…

200 papers

Designing models that are both expressive and preserve known invariances of tasks is an increasingly hard problem. Existing solutions tradeoff invariance for computational or memory resources. In this work, we show how to leverage…

Machine Learning · Computer Science 2023-09-29 Leonardo Cotta , Gal Yehuda , Assaf Schuster , Chris J. Maddison

We consider the problem of learning the functions computing children from parents in a Structural Causal Model once the underlying causal graph has been identified. This is in some sense the second step after causal discovery. Taking a…

Machine Learning · Statistics 2017-07-03 Paul K. Rubenstein , Ilya Tolstikhin , Philipp Hennig , Bernhard Schoelkopf

We propose a new loss function for supervised and physics-informed training of neural networks and operators that incorporates a posteriori error estimate. More specifically, during the training stage, the neural network learns additional…

Numerical Analysis · Mathematics 2024-02-09 Vladimir Fanaskov , Alexander Rudikov , Ivan Oseledets

In the last few decades, building regression models for non-scalar variables, including time series, text, image, and video, has attracted increasing interests of researchers from the data analytic community. In this paper, we focus on a…

Machine Learning · Computer Science 2020-12-01 Qiyao Wang , Haiyan Wang , Chetan Gupta , Aniruddha Rajendra Rao , Hamed Khorasgani

Stochastic Closed-Loop Active Fault Diagnosis (CLAFD) aims to select the input sequentially in order to improve the discrimination of different models by minimizing the predicted error probability. As computation of these error…

Systems and Control · Electrical Eng. & Systems 2024-01-12 Jacques Noom , Oleg Soloviev , Carlas Smith , Michel Verhaegen

People employ the function-on-function regression to model the relationship between two random curves. Fitting this model, widely used strategies include algorithms falling into the framework of functional partial least squares (typically…

Methodology · Statistics 2021-02-12 Zhiyang Zhou

This paper studies a regression model where both predictor and response variables are random functions. We consider a functional linear model where the conditional mean of the response variable at each time point is given by a linear…

Statistics Theory · Mathematics 2017-03-23 Masaaki Imaizumi , Kengo Kato

Combining experimental and observational follow-up datasets has received a lot of attention lately. In a time-to-event setting, recent work has used medicare claims to extend the follow-up period for participants in a prostate cancer…

Methodology · Statistics 2022-04-12 Gang Cheng , Yen-Chi Chen , Joseph M. Unger , Cathee Till , Ying-Qi Zhao

Functional linear regression analysis aims to model regression relations which include a functional predictor. The analog of the regression parameter vector or matrix in conventional multivariate or multiple-response linear regression…

Statistics Theory · Mathematics 2011-02-28 Yichao Wu , Jianqing Fan , Hans-Georg Müller

We introduce a new model of linear regression for random functional inputs taking into account the first order derivative of the data. We propose an estimation method which comes down to solving a special linear inverse problem. Our…

Statistics Theory · Mathematics 2016-08-16 André Mas , Besnik Pumo

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

This paper considers the partially functional linear model (PFLM) where all predictive features consist of a functional covariate and a high dimensional scalar vector. Over an infinite dimensional reproducing kernel Hilbert space, the…

Statistics Theory · Mathematics 2021-10-19 Shaogao Lv , Xin He , Junhui Wang

This paper proposes a dynamic regression (DR) framework that enhances existing deep spatiotemporal models by incorporating structured learning for the error process in traffic forecasting. The framework relaxes the assumption of time…

Machine Learning · Computer Science 2025-04-09 Vincent Zhihao Zheng , Seongjin Choi , Lijun Sun

We propose an extensive framework for additive regression models for correlated functional responses, allowing for multiple partially nested or crossed functional random effects with flexible correlation structures for, e.g., spatial,…

Methodology · Statistics 2013-11-26 Fabian Scheipl , Ana-Maria Staicu , Sonja Greven

This paper illustrates the central role of loss functions in data-driven decision making, providing a comprehensive survey on their influence in cost-sensitive classification (CSC) and reinforcement learning (RL). We demonstrate how…

Machine Learning · Statistics 2025-04-07 Kaiwen Wang , Nathan Kallus , Wen Sun

We study the functional linear regression model with a scalar response and a Hilbert space-valued predictor, a canonical example of an ill-posed inverse problem. We show that the functional partial least squares (PLS) estimator attains…

Statistics Theory · Mathematics 2025-05-08 Andrii Babii , Marine Carrasco , Idriss Tsafack

In applied time-to-event analysis, a flexible parametric approach is to model the hazard rate as a piecewise constant function of time. However, the change points and values of the piecewise constant hazard are usually unknown and need to…

Methodology · Statistics 2024-08-08 Manuel Rosenbaum , Jan Beyersmann , Michael Vogt

Recent research has shown that Transformers with linear attention are capable of in-context learning (ICL) by implementing a linear estimator through gradient descent steps. However, the existing results on the optimization landscape apply…

Machine Learning · Computer Science 2024-07-16 Yingcong Li , Ankit Singh Rawat , Samet Oymak

The aim of this paper is to compute one-day-ahead prediction regions for daily curves of electricity demand and price. Three model-based procedures to construct general prediction regions are proposed, all of them using bootstrap…

Methodology · Statistics 2024-01-23 Rebeca Peláez , Germán Aneiros , Juan Vilar

This paper describes a method for a model-based analysis of clinical safety data called multivariate Bayesian logistic regression (MBLR). Parallel logistic regression models are fit to a set of medically related issues, or response…

Methodology · Statistics 2012-10-02 William DuMouchel