English
Related papers

Related papers: Deep Fr\'echet Regression

200 papers

Delineating the associations between images and a vector of covariates is of central interest in medical imaging studies. To tackle this problem of image response regression, we propose a novel nonparametric approach in the framework of…

Machine Learning · Statistics 2022-03-04 Daiwei Zhang , Lexin Li , Chandra Sripada , Jian Kang

Non-Euclidean data is frequently encountered across different fields, yet there is limited literature that addresses the fundamental challenge of training neural networks with manifold representations as outputs. We introduce the trick…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tongtong Zhang , Xian Wei , Yuanxiang Li

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

We study the properties of nonparametric least squares regression using deep neural networks. We derive non-asymptotic upper bounds for the prediction error of the empirical risk minimizer of feedforward deep neural regression. Our error…

Statistics Theory · Mathematics 2023-01-18 Yuling Jiao , Guohao Shen , Yuanyuan Lin , Jian Huang

We focus on nonlinear Function-on-Scalar regression, where the predictors are scalar variables, and the responses are functional data. Most existing studies approximate the hidden nonlinear relationships using linear combinations of basis…

Methodology · Statistics 2025-04-01 Kazunori Takeshita , Yoshikazu Terada

Distribution-as-response regression problems are gaining wider attention, especially within biomedical settings where observation-rich patient specific data sets are available, such as feature densities in CT scans (Petersen et al., 2021)…

Computation · Statistics 2025-12-22 Alexander Coulter , Rebecca Lee , Irina Gaynanova

Network data are increasingly available in various research fields, motivating statistical analysis for populations of networks where a network as a whole is viewed as a data point. Due to the non-Euclidean nature of networks, basic…

Methodology · Statistics 2022-11-29 Yidong Zhou , Hans-Georg Müller

Many modern applications involve predicting structured, non-Euclidean outputs such as probability distributions, networks, and symmetric positive-definite matrices. These outputs are naturally modeled as elements of general metric spaces,…

Machine Learning · Statistics 2025-09-30 Yidong Zhou , Su I Iao , Hans-Georg Müller

Embedding high-dimensional data onto a low-dimensional manifold is of both theoretical and practical value. In this paper, we propose to combine deep neural networks (DNN) with mathematics-guided embedding rules for high-dimensional data…

Machine Learning · Computer Science 2022-08-19 Zixia Zhou , Xinrui Zu , Yuanyuan Wang , Boudewijn P. F. Lelieveldt , Qian Tao

Standard regression approaches assume that some finite number of the response distribution characteristics, such as location and scale, change as a (parametric or nonparametric) function of predictors. However, it is not always appropriate…

Methodology · Statistics 2020-07-14 Fernand A. Quintana , Peter Mueller , Alejandro Jara , Steven N. MacEachern

Fr\'echet regression has emerged as a useful tool for modeling non-Euclidean response variables associated with Euclidean covariates. In this work, we propose a global Fr\'echet regression estimation method that incorporates low-rank…

Methodology · Statistics 2025-05-09 Kyunghee Han , Hsin-Hsiung Huang

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

This paper proposes a nonparametric multivariate density forecast model based on deep learning. It not only offers the whole marginal distribution of each random variable in forecasting targets, but also reveals the future correlation…

Systems and Control · Electrical Eng. & Systems 2022-10-28 Zichao Meng , Ye Guo , Wenjun Tang , Hongbin Sun

We study harmonic map regression, a nonparametric estimator for manifold-valued responses, that penalizes the empirical Fr\'echet risk by the Dirichlet energy. By connecting penalized regression to the theory of harmonic maps, the estimator…

Statistics Theory · Mathematics 2026-04-13 Xiaoyu Chen

This paper considers improved forecasting in possibly nonlinear dynamic settings, with high-dimension predictors ("big data" environments). To overcome the curse of dimensionality and manage data and model complexity, we examine shrinkage…

Econometrics · Economics 2019-04-26 Ali Habibnia , Esfandiar Maasoumi

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

Machine Learning · Computer Science 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

Deep neural networks have shown great potential in image reconstruction problems in Euclidean space. However, many reconstruction problems involve imaging physics that are dependent on the underlying non-Euclidean geometry. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2022-10-07 Xiajun Jiang , Sandesh Ghimire , Jwala Dhamala , Zhiyuan Li , Prashnna Kumar Gyawali , Linwei Wang

Recent advances in deep learning have achieved impressive gains in classification accuracy on a variety of types of data, including images and text. Despite these gains, however, concerns have been raised about the calibration, robustness,…

Machine Learning · Computer Science 2018-11-20 Dallas Card , Michael Zhang , Noah A. Smith

This paper proposes a new high dimensional regression method by merging Gaussian process regression into a variational autoencoder framework. In contrast to other regression methods, the proposed method focuses on the case where output…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 YoungJoon Yoo , Sangdoo Yun , Hyung Jin Chang , Yiannis Demiris , Jin Young Choi

This paper revisits an adaptation of the random forest algorithm for Fr\'echet regression, addressing the challenge of regression in the context of random objects in metric spaces. Recognizing the limitations of previous approaches, we…

Methodology · Statistics 2023-06-30 Matthieu Bulté , Helle Sørensen