English
Related papers

Related papers: Improved Prediction and Network Estimation Using t…

200 papers

Generalized additive index models (GAIMs) offer a flexible semiparametric framework for capturing complex data relationships, balancing the interpretability of parametric models with the flexibility of nonparametric approaches. However,…

Methodology · Statistics 2026-05-29 Ziyu Peng , Linglingzhi Zhu , Yao Xie

We study the dynamics of matrix-valued time series with observed network structures by proposing a matrix network autoregression model with row and column networks of the subjects. We incorporate covariate information and a low rank…

Methodology · Statistics 2023-02-07 Xuening Zhu , Feifei Wang , Zeng Li , Yanyuan Ma

Autoregressive language modeling (ALM) have been successfully used in self-supervised pre-training in Natural language processing (NLP). However, this paradigm has not achieved comparable results with other self-supervised approach in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yu Qi , Fan Yang , Yousong Zhu , Yufei Liu , Liwei Wu , Rui Zhao , Wei Li

This paper introduces a new stochastic optimization method based on the regularized Fisher information matrix (FIM), named SOFIM, which can efficiently utilize the FIM to approximate the Hessian matrix for finding Newton's gradient update…

Machine Learning · Computer Science 2024-05-02 Mrinmay Sen , A. K. Qin , Gayathri C , Raghu Kishore N , Yen-Wei Chen , Balasubramanian Raman

Masked Image Modeling (MIM) is a technique in self-supervised learning that focuses on acquiring detailed visual representations from unlabeled images by estimating the missing pixels in randomly masked sections. It has proven to be a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Khanh-Binh Nguyen , Chae Jung Park

We consider efficient estimation of flexible transformation models with interval-censored data. To reduce the dimension of semi-parametric models, the unknown monotone transformation function is approximated via monotone splines. A…

Methodology · Statistics 2019-12-30 Minggen Lu , Yan Liu , Chin-Shang Li , Jianguo Sun

In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated has the "single-index" structure where neither the link function nor the index vector…

Statistics Theory · Mathematics 2013-04-30 Oleg Lepski , Nora Serdyukova

We consider minimizing a sum of agent-specific nondifferentiable merely convex functions over the solution set of a variational inequality (VI) problem in that each agent is associated with a local monotone mapping. This problem finds an…

Optimization and Control · Mathematics 2022-12-13 Harshal D. Kaushik , Sepideh Samadi , Farzad Yousefian

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

In this article, we propose two classes of semiparametric mixture regression models with single-index for model based clustering. Unlike many semiparametric/nonparametric mixture regression models that can only be applied to low dimensional…

Methodology · Statistics 2017-08-15 Sijia Xiang , Weixin Yao

In this paper, we consider a single-index mixed model with longitudinal data. A new set of estimating equations is proposed to estimate the single-index coefficient. The link function is estimated by using the local linear smoothing.…

Methodology · Statistics 2010-04-06 Zhen Pang , Liugen Xue

Despite remarkable progress in Single Image Super-Resolution (SISR), traditional models often struggle to generalize across varying scale factors, limiting their real-world applicability. To address this, we propose a plug-in Scale-Aware…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Dongsik Yoon , Jongeun Kim

Individuals or companies in a large social or financial network often display rather heterogeneous behaviors for various reasons. In this work, we propose a network vector autoregressive model with a latent group structure to model…

Methodology · Statistics 2023-08-14 Xuening Zhu , Ganggang Xu , Jianqing Fan

The development of autoregressive modeling (AM) in computer vision lags behind natural language processing (NLP) in self-supervised pre-training. This is mainly caused by the challenge that images are not sequential signals and lack a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Kaiyou Song , Shan Zhang , Tong Wang

Sharpness-aware Minimization (SAM) has been proposed recently to improve model generalization ability. However, SAM calculates the gradient twice in each optimization step, thereby doubling the computation costs compared to stochastic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jiaxin Deng , Junbiao Pang , Baochang Zhang , Tian Wang

We consider several estimation and learning problems that networked agents face when making decisions given their uncertainty about an unknown variable. Our methods are designed to efficiently deal with heterogeneity in both size and…

Applications · Statistics 2016-11-11 M. Amin Rahimian , Ali Jadbabaie

The performance of existing supervised neuron segmentation methods is highly dependent on the number of accurate annotations, especially when applied to large scale electron microscopy (EM) data. By extracting semantic information from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Yinda Chen , Wei Huang , Shenglong Zhou , Qi Chen , Zhiwei Xiong

Estimation mainly for two classes of popular models, single-index and partially linear single-index models, is studied in this paper. Such models feature nonstationarity. Orthogonal series expansion is used to approximate the unknown…

Statistics Theory · Mathematics 2016-01-25 Chaohua Dong , Jiti Gao , Dag Tjøstheim

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

This paper develops a new automatic and location-adaptive procedure for estimating regression in a Functional Single-Index Model (FSIM). This procedure is based on $k$-Nearest Neighbours ($k$NN) ideas. The asymptotic study includes results…

Statistics Theory · Mathematics 2024-01-29 Silvia Novo , Germán Aneiros , Philippe Vieu