English
Related papers

Related papers: HeteroJIVE: Joint Subspace Estimation for Heteroge…

200 papers

Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical challenges, such as personalized medicine and optimal resource allocation. In this paper, we develop a general class of two-step algorithms for…

Machine Learning · Statistics 2020-08-07 Xinkun Nie , Stefan Wager

Image segmentation is an important median level vision topic. Accurate and efficient multiphase segmentation for images with intensity inhomogeneity is still a great challenge. We present a new two-stage multiphase segmentation method…

Optimization and Control · Mathematics 2020-09-15 Xueyan Guo , Yunhua Xue , Chunlin Wu

We propose an adaptive ridge (AR) estimation scheme for a heteroscedastic linear regression model with log-linear noise in data. We simultaneously estimate the mean and variance parameters, demonstrating new asymptotic distributional and…

Statistics Theory · Mathematics 2025-09-29 Ka Long Keith Ho , Hiroki Masuda

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

This paper considers distributed M-estimation under heterogeneous distributions among distributed data blocks. A weighted distributed estimator is proposed to improve the efficiency of the standard "Split-And-Conquer" (SaC) estimator for…

Statistics Theory · Mathematics 2022-09-15 Jia Gu , Songxi Chen

This paper provides a new methodology to analyze unobserved heterogeneity when observed characteristics are modeled nonlinearly. The proposed model builds on varying random coefficients (VRC) that are determined by nonlinear functions of…

Econometrics · Economics 2020-08-05 Christoph Breunig

In multi-view clustering, different views may have different confidence levels when learning a consensus representation. Existing methods usually address this by assigning distinctive weights to different views. However, due to noisy nature…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Yanbo Fan , Jian Liang , Ran He , Bao-Gang Hu , Siwei Lyu

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

We study the problem of detecting and locating change points in high-dimensional Vector Autoregressive (VAR) models, whose transition matrices exhibit low rank plus sparse structure. We first address the problem of detecting a single change…

Methodology · Statistics 2021-10-01 Peiliang Bai , Abolfazl Safikhani , George Michailidis

Prompt and accurate detection of system anomalies is essential to ensure the reliability of software systems. Unlike manual efforts that exploit all available run-time information, existing approaches usually leverage only a single type of…

Software Engineering · Computer Science 2023-02-16 Baitong Li , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Yongqiang Yang , Michael R. Lyu

Model averaging is an important alternative to model selection with attractive prediction accuracy. However, its application to high-dimensional data remains under-explored. We propose a high-dimensional model averaging method via…

Statistics Theory · Mathematics 2025-06-11 Zhengyan Wan , Fang Fang , Binyan Jiang

Data mixing--the strategic reweighting of training domains--is a critical component in training robust machine learning models. This problem is naturally formulated as a bilevel optimization task, where the outer loop optimizes domain…

Machine Learning · Computer Science 2026-02-24 Rudrajit Das , Neel Patel , Meisam Razaviyayn , Vahab Mirrokni

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

This paper proposes a joint channel and data estimation (JCDE) algorithm for uplink multiuser extremely large-scale multiple-input-multiple-output (XL-MIMO) systems. The initial channel estimation is formulated as a sparse reconstruction…

Signal Processing · Electrical Eng. & Systems 2025-08-20 Kabuto Arai , Koji Ishibashi , Hiroki Iimori , Paulo Valente Klaine , Szabolcs Malomsoky

Multi-view clustering has gained broad attention owing to its capacity to exploit complementary information across multiple data views. Although existing methods demonstrate delightful clustering performance, most of them are of high time…

Machine Learning · Computer Science 2023-03-06 Xinhang Wan , Xinwang Liu , Jiyuan Liu , Siwei Wang , Yi Wen , Weixuan Liang , En Zhu , Zhe Liu , Lu Zhou

Deep learning methods for unsupervised registration often rely on objectives that assume a uniform noise level across the spatial domain (e.g. mean-squared error loss), but noise distributions are often heteroscedastic and input-dependent…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Xiaoran Zhang , Daniel H. Pak , Shawn S. Ahn , Xiaoxiao Li , Chenyu You , Lawrence H. Staib , Albert J. Sinusas , Alex Wong , James S. Duncan

Sparse reduced rank regression is an essential statistical learning method. In the contemporary literature, estimation is typically formulated as a nonconvex optimization that often yields to a local optimum in numerical computation. Yet,…

Methodology · Statistics 2022-12-06 Canhong Wen , Ruipeng Dong , Xueqin Wang , Weiyu Li , Heping Zhang

In this letter, we propose a novel adaptive reduced-rank strategy based on joint iterative optimization (JIO) of filters according to the minimization of the bit error rate (BER) cost function. The proposed optimization technique adjusts…

Information Theory · Computer Science 2013-02-19 Yunlong Cai , Rodrigo C. de Lamare

Network embedding approaches are gaining momentum to analyse a large variety of networks. Indeed, these approaches have demonstrated their efficiency for tasks such as community detection, node classification, and link prediction. However,…

Machine Learning · Computer Science 2021-01-06 Léo Pio-Lopez , Alberto Valdeolivas , Laurent Tichit , Élisabeth Remy , Anaïs Baudot

In this paper, we consider the infinite-dimensional integration problem on weighted reproducing kernel Hilbert spaces with norms induced by an underlying function space decomposition of ANOVA-type. The weights model the relative importance…

Numerical Analysis · Mathematics 2021-09-21 Jan Baldeaux , Michael Gnewuch