English
Related papers

Related papers: Collaborative Inference for Sparse High-Dimensiona…

200 papers

Ultra-high dimensional longitudinal data are increasingly common and the analysis is challenging both theoretically and methodologically. We offer a new automatic procedure for finding a sparse semivarying coefficient model, which is widely…

Methodology · Statistics 2014-09-24 Ming-Yen Cheng , Toshio Honda , Jialiang Li , Heng Peng

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

The use of M-estimators in generalized linear regression models in high dimensional settings requires risk minimization with hard $L_0$ constraints. Of the known methods, the class of projected gradient descent (also known as iterative hard…

Machine Learning · Computer Science 2014-10-22 Prateek Jain , Ambuj Tewari , Purushottam Kar

Spatiotemporal learning plays a crucial role in mobile computing techniques to empower smart cites. While existing research has made great efforts to achieve accurate predictions on the overall dataset, they still neglect the significant…

Machine Learning · Computer Science 2024-03-20 Gengyu Lin , Zhengyang Zhou , Qihe Huang , Kuo Yang , Shifen Cheng , Yang Wang

We present a Bayesian non-parametric way of inferring stochastic differential equations for both regression tasks and continuous-time dynamical modelling. The work has high emphasis on the stochastic part of the differential equation, also…

Machine Learning · Statistics 2020-06-29 Martin Jørgensen , Marc Peter Deisenroth , Hugh Salimbeni

As the size of modern data sets exceeds the disk and memory capacities of a single computer, machine learning practitioners have resorted to parallel and distributed computing. Given that optimization is one of the pillars of machine…

Machine Learning · Statistics 2019-12-10 Biyi Fang , Diego Klabjan

This paper proposes a novel two-step strategy for testing the goodness-of-fit of parametric regression models in ultra-high dimensional sparse settings, where the predictor dimension far exceeds the sample size. This regime usually renders…

Methodology · Statistics 2025-12-30 Falong Tan , Jie Liu , Heng Peng , Lixing Zhu

Collaborative intrusion detection networks are often used to gain better detection accuracy and cost efficiency as compared to a single host-based intrusion detection system (IDS). Through cooperation, it is possible for a local IDS to…

Cryptography and Security · Computer Science 2016-09-08 Quanyan Zhu , Carol J. Fung , Raouf Boutaba , Tamer Basar

Sparse estimation of the precision matrix under high-dimensional scaling constitutes a canonical problem in statistics and machine learning. Numerous regression and likelihood based approaches, many frequentist and some Bayesian in nature…

Methodology · Statistics 2020-05-20 Peyman Jalali , Kshitij Khare , George Michailidis

Sequential testing problems involve a complex system with several components, each of which is "working" with some independent probability. The outcome of each component can be determined by performing a test, which incurs some cost. The…

Data Structures and Algorithms · Computer Science 2023-08-22 Rohan Ghuge , Anupam Gupta , Viswanath Nagarajan

Large knowledge bases typically contain data adhering to various schemas with incomplete and/or noisy type information. This seriously complicates further integration and post-processing efforts, as type information is crucial in correctly…

Applications · Statistics 2019-02-19 Artem Lutov , Soheil Roshankish , Mourad Khayati , Philippe Cudré-Mauroux

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

We introduce a powerful deep classifier two-sample test for high-dimensional data based on E-values, called E-value Classifier Two-Sample Test (E-C2ST). Our test combines ideas from existing work on split likelihood ratio tests and…

Methodology · Statistics 2024-05-01 Teodora Pandeva , Tim Bakker , Christian A. Naesseth , Patrick Forré

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by…

Methodology · Statistics 2017-04-19 Yun Yang

This article proposes a novel estimator for regression coefficients in clustered data that explicitly accounts for within-cluster dependence. We study the asymptotic properties of the proposed estimator under both finite and infinite…

Methodology · Statistics 2026-02-05 Subhodeep Dey , Gopal K. Basak , Samarjit Das

A meta-model of the input-output data of a computationally expensive simulation is often employed for prediction, optimization, or sensitivity analysis purposes. Fitting is enabled by a designed experiment, and for computationally expensive…

Methodology · Statistics 2023-12-01 Andrew Gill , David J. Warne , Antony M. Overstall , Clare McGrory , James M. McGree

This paper considers testing the covariance matrices structure based on Wald's score test in large dimensional setting. The hypothesis $H_0: \Sigma =\Sigma_0 $ for a given matrix $\Sigma_0$, which covers the identity hypothesis test and…

Methodology · Statistics 2016-03-01 Dandan Jiang , QiBin Zhang

This paper studies the problem of estimating a large coefficient matrix in a multiple response linear regression model when the coefficient matrix could be both of low rank and sparse in the sense that most nonzero entries concentrate on a…

Methodology · Statistics 2016-03-18 Zhuang Ma , Zongming Ma , Tingni Sun

Conditional independence testing (CIT) is a common task in machine learning, e.g., for variable selection, and a main component of constraint-based causal discovery. While most current CIT approaches assume that all variables are numerical…

Machine Learning · Computer Science 2023-11-07 Oana-Iuliana Popescu , Andreas Gerhardus , Jakob Runge

We propose a novel resampling-based method to construct an asymptotically exact test for any subset of hypotheses on coefficients in high-dimensional linear regression. It can be embedded into any multiple testing procedure to make…

Methodology · Statistics 2022-05-26 Anna Vesely , Jelle J. Goeman , Livio Finos