English
Related papers

Related papers: Strong consistent model selection for general caus…

200 papers

Our goal is to estimate causal interactions in multivariate time series. Using vector autoregressive (VAR) models, these can be defined based on non-vanishing coefficients belonging to respective time-lagged instances. As in most cases a…

Methodology · Statistics 2010-08-13 Stefan Haufe , Guido Nolte , Klaus-Robert Mueller , Nicole Kraemer

Recently, many authors have cast doubts on the validity of ABC model choice. It has been shown that the use of sufficient statistic in ABC model selection leads, apart from few exceptional cases in which the sufficient statistic is also…

Computation · Statistics 2018-04-13 Erlis Ruli

Most of previous machine learning algorithms are proposed based on the i.i.d. hypothesis. However, this ideal assumption is often violated in real applications, where selection bias may arise between training and testing process. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Zheyan Shen , Peng Cui , Kun Kuang , Bo Li , Peixuan Chen

Subsequence-based time series classification algorithms provide accurate and interpretable models, but training these models is extremely computation intensive. The asymptotic time complexity of subsequence-based algorithms remains a…

Machine Learning · Computer Science 2021-02-18 Atif Raza , Stefan Kramer

Many methods of estimating causal models do not provide estimates of confidence in the resulting model. In this work, a metric is proposed for validating the output of a causal model fit; the robustness of the model structure with resampled…

We propose a new sequential procedure to detect change in the parameters of a process $ X= (X_t)_{t\in \Z}$ belonging to a large class of causal models (such as AR($\infty$), ARCH($\infty$), TARCH($\infty$), ARMA-GARCH processes). The…

Statistics Theory · Mathematics 2014-02-12 Jean-Marc Bardet , William Chakry Kengne

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

Variable selection for models including interactions between explanatory variables often needs to obey certain hierarchical constraints. The weak or strong structural hierarchy requires that the existence of an interaction term implies at…

Statistics Theory · Mathematics 2016-11-10 Yiyuan She , Zhifeng Wang , He Jiang

Recently, Brand, Ganian and Simonov introduced a parameterized refinement of the classical PAC-learning sample complexity framework. A crucial outcome of their investigation is that for a very wide range of learning problems, there is a…

Data Structures and Algorithms · Computer Science 2023-08-23 Robert Ganian , Liana Khazaliya , Kirill Simonov

Linear models are foundational tools in statistics and ubiquitous across the applied sciences. However, conventional statistical inference -- such as $t$-tests and $F$-tests -- are only valid at fixed sample sizes, making them unsuitable…

Methodology · Statistics 2025-07-08 Michael Lindon , Dae Woong Ham , Martin Tingley , Iavor Bojinov

We study the law of the iterated logarithm (LIL) for the maximum likelihood estimation of the parameters (as a convex optimization problem) in the generalized linear models with independent or weakly dependent ($\rho$-mixing, $m$-dependent)…

Statistics Theory · Mathematics 2020-04-28 Xiaowei Yang , Shuang Song , Huiming Zhang

Strong consistency and asymptotic normality of the Gaussian pseudo-maximum likelihood estimate of the parameters in a wide class of ARCH$(\infty)$ processes are established. The conditions are shown to hold in case of exponential and…

Statistics Theory · Mathematics 2007-06-13 Peter M. Robinson , Paolo Zaffaroni

In this paper, we propose a framework for achieving long-term fair sequential decision making. By conducting both the hard and soft interventions, we propose to take path-specific effects on the time-lagged causal graph as a quantitative…

Machine Learning · Computer Science 2022-04-06 Yaowei Hu , Lu Zhang

One of the important and widely used classes of models for non-Gaussian time series is the generalized autoregressive model average models (GARMA), which specifies an ARMA structure for the conditional mean process of the underlying time…

Methodology · Statistics 2021-05-13 Tingguo Zheng , Han Xiao , Rong Chen

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

Standard penalized methods of variable selection and parameter estimation rely on the magnitude of coefficient estimates to decide which variables to include in the final model. However, coefficient estimates are unreliable when the design…

Methodology · Statistics 2018-02-13 Jonathan P Williams , Jan Hannig

We introduce the arbitrary rectangle-range generalized elastic net penalty method, abbreviated to ARGEN, for performing constrained variable selection and regularization in high-dimensional sparse linear models. As a natural extension of…

Machine Learning · Statistics 2021-12-16 Yujia Ding , Qidi Peng , Zhengming Song , Hansen Chen

Here we present an expository, general analysis of valid post-selection or post-regularization inference about a low-dimensional target parameter, $\alpha$, in the presence of a very high-dimensional nuisance parameter, $\eta$, which is…

Statistics Theory · Mathematics 2017-10-03 Victor Chernozhukov , Christian Hansen , Martin Spindler

This paper studies causal discovery in irregularly sampled time series-a key challenge in risk-sensitive domains like finance, healthcare, and climate science, where missing data and inconsistent sampling frequencies distort causal…

Machine Learning · Computer Science 2026-05-12 Weihong Li , Baohong Li , Anpeng Wu , Zhihan Li , Ming Ma , Keting Yin , Kun Kuang

In this paper, we consider the problem of estimating the marginal density in some nonlinear autoregressive time series models for which the conditional mean and variance have a parametric specification. Under some regularity conditions, we…

Statistics Theory · Mathematics 2016-10-31 Lionel Truquet