English
Related papers

Related papers: Strong consistent model selection for general caus…

200 papers

Matrix-variate time series data are largely available in applications. However, no attempt has been made to study their conditional heteroskedasticity that is often observed in economic and financial data. To address this gap, we propose a…

Methodology · Statistics 2023-06-09 Cheng Yu , Dong Li , Feiyu Jiang , Ke Zhu

In this paper we present a new framework for time-series modeling that combines the best of traditional statistical models and neural networks. We focus on time-series with long-range dependencies, needed for monitoring fine granularity…

Machine Learning · Computer Science 2019-12-02 Oskar Triebe , Nikolay Laptev , Ram Rajagopal

Reward models (RMs) play a crucial role in aligning large language models (LLMs) with human preferences and enhancing reasoning quality. Traditionally, RMs are trained to rank candidate outputs based on their correctness and coherence.…

Machine Learning · Computer Science 2025-02-21 Yuhui Xu , Hanze Dong , Lei Wang , Caiming Xiong , Junnan Li

The information flow-based quantitative causality analysis has been widely applied in different disciplines because of its origin from first principles, its concise form, and its computational efficiency. So far the algorithm for its…

Adaptation and Self-Organizing Systems · Physics 2023-03-08 X. San Liang

We study the model selection problem in conditional average treatment effect (CATE) prediction. Unlike previous works on this topic, we focus on preserving the rank order of the performance of candidate CATE predictors to enable accurate…

Machine Learning · Statistics 2020-07-20 Yuta Saito , Shota Yasui

In this paper we discuss dynamic ARMA-type regression models for time series taking values in $(0,\infty)$. In the proposed model, the conditional mean is modeled by a dynamic structure containing autoregressive and moving average terms,…

We present a re-parameterization of vector autoregressive moving average (VARMA) models that allows estimation of parameters under the constraints of causality and invertibility. The parameter constraints associated with a causal invertible…

Statistics Theory · Mathematics 2014-06-19 Anindya Roy , Tucker S. McElroy , Peter Linton

Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algorithms over larger…

Machine Learning · Computer Science 2025-04-01 Menghua Wu , Yujia Bao , Regina Barzilay , Tommi Jaakkola

In this paper we propose a new optimization model for maximum likelihood estimation of causal and invertible ARMA models. Through a set of numerical experiments we show how our proposed model outperforms, both in terms of quality of the…

Optimization and Control · Mathematics 2022-01-27 Leonardo Di Gangi , Matteo Lapucci , Fabio Schoen , Alessio Sortino

We propose a sparse coefficient estimation and automated model selection procedure for autoregressive (AR) processes with heavy-tailed innovations based on penalized conditional maximum likelihood. Under mild moment conditions on the…

Methodology · Statistics 2013-09-24 Hailin Sang , Yan Sun

Given a set of items and a set of evaluators who all individually rank them, how do we aggregate these evaluations into a single societal ranking? Work in social choice and statistics has produced many aggregation methods for this problem,…

Computer Science and Game Theory · Computer Science 2025-08-26 Ratip Emin Berker , Ben Armstrong , Vincent Conitzer , Nihar B. Shah

Existing computationally efficient methods for penalized likelihood GAM fitting employ iterative smoothness selection on working linear models (or working mixed models). Such schemes fail to converge for a non-negligible proportion of…

Methodology · Statistics 2015-11-13 Simon N. Wood

In this paper, we study the possibility of designing non-trivial random CSP models by exploiting the intrinsic connection between structures and typical-case hardness. We show that constraint consistency, a notion that has been developed to…

Artificial Intelligence · Computer Science 2011-10-12 J. Culberson , Y. Gao

Multivariate time series anomaly detection has numerous real-world applications and is being extensively studied. Modeling pairwise correlations between variables is crucial. Existing methods employ learnable graph structures and graph…

Machine Learning · Computer Science 2025-01-24 Zehao Liu , Mengzhou Gao , Pengfei Jiao

We develop a class of optimal tests for a structural break occurring at an unknown date in infinite and growing-order time series regression models, such as AR($\infty$), linear regression with increasingly many covariates, and…

Econometrics · Economics 2025-10-15 Abhimanyu Gupta , Myung Hwan Seo

Information theoretic criteria (ITC) have been widely adopted in engineering and statistics for selecting, among an ordered set of candidate models, the one that better fits the observed sample data. The selected model minimizes a penalized…

Machine Learning · Statistics 2019-10-10 Andrea Mariani , Andrea Giorgetti , Marco Chiani

Neural marked temporal point processes have been a valuable addition to the existing toolbox of statistical parametric models for continuous-time event data. These models are useful for sequences where each event is associated with a single…

Machine Learning · Computer Science 2024-03-20 Yuxin Chang , Alex Boyd , Padhraic Smyth

Estimating the periodicity of a stationary time series via fitting a second order stationary autoregressive (AR(2)) model has been initiated by the seminal paper of Yule(1927).. We investigate properties of this procedure when applied to a…

Statistics Theory · Mathematics 2025-12-01 Jens-Peter Kreiss , Panagiotis Maouris , Efstathios Paparoditis

We consider an epidemic change-point detection in a large class of causal time series models, including among other processes, AR($\infty$), ARCH($\infty$), TARCH($\infty$), ARMA-GARCH. A test statistic based on the Gaussian quasi-maximum…

Statistics Theory · Mathematics 2021-05-31 Mamadou Lamine Diop , William Kengne

Certifiable, adaptive uncertainty estimates for unknown quantities are an essential ingredient of sequential decision-making algorithms. Standard approaches rely on problem-dependent concentration results and are limited to a specific…

Machine Learning · Computer Science 2023-11-09 Nicolas Emmenegger , Mojmír Mutný , Andreas Krause