English
Related papers

Related papers: Testing the number of parameters with multidimensi…

200 papers

We study asymptotic properties of $M$-estimates of regression parameters in linear models in which errors are dependent. Weak and strong Bahadur representations of the $M$-estimates are derived and a central limit theorem is established.…

Statistics Theory · Mathematics 2009-09-29 Wei Biao Wu

Markov parameters play a key role in system identification. There exists many algorithms where these parameters are estimated using least-squares in a first, pre-processing, step, including subspace identification and multi-step…

Systems and Control · Electrical Eng. & Systems 2024-05-08 Jiabao He , Cristian R. Rojas , Håkan Hjalmarsson

Suppose that univariate data are drawn from a mixture of two distributions that are equal up to a shift parameter. Such a model is known to be nonidentifiable from a nonparametric viewpoint. However, if we assume that the unknown mixed…

Statistics Theory · Mathematics 2016-08-16 Laurent Bordes , Stéphane Mottelet , Pierre Vandekerkhove

The properties of the normal distribution under linear transformation, as well the easy way to compute the covariance matrix of marginals and conditionals, offer a unique opportunity to get an insight about several aspects of uncertainties…

Data Analysis, Statistics and Probability · Physics 2018-02-12 Giulio D'Agostini

Multilayer perceptron (MLP), one of the most fundamental neural networks, is extensively utilized for classification and regression tasks. In this paper, we establish a new generalization error bound, which reveals how the variance of…

Machine Learning · Computer Science 2025-08-29 Feijiang Li , Liuya Zhang , Jieting Wang , Tao Yan , Yuhua Qian

Deep learning methods relying on multi-layered networks have been actively studied in a wide range of fields in recent years, and deep Boltzmann machines(DBMs) is one of them. In this study, a model of DBMs with some properites of weight…

Disordered Systems and Neural Networks · Physics 2022-10-06 Yuma Ichikawa , Koji Hukushima

This paper presents a method for investigating, through an automatic procedure, the (lack of) identifiability of parametrized dynamical models. This method takes into account constraints on parameters and returns parameters whose…

Dynamical Systems · Mathematics 2016-10-11 Nathalie Verdière , Sébastien Orange

In the mixture models problem it is assumed that there are $K$ distributions $\theta_{1},\ldots,\theta_{K}$ and one gets to observe a sample from a mixture of these distributions with unknown coefficients. The goal is to associate instances…

Machine Learning · Statistics 2013-12-02 Jason D Lee , Ran Gilad-Bachrach , Rich Caruana

We consider a stochastic process model with time trend and measurement error. We establish consistency and derive the limiting distributions of the maximum likelihood (ML) estimators of the covariance function parameters under a general…

Statistics Theory · Mathematics 2016-09-29 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

We provide a unified approach to a method of estimation of the regression parameter in balanced linear models with a structured covariance matrix that combines a high breakdown point and bounded influence with high asymptotic efficiency at…

Statistics Theory · Mathematics 2023-03-22 Hendrik Paul Lopuhaä

As machine learning and deep learning models become ubiquitous, it is inevitable that there will be attempts to exploit such models in various attack scenarios. For example, in a steganographic-based attack, information could be hidden in a…

Cryptography and Security · Computer Science 2023-07-03 Lei Zhang , Dong Li , Olha Jurečková , Mark Stamp

Determinantal point processes (DPPs) are popular probabilistic models of diversity. In this paper, we investigate DPPs from a new perspective: property testing of distributions. Given sample access to an unknown distribution $q$ over the…

Machine Learning · Computer Science 2020-08-11 Khashayar Gatmiry , Maryam Aliakbarpour , Stefanie Jegelka

We present the asymptotic distribution for two-sided tests based on the profile likelihood ratio with lower and upper boundaries on the parameter of interest. This situation is relevant for branching ratios and the elements of unitary…

Data Analysis, Statistics and Probability · Physics 2012-10-26 Glen Cowan , Kyle Cranmer , Eilam Gross , Ofer Vitells

Multivariate linear regressions are widely used statistical tools in many applications to model the associations between multiple related responses and a set of predictors. To infer such associations, it is often of interest to test the…

Statistics Theory · Mathematics 2019-10-07 Yinqiu He , Tiefeng Jiang , Jiyang Wen , Gongjun Xu

This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the…

Machine Learning · Computer Science 2024-07-10 Ping Hu , Virginia Bordignon , Mert Kayaalp , Ali H. Sayed

Statistical learning in high-dimensional spaces is challenging without a strong underlying data structure. Recent advances with foundational models suggest that text and image data contain such hidden structures, which help mitigate the…

Machine Learning · Statistics 2025-02-04 Charles Arnal , Clement Berenfeld , Simon Rosenberg , Vivien Cabannes

We consider a parametric modelling approach for survival data where covariates are allowed to enter the model through multiple distributional parameters, i.e., scale and shape. This is in contrast with the standard convention of having a…

Methodology · Statistics 2021-11-17 Fatima-Zahra Jaouimaa , Il Do Ha , Kevin Burke

In this paper we prove the Local Asymptotic Mixed Normality (LAMN) property for the statistical model given by the observation of local means of a diffusion process $X$. Our data are given by $ \int_0^1 X_{\frac{s+i}{n}} \dd \mu (s)$ for…

Probability · Mathematics 2009-06-09 Arnaud Gloter , Emmanuel Gobet

The reliable power system operation is a major goal for electric utilities, which requires the accurate reliability forecasting to minimize the duration of power interruptions. Since weather conditions are usually the leading causes for…

Applications · Statistics 2018-10-12 Longfei Wei , Arif I. Sarwat

While neural networks have been successfully applied to the full-spectrum k-distribution (FSCK) method at a large range of thermodynamics with k-values predicted by a trained multilayer perceptron (MLP) model, the required a-values still…

Machine Learning · Computer Science 2024-03-21 Xin Wang , Yucheng Kuang , Chaojun Wang , Hongyuan Di , Boshu He