English
Related papers

Related papers: On identification in ill-posed linear regression

200 papers

To understand how the interconnected and interdependent world of the twenty-first century operates and make model-based predictions, joint probability models for networks and interdependent outcomes are needed. We propose a comprehensive…

Methodology · Statistics 2025-07-03 Cornelius Fritz , Michael Schweinberger , Subhankar Bhadra , David R. Hunter

Modelling, parameter identification, and simulation play an important role in systems biology. Usually, the goal is to determine parameter values that minimise the difference between experimental measurement values and model predictions in…

Mathematical Software · Computer Science 2013-04-10 Thomas Dierkes , Susanna Röblitz , Moritz Wade , Peter Deuflhard

Latent feature models (LFM)s are widely employed for extracting latent structures of data. While offering high, parameter estimation is difficult with LFMs because of the combinational nature of latent features, and non-identifiability is a…

Machine Learning · Computer Science 2018-09-27 Ryota Suzuki , Shingo Takahashi , Murtuza Petladwala , Shigeru Kohmoto

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

When parameters are weakly identified, bounds on the parameters may provide a valuable source of information. Existing weak identification estimation and inference results are unable to combine weak identification with bounds. Within a…

Econometrics · Economics 2025-10-03 Gregory Fletcher Cox

We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete…

Machine Learning · Statistics 2015-11-24 Yang Ning , Tianqi Zhao , Han Liu

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

We propose a new prediction method for multivariate linear regression problems where the number of features is less than the sample size but the number of outcomes is extremely large. Many popular procedures, such as penalized regression…

Methodology · Statistics 2021-04-20 Yihe Wang , Sihai Dave Zhao

Scientists use mathematical modelling to understand and predict the properties of complex physical systems. In highly parameterised models there often exist relationships between parameters over which model predictions are identical, or…

Data Analysis, Statistics and Probability · Physics 2017-03-24 Dhruva V. Raman , James Anderson , Antonis Papachristodoulou

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

Methodology · Statistics 2012-02-07 Nicolai Meinshausen

Advances in machine learning technologies have led to increasingly powerful models in particular in the context of big data. Yet, many application scenarios demand for robustly interpretable models rather than optimum model accuracy; as an…

Machine Learning · Computer Science 2020-05-07 Lukas Pfannschmidt , Jonathan Jakob , Fabian Hinder , Michael Biehl , Peter Tino , Barbara Hammer

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

Semi-supervised learning has attracted significant attention due to the proliferation of applications featuring limited labeled data but abundant unlabeled data. In this paper, we examine the statistical inference problem in an…

Methodology · Statistics 2026-03-31 Chao Ying , Siyi Deng , Yang Ning , Jiwei Zhao , Heping Zhang

Least squares fitting is in general not useful for high-dimensional linear models, in which the number of predictors is of the same or even larger order of magnitude than the number of samples. Theory developed in recent years has coined a…

Statistics Theory · Mathematics 2014-02-13 Martin Slawski , Matthias Hein

Practical identifiability is a critical concern in data-driven modeling of mathematical systems. In this paper, we propose a novel framework for practical identifiability analysis to evaluate parameter identifiability in mathematical models…

Quantitative Methods · Quantitative Biology 2026-01-06 Shun Wang , Wenrui Hao

Log-linear models are typically fitted to contingency table data to describe and identify the relationship between different categorical variables. However, the data may include observed zero cell entries. The presence of zero cell entries…

Methodology · Statistics 2022-12-01 Serveh Sharifi Far , Michail Papathomas , Ruth King

Statistical latent class models are widely used in social and psychological researches, yet it is often difficult to establish the identifiability of the model parameters. In this paper we consider the identifiability issue of a family of…

Methodology · Statistics 2016-03-15 Gongjun Xu

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

Many scientific and engineering applications require fitting regression models that are nonlinear in the parameters. Advances in computer hardware and software in recent decades have made it easier to fit such models. Relative to fitting…

Methodology · Statistics 2024-03-20 Peng Liu , William Q. Meeker

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao