English
Related papers

Related papers: Mixture of partially linear experts

200 papers

We conduct the convergence analysis of parameter estimation in the contaminated mixture of experts. This model is motivated from the prompt learning problem where ones utilize prompts, which can be formulated as experts, to fine-tune a…

Machine Learning · Computer Science 2025-03-07 Fanqi Yan , Huy Nguyen , Dung Le , Pedram Akbarian , Nhat Ho

Linear fusion of estimates under the condition of no knowledge of correlation of estimation errors has reached maturity. On the other hand, various cases of partial knowledge are still active research areas. A frequent motivation is to deal…

Signal Processing · Electrical Eng. & Systems 2025-06-16 Jiří Ajgl , Ondřej Straka

Causal mediation analysis usually requires strong assumptions, such as ignorability of the mediator, which may not hold in many social and scientific studies. Motivated by a multilevel randomized treatment experiment using functional…

Applications · Statistics 2017-07-11 Yi Zhao , Xi Luo

In practice, data often contain discrete variables. But most of the popular nonparametric estimation methods have been developed in a purely continuous framework. A common trick among practitioners is to make discrete variables continuous…

Methodology · Statistics 2018-01-08 Thomas Nagler

Regression trees and their ensemble methods are popular methods for nonparametric regression: they combine strong predictive performance with interpretable estimators. To improve their utility for locally smooth response surfaces, we study…

Methodology · Statistics 2021-09-13 Sören R. Künzel , Theo F. Saarinen , Edward W. Liu , Jasjeet S. Sekhon

One of the distinguishing characteristics of modern deep learning systems is that they typically employ neural network architectures that utilize enormous numbers of parameters, often in the millions and sometimes even in the billions.…

Machine Learning · Statistics 2021-11-15 Ben Adlam , Jake Levinson , Jeffrey Pennington

Quantitative studies in many fields involve the analysis of multivariate data of diverse types, including measurements that we may consider binary, ordinal and continuous. One approach to the analysis of such mixed data is to use a copula…

Statistics Theory · Mathematics 2007-06-13 Peter D. Hoff

Combining additive models and neural networks allows to broaden the scope of statistical regression and extend deep learning-based approaches by interpretable structured additive predictors at the same time. Existing attempts uniting the…

Machine Learning · Statistics 2022-07-12 David Rügamer , Chris Kolb , Nadja Klein

Estimating population quantities such as mean outcomes from user feedback is fundamental to platform evaluation and social science, yet feedback is often missing not at random (MNAR): users with stronger opinions are more likely to respond,…

Machine Learning · Statistics 2026-02-19 Hongyu Chen , David Simchi-Levi , Ruoxuan Xiong

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

This paper presents a backfitting-type method for estimating and forecasting a periodically correlated partially linear model with exogeneous variables and heteroskedastic input noise. A rate of convergence of the estimator is given. The…

Statistics Theory · Mathematics 2011-02-23 Xavier Brossat , Georges Oppenheim , Marie-Claude Viano

This paper studies a \textit{partial functional partially linear single-index model} that consists of a functional linear component as well as a linear single-index component. This model generalizes many well-known existing models and is…

Statistics Theory · Mathematics 2017-03-09 Qingguo Tang , Linglong Kong , David Ruppert , Rohana J. Karunamuni

A quantitative model of concurrent interaction is introduced. The basic objects are linear combinations of partial order relations, acted upon by a group of permutations that represents potential non-determinism in synchronisation. This…

Logic in Computer Science · Computer Science 2011-07-08 Emmanuel Beffara

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

To date, most probabilistic reasoning systems have relied on a fixed belief network constructed at design time. The network is used by an application program as a representation of (in)dependencies in the domain. Probabilistic inference…

Artificial Intelligence · Computer Science 2013-03-25 Robert P. Goldman , John S. Breese

While linear mixed modeling methods are foundational concepts introduced in any statistical education, adequate general methods for interval estimation involving models with more than a few variance components are lacking, especially in the…

Methodology · Statistics 2012-11-07 Jessi Cisewski , Jan Hannig

This paper investigates the idea of designing data-driven partial estimators for nonlinear systems showing parametric uncertainties using sparse multivariate polynomial relationships. A general framework is first presented and then…

Systems and Control · Electrical Eng. & Systems 2025-11-04 Mazen Alamir

The machine learning community has recently devoted much attention to the problem of inferring causal relationships from statistical data. Most of this work has focused on uncovering connections among scalar random variables. We generalize…

Machine Learning · Statistics 2012-07-10 Doris Entner , Patrik O. Hoyer

Multilevel data are prevalent in many real-world applications. However, it remains an open research problem to identify and justify a class of models that flexibly capture a wide range of multilevel data. Motivated by the versatility of the…

Statistics Theory · Mathematics 2022-10-03 Tsz Chai Fung , Spark C. Tseung

In this article, we propose a class of semiparametric mixture regression models with single-index. We argue that many recently proposed semiparametric/nonparametric mixture regression models can be considered special cases of the proposed…

Methodology · Statistics 2016-10-04 Sijia Xiang , Weixin Yao