English
Related papers

Related papers: On the Equivalence between Neyman Orthogonality an…

200 papers

Label noise in data has long been an important problem in supervised learning applications as it affects the effectiveness of many widely used classification methods. Recently, important real-world applications, such as medical diagnosis…

Machine Learning · Statistics 2021-12-02 Shunan Yao , Bradley Rava , Xin Tong , Gareth James

Orthogonality regularization has been developed to prevent deep CNNs from training instability and feature redundancy. Among existing proposals, kernel orthogonality regularization enforces orthogonality by minimizing the residual between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Changhao Wu , Shenan Zhang , Fangsong Long , Ziliang Yin , Tuo Leng

This paper proposes methods of estimation and uniform inference for a general class of causal functions, such as the conditional average treatment effects and the continuous treatment effects, under multiway clustering. The causal function…

Econometrics · Economics 2024-09-11 Nan Liu , Yanbo Liu , Yuya Sasaki

We develop a unified framework for automatic debiased machine learning (autoDML) for inference on a broad class of statistical parameters. The framework applies to any smooth functional of a nonparametric M-estimand, defined as the…

Methodology · Statistics 2026-03-23 Lars van der Laan , Aurelien Bibaut , Nathan Kallus , Alex Luedtke

We consider the estimation of treatment effects in settings when multiple treatments are assigned over time and treatments can have a causal effect on future outcomes or the state of the treated unit. We propose an extension of the…

Econometrics · Economics 2021-06-18 Greg Lewis , Vasilis Syrgkanis

A central problem in cognitive science and behavioural neuroscience as well as in machine learning and artificial intelligence research is to ascertain whether two or more decision makers (be they brains or algorithms) use the same…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Robert Geirhos , Kristof Meding , Felix A. Wichmann

Different notions for order convergence have been considered by various authors. Associated to every notion of order convergence corresponds a topology, defined by taking as the closed sets those subsets of the poset satisfying that no net…

Functional Analysis · Mathematics 2020-12-29 Kevin Abela , Emmanuel Chetcuti , Hans Weber

Dynamic nonlinear systems exhibit distortions arising from coupled static and dynamic effects. Their intertwined nature poses major challenges for data-driven modeling. This paper presents a theoretical framework grounded in structured…

Machine Learning · Computer Science 2025-09-23 Sri Satish Krishna Chaitanya Bulusu , Mikko Sillanpää

The Rasch model is the most prominent member of the class of latent trait models that are in common use. The main reason is that it can be considered as a measurement model that allows to separate person and item parameters, a feature that…

Methodology · Statistics 2023-01-10 Gerhard Tutz

Neural networks trained on biased datasets tend to inadvertently learn spurious correlations, hindering generalization. We formally prove that (1) samples that exhibit spurious correlations lie on a lower rank manifold relative to the ones…

Machine Learning · Computer Science 2024-11-07 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Abhra Chaudhuri , Anjan Dutta

In this draft, fault diagnosis in nonlinear dynamic systems is addressed. The objective of this work is to establish a framework, in which not only model-based but also data-driven and machine learning based fault diagnosis strategies can…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Steven X. Ding , Linlin Li

In distributed-parameter inverse problems in computational mechanics, spatially varying fields are inferred from noisy, indirect, and heterogeneous observations. The relevant identifiability question concerns which spatial perturbation…

Computational Engineering, Finance, and Science · Computer Science 2026-05-28 Tammam Bakeer

The aim of this Lecture Note is to introduce the Signal Processing (SP) community to a powerful yet still under-utilised tool: the semiparametric statistics. In short, the semiparametric framework allows us to estimate or perform hypothesis…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Stefano Fortunati

Developing robust inference for models with nonparametric Unobserved Heterogeneity (UH) is both important and challenging. We propose novel Debiased Machine Learning (DML) procedures for valid inference on functionals of UH, allowing for…

Econometrics · Economics 2025-07-21 Facundo Argañaraz , Juan Carlos Escanciano

In many classification problems, misclassification costs are highly asymmetric, while training labels are often corrupted due to measurement error, annotator variability, or adversarial noise. The Neyman-Pearson multiclass classification…

Methodology · Statistics 2026-04-22 Qiong Zhang , Qinglong Tian , Pengfei Li

The goal of this article is twofold. Firstly, nonlinear system identification is introduced to a wide audience, guiding practicing engineers and newcomers in the field to a sound solution of their data driven modeling problems for nonlinear…

Systems and Control · Computer Science 2019-02-05 Johan Schoukens , Lennart Ljung

Change-plane regression identifies subpopulations through an interpretable linear threshold rule, but likelihood-based inference for the hard-threshold boundary is nonregular: objectives are non-smooth, the boundary is weakly identified…

Methodology · Statistics 2026-04-28 Yuki Ohnishi , Fan Li

This work is about understanding the impact of invariance and equivariance on generalisation in supervised learning. We use the perspective afforded by an averaging operator to show that for any predictor that is not equivariant, there is…

Machine Learning · Computer Science 2025-01-08 Hayder Elesedy

First non-zero Neumann eigenvalues of a rectangle and a parallelogram with the same base and area are compared in case when the height of the parallelogram is greater than the base. This result is applied to compare first non-zero Neumann…

Metric Geometry · Mathematics 2018-10-17 Arseny Raiko

This paper proposes a generalized framework with joint normalization which learns lower-dimensional subspaces with maximum discriminative power by making use of the Riemannian geometry. In particular, we model the similarity/dissimilarity…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Tianci Liu , Zelin Shi , Yunpeng Liu