English
Related papers

Related papers: A Consistent Heteroskedasticity Robust LM Type Spe…

200 papers

We propose a novel approach to conformal prediction for generative language models (LMs). Standard conformal prediction produces prediction sets -- in place of single predictions -- that have rigorous, statistical performance guarantees. LM…

Computation and Language · Computer Science 2024-06-04 Victor Quach , Adam Fisch , Tal Schuster , Adam Yala , Jae Ho Sohn , Tommi S. Jaakkola , Regina Barzilay

Large language models (LLMs) have shown tremendous success in following user instructions and generating helpful responses. Nevertheless, their robustness is still far from optimal, as they may generate significantly inconsistent responses…

Computation and Language · Computer Science 2024-03-25 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Shuaiqiang Wang , Chong Meng , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Robust tests of general composite hypothesis under non-identically distributed observations is always a challenge. Ghosh and Basu (2018, Statistica Sinica, 28, 1133--1155) have proposed a new class of test statistics for such problems based…

Statistics Theory · Mathematics 2019-01-08 Abhik Ghosh , Ayanendranath Basu

We propose a bootstrap-based test to detect a mean shift in a sequence of high-dimensional observations with unknown time-varying heteroscedasticity. The proposed test builds on the U-statistic based approach in Wang et al. (2022), targets…

Methodology · Statistics 2023-11-17 Teng Wu , Stanislav Volgushev , Xiaofeng Shao

Large language models (LLMs) are increasingly used to simulate human behavior, but common practices to use LLM-generated data are inefficient. Treating an LLM's output ("model choice") as a single data point underutilizes the information…

Artificial Intelligence · Computer Science 2025-12-30 Hongshen Sun , Juanjuan Zhang

This paper proposes an overidentifying restriction test for high-dimensional linear instrumental variable models. The novelty of the proposed test is that it allows the number of covariates and instruments to be larger than the sample size.…

Econometrics · Economics 2024-05-08 Qingliang Fan , Zijian Guo , Ziwei Mei

Partial label learning (PLL) learns from training examples each associated with multiple candidate labels, among which only one is valid. In recent years, benefiting from the strong capability of dealing with ambiguous supervision and the…

Artificial Intelligence · Computer Science 2024-02-28 Qian-Wei Wang , Bowen Zhao , Mingyan Zhu , Tianxiang Li , Zimo Liu , Shu-Tao Xia

The integrated conditional moment (ICM) test is a classical and widely used method for assessing the adequacy of regression models. Although it performs well in fixed-dimension settings, its behavior changes dramatically when the predictor…

Methodology · Statistics 2026-04-17 Yue Hu , Haiqi Li , Xintao Xia

In this article, a novel identification test is proposed, which can be applied to parameteric models such as Mixture of Normal (MN) distributions, Markow Switching(MS), or Structural Autoregressive (SVAR) models. In the approach, it is…

Methodology · Statistics 2022-06-09 Katarzyna Maciejowska

In this paper, we consider the problem of estimating parameters of a linear regression model. Using a hybrid systems framework, a hybrid algorithm is proposed allowing the estimate to converge to the exact value of the unknown parameters in…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Adnane Saoud , Ryan S. Johnson , Ricardo G. Sanfelice

Given a finite-valued sample $X_1,...,X_n$ we wish to test whether it was generated by a stationary ergodic process belonging to a family $H_0$, or it was generated by a stationary ergodic process outside $H_0$. We require the Type I error…

Statistics Theory · Mathematics 2014-12-30 Daniil Ryabko

Pseudo-labeling is a commonly used paradigm in semi-supervised learning, yet its application to semi-supervised regression (SSR) remains relatively under-explored. Unlike classification, where pseudo-labels are discrete and confidence-based…

Machine Learning · Computer Science 2025-10-20 Xueqing Sun , Renzhen Wang , Quanziang Wang , Yichen Wu , Xixi Jia , Deyu Meng

The free-energy lattice Boltzmann (LB) model is one of the major multiphase models in the LB community. The present study is focused on a class of free-energy LB models in which the divergence of thermodynamic pressure tensor or its…

Computational Physics · Physics 2021-01-20 Q. Li , Y. Yu , R. Z. Huang

We investigate the behavior of the Generalized Likelihood Ratio Test (GLRT) (Fan, Zhang and Zhang [Ann. Statist. 29 (2001) 153-193]) for time varying coefficient models where the regressors and errors are non-stationary time series and can…

Statistics Theory · Mathematics 2014-02-05 Zhou Zhou

Runtime verification encompasses several lightweight techniques for checking whether a system's current execution satisfies a given specification. We focus on runtime verification for Linear Temporal Logic (LTL). Previous work describes…

Logic in Computer Science · Computer Science 2025-08-12 Javier Esparza , Vincent Fischer

We propose and implement an approach to inference in linear instrumental variables models which is simultaneously robust and computationally tractable. Inference is based on self-normalization of sample moment conditions, and allows for…

Econometrics · Economics 2022-11-29 Eric Gautier , Christiern Rose

Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress of machine learning in recent years has been the ability to…

Machine Learning · Computer Science 2020-06-30 Giorgi Nadiradze , Ilia Markov , Bapi Chatterjee , Vyacheslav Kungurtsev , Dan Alistarh

Most linear experimental design problems assume homogeneous variance although heteroskedastic noise is present in many realistic settings. Let a learner have access to a finite set of measurement vectors $\mathcal{X}\subset \mathbb{R}^d$…

Statistics Theory · Mathematics 2024-09-19 Justin Weltz , Tanner Fiez , Alexander Volfovsky , Eric Laber , Blake Mason , Houssam Nassif , Lalit Jain

Accurately gauging the confidence level of Large Language Models' (LLMs) predictions is pivotal for their reliable application. However, LLMs are often uncalibrated inherently and elude conventional calibration techniques due to their…

In subgroup analysis, testing the existence of a subgroup with a differential treatment effect serves as protection against spurious subgroup discovery. Despite its importance, this hypothesis testing possesses a complicated nature:…

Statistics Theory · Mathematics 2025-03-21 Shota Takeishi