English
Related papers

Related papers: Scale-Location-Truncated Beta Regression: Expandin…

200 papers

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

We develop new representations for the Levy measures of the beta and gamma processes. These representations are manifested in terms of an infinite sum of well-behaved (proper) beta and gamma distributions. Further, we demonstrate how these…

Methodology · Statistics 2012-06-22 Yingjian Wang , Lawrence Carin

The paper studies the properties of stochastic gradient methods with preconditioning. We focus on momentum updated preconditioners with momentum coefficient $\beta$. Seeking to explain practical efficiency of scaled methods, we provide…

Optimization and Control · Mathematics 2022-10-24 Dmitry A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

We provide a comprehensive analysis of the two-parameter Beta distributions seen from the perspective of second-order stochastic dominance. By changing its parameters through a bijective mapping, we work with a bounded subset D instead of…

Probability · Mathematics 2022-08-01 Yann Braouezec , John Cagnol

Logistic regression model is widely used in many studies to investigate the relationship between a binary response variable $Y$ and a set of potential predictors $\mathbf X$. The binary response may represent, for example, the occurrence of…

Methodology · Statistics 2021-05-04 Aba Diop , El Hadji Deme , Aliou Diop

The problem of integrated volatility estimation for the solution X of a stochastic differential equation with L{\'e}vy-type jumps is considered under discrete high-frequency observations in both short and long time horizon. We provide an…

Statistics Theory · Mathematics 2020-05-01 Chiara Amorino , Arnaud Gloter

High-dimensional linear regression is important in many scientific fields. This article considers discrete measured data of underlying smooth latent processes, as is often obtained from chemical or biological systems. Interpretation in high…

This paper explores transfer learning in heterogeneous multi-source environments with distributional divergence between target and auxiliary domains. To address challenges in statistical bias and computational efficiency, we propose a…

Machine Learning · Statistics 2025-04-08 Chenqi Gong , Hu Yang

Standard variational lower bounds used to train latent variable models produce biased estimates of most quantities of interest. We introduce an unbiased estimator of the log marginal likelihood and its gradients for latent variable models…

Machine Learning · Computer Science 2020-07-14 Yucen Luo , Alex Beatson , Mohammad Norouzi , Jun Zhu , David Duvenaud , Ryan P. Adams , Ricky T. Q. Chen

The Big Data revolution is challenging the state-of-the-art statistical and econometric techniques not only for the computational burden connected with the high volume and speed which data are generated, but even more for the variety of…

Methodology · Statistics 2024-10-25 Giuseppe Arbia , Vincenzo Nardelli

We introduce the Byte Latent Transformer (BLT), a new byte-level LLM architecture that, for the first time, matches tokenization-based LLM performance at scale with significant improvements in inference efficiency and robustness. BLT…

In this paper considering the transformation $X=\frac{Y}{1+Y}$, where $Y \sim\text{Lindley}(\theta)$, we propose the unit-Lindley distribution and investigate some of its mathematical properties. A important fact associated with this new…

Methodology · Statistics 2018-01-09 J. Mazucheli , A. F. B. Menezes , S. Chakraborty

Large Language Models (LLMs) can achieve inflated scores on multiple-choice tasks by exploiting inherent biases in option positions or labels, rather than demonstrating genuine understanding. This study introduces SCOPE, an evaluation…

Computation and Language · Computer Science 2025-08-05 Wonjun Jeong , Dongseok Kim , Taegkeun Whangbo

We consider a linear regression model with regression parameter beta =(beta_1, ..., beta_p) and independent and identically N(0, sigma^2)distributed errors. Suppose that the parameter of interest is theta = a^T beta where a is a specified…

Computation · Statistics 2009-04-17 Paul Kabaila , Khageswor Giri

A fundamental problem in machine learning is understanding the effect of early stopping on the parameters obtained and the generalization capabilities of the model. Even for linear models, the effect is not fully understood for arbitrary…

Machine Learning · Computer Science 2024-06-10 Rishi Sonthalia , Jackie Lok , Elizaveta Rebrova

Distribution Regression (DR) on stochastic processes describes the learning task of regression on collections of time series. Path signatures, a technique prevalent in stochastic analysis, have been used to solve the DR problem. Recent…

Machine Learning · Computer Science 2024-10-15 Andrew Alden , Carmine Ventre , Blanka Horvath

A major family of sufficient dimension reduction (SDR) methods, called inverse regression, commonly require the distribution of the predictor $X$ to have a linear $E(X|\beta^\mathsf{T}X)$ and a degenerate $\mathrm{var}(X|\beta^\mathsf{T}X)$…

Methodology · Statistics 2023-08-30 Wei Luo , Yan Guo

The machine learning (ML) techniques to predict unitarity (UNI) and bounded from below (BFB) constraints in multi-scalar models is employed. The effectiveness of this approach is demonstrated by applying it to the two and three Higgs…

High Energy Physics - Phenomenology · Physics 2024-01-18 Darius Jurčiukonis

This article concerns the dimension reduction in regression for large data set. We introduce a new method based on the sliced inverse regression approach, called cluster-based regularized sliced inverse regression. Our method not only keeps…

Applications · Statistics 2013-12-03 Yue Yu , Zhihong Chen , Jie Yang

Cooperative geolocation has attracted significant research interests in recent years. A large number of localization algorithms rely on the availability of statistical knowledge of measurement errors, which is often difficult to obtain in…

Applications · Statistics 2017-01-05 Xiufang Shi , Guoqiang Mao , Brian. D. O. Anderson , Zaiyue Yang , Jiming Chen