English
Related papers

Related papers: Leverage Point Identification Method for LAV-Based…

200 papers

Leverage scores have become essential in statistics and machine learning, aiding regression analysis, randomized matrix computations, and various other tasks. This paper delves into the inverse problem, aiming to recover the intrinsic model…

Machine Learning · Computer Science 2024-08-22 Chenyang Li , Zhao Song , Zhaoxing Xu , Junze Yin

Reinforcement learning (RL) refines large language models (LLMs) by directly optimizing model behavior through reward signals. While accurate state value estimation is critical for stable training in classical RL, it remains an…

Machine Learning · Computer Science 2026-05-29 Zizhe Chen , Jiqian Dong , Yizhou Tian , Garry Yang , Yongqiang Chen , Zhitang Chen , James Cheng

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires…

Machine Learning · Computer Science 2025-11-05 Rodrigo Mendoza-Smith

Errors-in-variables is a long-standing, difficult issue in linear regression; and progress depends in part on new identifying assumptions. I characterize measurement error as bad-leverage points and assume that fewer than half the sample…

Econometrics · Economics 2020-03-17 Eric Blankmeyer

The detection of influential observations for the standard least squares regression model is a question that has been extensively studied. LAD regression diagnostics offers alternative approaches whose main feature is the robustness. In…

Statistics Theory · Mathematics 2014-10-03 Giuseppe Melfi , Susana Faria

With the increased complexity of power systems due to the integration of smart grid technologies and renewable energy resources, more frequent changes have been introduced to system status, and the traditional serial mode of state…

Systems and Control · Computer Science 2018-03-12 Chen Yuan , Yuqi Zhou , Guofang Zhang , Guangyi Liu , Renchang Dai , Xi Chen , Zhiwei Wang

In this paper the problem of retrospective change-point detection and estimation in multivariate linear models is considered. The lower bounds for the error of change-point estimation are proved in different cases (one change-point:…

Statistics Theory · Mathematics 2011-10-27 Boris Brodsky , Boris Darkhovsky

Leverage score sampling provides an appealing way to perform approximate computations for large matrices. Indeed, it allows to derive faithful approximations with a complexity adapted to the problem at hand. Yet, performing leverage scores…

Machine Learning · Statistics 2019-01-25 Alessandro Rudi , Daniele Calandriello , Luigi Carratino , Lorenzo Rosasco

Traditional LLM alignment methods are vulnerable to heterogeneity in human preferences. Fitting a na\"ive probabilistic model to pairwise comparison data (say over prompt-completion pairs) yields an inconsistent estimate of the…

Artificial Intelligence · Computer Science 2025-10-30 Ali Aouad , Aymane El Gadarri , Vivek F. Farias

Estimating the difficulty of input questions as perceived by large language models (LLMs) is essential for accurate performance evaluation and adaptive inference. Existing methods typically rely on repeated response sampling, auxiliary…

Computation and Language · Computer Science 2025-09-17 Yubo Zhu , Dongrui Liu , Zecheng Lin , Wei Tong , Sheng Zhong , Jing Shao

This paper presents a method for jointly estimating the state, input, and parameters of linear systems in an online fashion. The method is specially designed for measurements that are corrupted with non-Gaussian noise or outliers, which are…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Jean-Sébastien Brouillon , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

This paper explores an energy-modified leverage sampling strategy for matrix completion in radio map construction. The main goal is to address potential identifiability issues in matrix completion with sparse observations by using a…

Signal Processing · Electrical Eng. & Systems 2024-04-15 Hao Sun , Junting Chen

Peak estimation of hybrid systems aims to upper bound extreme values of a state function along trajectories, where this state function could be different in each subsystem. This finite-dimensional but nonconvex problem may be lifted into an…

Optimization and Control · Mathematics 2023-03-22 Jared Miller , Mario Sznaier

A novel approach to the problem of partial state estimation of nonlinear systems is proposed. The main idea is to translate the state estimation problem into one of estimation of constant, unknown parameters related to the systems initial…

Systems and Control · Computer Science 2016-04-08 Ortega Romeo , Bobtsov Alexey , Pyrkin Anton , Aranovskiy Stanislav

This paper examines the problem of state estimation in power distribution systems under low-observability conditions. The recently proposed constrained matrix completion method which combines the standard matrix completion method and power…

Optimization and Control · Mathematics 2020-06-09 Yajing Liu , April Sagan , Andrey Bernstein , Rui Yang , Xinyang Zhou , Yingchen Zhang

Estimating the importance of variables is an essential task in modern machine learning. This help to evaluate the goodness of a feature in a given model. Several techniques for estimating the importance of variables have been developed…

Machine Learning · Statistics 2022-08-09 Louis Mozart Kamdem , Ernest Fokoue

In this paper, we consider the state estimation problem for nonlinear stochastic discrete-time systems. We combine Lyapunov's method in control theory and deep reinforcement learning to design the state estimator. We theoretically prove the…

Machine Learning · Computer Science 2021-01-08 Liang Hu , Chengwei Wu , Wei Pan

Suppose an $n \times d$ design matrix in a linear regression problem is given, but the response for each point is hidden unless explicitly requested. The goal is to sample only a small number $k \ll n$ of the responses, and then produce a…

Machine Learning · Computer Science 2018-09-06 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

The state estimation algorithm estimates the values of the state variables based on the measurement model described as the system of equations. Prior to applying the state estimation algorithm, the existence and uniqueness of the solution…

Information Theory · Computer Science 2022-10-21 Mirsad Cosovic , Muhamed Delalic , Darijo Raca , Dejan Vukobratovic

Location information will play a very important role in emerging wireless networks such as Intelligent Transportation Systems, 5G, and the Internet of Things. However, wrong location information can result in poor network outcomes. It is…

Signal Processing · Electrical Eng. & Systems 2020-07-08 Ullah Ihsan , Robert Malaney , Shihao Yan