English
Related papers

Related papers: Statistical inference for the penalized EM algorit…

200 papers

Metric learning has attracted extensive interest for its ability to provide personalized recommendations based on the importance of observed user-item interactions. Current metric learning methods aim to push negative items away from the…

Information Retrieval · Computer Science 2025-12-24 Yan Zhang , Li Deng , Lixin Duan , Sami Azam

In this paper, we leverage existing statistical methods to better understand feature learning from data. We tackle this by modifying the model-free variable selection method, Feature Ordering by Conditional Independence (FOCI), which is…

Machine Learning · Statistics 2025-02-14 Krunoslav Lehman Pavasovic , David Lopez-Paz , Giulio Biroli , Levent Sagun

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

Statistics Theory · Mathematics 2021-07-30 Michael Celentano , Andrea Montanari

Penalized smoothing is a standard tool in regression analysis. Classical approaches often rely on basis or kernel expansions, which constrain the estimator to a fixed span and impose smoothness assumptions that may be restrictive for…

Statistics Theory · Mathematics 2026-01-19 Marc Vidal , Yves Rosseel

State-of-the-art object detectors rely on regressing and classifying an extensive list of possible anchors, which are divided into positive and negative samples based on their intersection-over-union (IoU) with corresponding groundtruth…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Hengduo Li , Zuxuan Wu , Chen Zhu , Caiming Xiong , Richard Socher , Larry S. Davis

We study the problem of list-decodable sparse mean estimation. Specifically, for a parameter $\alpha \in (0, 1/2)$, we are given $m$ points in $\mathbb{R}^n$, $\lfloor \alpha m \rfloor$ of which are i.i.d. samples from a distribution $D$…

Data Structures and Algorithms · Computer Science 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Discrete diffusion language models improve generation efficiency through parallel token prediction, but standard $X_0$ prediction methods introduce factorization errors by approximating the clean token posterior with independent token-wise…

Computation and Language · Computer Science 2026-05-15 Xun Fang , Yunchen Li , Hang Yuan , Zhou Yu

In the context of fault-detection problems, the objective is to identify all defective items among a set of $n$ binary-state items using the minimum number of tests. The {group testing} paradigm, which allows testing a subset of items in a…

Combinatorics · Mathematics 2025-11-18 Jun Wu , Yongxi Cheng , Zhen Yang , Feng Chu , Junkai He

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

Computed Laminography (CL) is a key non-destructive testing technology for the visualization of internal structures in large planar objects. The inherent scanning geometry of CL inevitably results in inter-layer aliasing artifacts, limiting…

Image and Video Processing · Electrical Eng. & Systems 2026-01-13 Tan Liu , Liu Shi , Binghuang Peng , Tong Jia , Xiaoling Xu , Baodong Liu , Qiegen Liu

Iterative Proportional Fitting (IPF), combined with EM, is commonly used as an algorithm for likelihood maximization in undirected graphical models. In this paper, we present two iterative algorithms that generalize upon IPF. The first one…

Machine Learning · Computer Science 2013-01-07 Wim Wiegerinck , Tom Heskes

The rapid release of both language models and benchmarks makes it increasingly costly to evaluate every model on every dataset. In practice, models are often evaluated on different samples, making scores difficult to compare across studies.…

Computation and Language · Computer Science 2026-04-16 Eliya Habba , Itay Itzhak , Asaf Yehudai , Yotam Perlitz , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen , Gabriel Stanovsky

Generalized category discovery (GCD) is an important and challenging task in open-world learning. Specifically, given some labeled data of known classes, GCD aims to cluster unlabeled data that contain both known and unknown classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhimao Peng , Enguang Wang , Fei Yang , Xialei Liu , Ming-Ming Cheng

Motivated by the simultaneous association analysis with the presence of latent confounders, this paper studies the large-scale hypothesis testing problem for the high-dimensional confounded linear models with both non-asymptotic and…

Methodology · Statistics 2023-08-24 Yinrui Sun , Li Ma , Yin Xia

Motivated by the problem of inferring the graph structure of functional connectivity networks from multi-level functional magnetic resonance imaging data, we develop a valid inference framework for high-dimensional graphical models that…

Methodology · Statistics 2024-03-18 Kun Yue , Eardi Lila , Ali Shojaie

Ordering-based approaches to causal discovery identify topological orders of causal graphs, providing scalable alternatives to combinatorial search methods. Under the Additive Noise Model (ANM) assumption, recent causal ordering methods…

Machine Learning · Computer Science 2025-10-28 Jiyeon Kang , Songseong Kim , Chanhui Lee , Doyeong Hwang , Joanie Hayoun Chung , Yunkyung Ko , Sumin Lee , Sungwoong Kim , Sungbin Lim

To accommodate rapid changes in the real world, the cognition system of humans is capable of continually learning concepts. On the contrary, conventional deep learning models lack this capability of preserving previously learned knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Can Peng , Kun Zhao , Sam Maksoud , Tianren Wang , Brian C. Lovell

The LASSO estimator is an $\ell_1$-norm penalized least-squares estimator, which was introduced for variable selection in the linear model. When the design matrix satisfies, e.g. the Restricted Isometry Property, or has a small coherence…

Statistics Theory · Mathematics 2014-06-24 Stephane Chretien

The lack of reliable methods for identifying descriptors - the sets of parameters capturing the underlying mechanisms of a materials property - is one of the key factors hindering efficient materials development. Here, we propose a…

Materials Science · Physics 2018-08-15 Runhai Ouyang , Stefano Curtarolo , Emre Ahmetcik , Matthias Scheffler , Luca M. Ghiringhelli