English
Related papers

Related papers: Handling Sparse Data by Successive Abstraction

200 papers

Answering complex questions that require making latent decisions is a challenging task, especially when limited supervision is available. Recent works leverage the capabilities of large language models (LMs) to perform complex question…

Computation and Language · Computer Science 2022-12-09 Dheeru Dua , Shivanshu Gupta , Sameer Singh , Matt Gardner

Today, data analysts largely rely on intuition to determine whether missing or withheld rows of a dataset significantly affect their analyses. We propose a framework that can produce automatic contingency analysis, i.e., the range of values…

Databases · Computer Science 2020-04-09 Xi Liang , Zechao Shang , Aaron J. Elmore , Sanjay Krishnan , Michael J. Franklin

Approximations during program analysis are a necessary evil, as they ensure essential properties, such as soundness and termination of the analysis, but they also imply not always producing useful results. Automatic techniques have been…

Programming Languages · Computer Science 2018-12-18 Isabel Garcia-Contreras , Jose F. Morales , Manuel V. Hermenegildo

Sparse linear inverse problems appear in a variety of settings, but often the noise contaminating observations cannot accurately be described as bounded by or arising from a Gaussian distribution. Poisson observations in particular are a…

Statistics Theory · Mathematics 2018-02-14 Xin Jiang , Patricia Reynaud-Bouret , Vincent Rivoirard , Laure Sansonnet , Rebecca Willett

While the difficulty of reinforcement learning problems is typically related to the complexity of their state spaces, Abstraction proposes that solutions often lie in simpler underlying latent spaces. Prior works have focused on learning…

Artificial Intelligence · Computer Science 2022-10-19 Amnon Attali , Pedro Cisneros-Velarde , Marco Morales , Nancy M. Amato

Parsimony, including sparsity and low rank, has been shown to successfully model data in numerous machine learning and signal processing tasks. Traditionally, such modeling approaches rely on an iterative algorithm that minimizes an…

Machine Learning · Computer Science 2012-12-18 Pablo Sprechmann , Alex M. Bronstein , Guillermo Sapiro

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is done by solving an l_1-regularized linear regression problem, usually called Lasso. In this work we first combine the…

Information Theory · Computer Science 2010-03-02 Pablo Sprechmann , Ignacio Ramirez , Guillermo Sapiro , Yonina C. Eldar

Multiple systems estimation strategies have recently been applied to quantify hard-to-reach populations, particularly when estimating the number of victims of human trafficking and modern slavery. In such contexts, it is not uncommon to see…

Methodology · Statistics 2020-03-06 Lax Chan , Bernard W. Silverman , Kyle Vincent

We discuss a novel sparsity prior for compressive imaging in the context of the theory of compressed sensing with coherent redundant dictionaries, based on the observation that natural images exhibit strong average sparsity over multiple…

Information Theory · Computer Science 2013-05-03 Rafael E. Carrillo , Jason D. McEwen , Dimitri Van De Ville , Jean-Philippe Thiran , Yves Wiaux

Sparse functional data frequently arise in real-world applications, posing significant challenges for accurate classification. To address this, we propose a novel classification method that integrates functional principal component analysis…

Computation · Statistics 2025-03-17 Ahmad Talafha

We devise a one-shot approach to distributed sparse regression in the high-dimensional setting. The key idea is to average "debiased" or "desparsified" lasso estimators. We show the approach converges at the same rate as the lasso as long…

Machine Learning · Statistics 2015-08-12 Jason D. Lee , Yuekai Sun , Qiang Liu , Jonathan E. Taylor

Tabular datasets are widely used in scientific disciplines such as biology. While these disciplines have already adopted AI methods to enhance their findings and analysis, they mainly use tree-based methods due to their interpretability. At…

Machine Learning · Computer Science 2025-04-16 Salvatore Raieli , Nathalie Jeanray , Stéphane Gerart , Sebastien Vachenc , Abdulrahman Altahhan

The unmatched ability of Deep Neural Networks in capturing complex patterns in large and noisy datasets is often associated with their large hypothesis space, and consequently to the vast amount of parameters that characterize model…

Machine Learning · Computer Science 2026-02-25 Enrico Ballini , Luca Muscarnera , Alessio Fumagalli , Anna Scotti , Francesco Regazzoni

We discuss a strategy of sparse approximation that is based on the use of an overcomplete basis, and evaluate its performance when a random matrix is used as this basis. A small combination of basis vectors is chosen from a given…

Information Theory · Computer Science 2016-06-29 Yoshinori Nakanishi-Ohno , Tomoyuki Obuchi , Masato Okada , Yoshiyuki Kabashima

The article considers the problem of estimating a high-dimensional sparse parameter in the presence of side information that encodes the sparsity structure. We develop a general framework that involves first using an auxiliary sequence to…

Methodology · Statistics 2019-10-21 Trambak Banerjee , Gourab Mukherjee , Wenguang Sun

Current abstractive summarization systems outperform their extractive counterparts, but their widespread adoption is inhibited by the inherent lack of interpretability. To achieve the best of both worlds, we propose EASE, an…

Computation and Language · Computer Science 2021-05-17 Haoran Li , Arash Einolghozati , Srinivasan Iyer , Bhargavi Paranjape , Yashar Mehdad , Sonal Gupta , Marjan Ghazvininejad

Shortcut mitigation strategies commonly rely on training data annotations, group-balanced held-out data or the presence of all groups, i.e., all combinations of (spurious) attributes and classes, in the training data. However, these…

Machine Learning · Computer Science 2026-05-14 Phuong Quynh Le , Jörg Schlötterer , Sari Sadiya , Gemma Roig , Christin Seifert

This paper considers sequential adaptive estimation of sparse signals under a constraint on the total sensing effort. The advantage of adaptivity in this context is the ability to focus more resources on regions of space where signal…

Methodology · Statistics 2013-04-03 Dennis Wei , Alfred O. Hero

Can textual data be compressed intelligently without losing accuracy in evaluating sentiment? In this study, we propose a novel evolutionary compression algorithm, PARSEC (PARts-of-Speech for sEntiment Compression), which makes use of…

Neural and Evolutionary Computing · Computer Science 2017-09-21 Emmanuel Dufourq , Bruce A. Bassett

Time delay estimation has long been an active area of research. In this work, we show that compressive sensing with interpolation may be used to achieve good estimation precision while lowering the sampling frequency. We propose an…

Information Theory · Computer Science 2013-06-12 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen