English
Related papers

Related papers: Greedy Is Enough: Sparse Action Discovery in Agent…

200 papers

We propose a greedy algorithm to select $N$ important features among $P$ input features for a non-linear prediction problem. The features are selected one by one sequentially, in an iterative loss minimization procedure. We use neural…

Machine Learning · Computer Science 2023-09-14 Sandipan Das , Alireza M. Javid , Prakash Borpatra Gohain , Yonina C. Eldar , Saikat Chatterjee

We study a logistic model-based active learning procedure for binary classification problems, in which we adopt a batch subject selection strategy with a modified sequential experimental design method. Moreover, accompanying the proposed…

Machine Learning · Statistics 2018-02-02 Hsiang-Ling Hsu , Yuan-Chin Ivan Chang , Ray-Bing Chen

We study Matching and other related problems in a partial information setting where the agents' utilities for being matched to other agents are hidden and the mechanism only has access to ordinal preference information. Our model is…

Computer Science and Game Theory · Computer Science 2016-08-03 Elliot Anshelevich , Shreyas Sekar

We study the problem of estimating a random process from the observations collected by a network of sensors that operate under resource constraints. When the dynamics of the process and sensor observations are described by a state-space…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

Many robotic systems deal with uncertainty by performing a sequence of information gathering actions. In this work, we focus on the problem of efficiently constructing such a sequence by drawing an explicit connection to submodularity.…

Large Language Models (LLMs) exhibit significant activation sparsity, where only a subset of neurons are active for a given input. Although this sparsity presents opportunities to reduce computational cost, efficiently utilizing it requires…

Machine Learning · Computer Science 2025-07-22 Nobel Dhar , Bobin Deng , Md Romyull Islam , Xinyue Zhang , Kazi Fahim Ahmad Nasif , Kun Suo

We develop a real-time anomaly detection algorithm for directed activity on large, sparse networks. We model the propensity for future activity using a dynamic logistic model with interaction terms for sender- and receiver-specific latent…

Methodology · Statistics 2021-02-01 Wesley Lee , Tyler H. McCormick , Joshua Neil , Cole Sodja , Yanran Cui

Greedy algorithms for minimizing L0-norm of sparse decomposition have profound application impact on many signal processing problems. In the sparse coding setup, given the observations $\mathrm{y}$ and the redundant dictionary…

Numerical Analysis · Computer Science 2015-02-13 Yuanyi Xue , Yao Wang

Sparse-reward reinforcement learning (RL) remains fundamentally hard: without structure, any agent needs $\Omega(|\mathcal{S}||\mathcal{A}|/p)$ samples to recover rewards. We introduce Policy-Aware Matrix Completion (PAMC) as a first…

Machine Learning · Computer Science 2025-09-10 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

We describe the Greedy Sparse Subspace Clustering (GSSC) algorithm providing an efficient method for clustering data belonging to a few low-dimensional linear or affine subspaces from incomplete corrupted and noisy data. We provide…

Numerical Analysis · Mathematics 2013-04-17 Alexander Petukhov , Inna Kozlov

We present a transition-based parser that jointly produces syntactic and semantic dependencies. It learns a representation of the entire algorithm state, using stack long short-term memories. Our greedy inference algorithm has linear time,…

Computation and Language · Computer Science 2018-07-06 Swabha Swayamdipta , Miguel Ballesteros , Chris Dyer , Noah A. Smith

We propose a Reinforcement Learning framework for sparse indirect control of large-scale multi-agent systems, where few controlled agents shape the collective behavior of many uncontrolled agents. The approach addresses this multi-scale…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Luigi Catello , Italo Napolitano , Davide Salzano , Mario di Bernardo

We study a linear quadratic regulation problem with a constraint where the control input can be nonzero only at a limited number of times. Given that this constraint leads to a combinational optimization problem, we adopt a greedy method to…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Shumpei Nishida , Kunihisa Okano

We propose a new scalable method to optimize the architecture of an artificial neural network. The proposed algorithm, called Greedy Search for Neural Network Architecture, aims to determine a neural network with minimal number of layers…

Machine Learning · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Junqi Yin , Ying Wai Li , Markus Eisenbach

Test-time data augmentation$-$averaging the predictions of a machine learning model across multiple augmented samples of data$-$is a widely used technique that improves the predictive performance. While many advanced learnable data…

Machine Learning · Statistics 2020-06-23 Dmitry Molchanov , Alexander Lyzhov , Yuliya Molchanova , Arsenii Ashukha , Dmitry Vetrov

The cosparse analysis model has been introduced recently as an interesting alternative to the standard sparse synthesis approach. A prominent question brought up by this new construction is the analysis pursuit problem -- the need to find a…

Functional Analysis · Mathematics 2014-01-06 Raja Giryes , Sangnam Nam , Michael Elad , Rémi Gribonval , Mike E. Davies

This paper investigates regret minimization, statistical inference, and their interplay in high-dimensional online decision-making based on the sparse linear context bandit model. We integrate the $\varepsilon$-greedy bandit algorithm for…

Machine Learning · Computer Science 2025-05-20 Congyuan Duan , Wanteng Ma , Jiashuo Jiang , Dong Xia

Greedy algorithms for feature selection are widely used for recovering sparse high-dimensional vectors in linear models. In classical procedures, the main emphasis was put on the sample complexity, with little or no consideration of the…

Machine Learning · Statistics 2021-02-11 El Mehdi Saad , Gilles Blanchard , Sylvain Arlot

Precision matrix estimation is an important problem in statistical data analysis. This paper introduces a fast sparse precision matrix estimation algorithm, namely GISS$^{{\rho}}$, which is originally introduced for compressive sensing. The…

Statistics Theory · Mathematics 2019-07-02 Didi Lv , Xiaoqun Zhang

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson