English
Related papers

Related papers: Improving Accuracy of Permutation DAG Search using…

200 papers

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

Methodology · Statistics 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

In the algorithm Intersort, Chevalley et al. (2024) proposed a score-based method to discover the causal order of variables in a Directed Acyclic Graph (DAG) model, leveraging interventional data to outperform existing methods. However, as…

Machine Learning · Computer Science 2024-10-14 Mathieu Chevalley , Arash Mehrjou , Patrick Schwab

This paper considers simulation-based optimization of the performance of a regime-switching stochastic system over a finite set of feasible configurations. Inspired by the stochastic fictitious play learning rules in game theory, we propose…

Optimization and Control · Mathematics 2016-11-18 Omid Namvar Gharehshiran , Vikram Krishnamurthy , George Yin

A new sparse SOS decomposition algorithm is proposed based on a new sparsity pattern, called cross sparsity patterns. The new sparsity pattern focuses on the sparsity of terms and thus is different from the well-known correlative sparsity…

Optimization and Control · Mathematics 2019-01-23 Jie Wang , Haokun Li , Bican Xia

Sparse training is emerging as a promising avenue for reducing the computational cost of training neural networks. Several recent studies have proposed pruning methods using learnable thresholds to efficiently explore the non-uniform…

Machine Learning · Computer Science 2023-04-17 Abhisek Kundu , Naveen K. Mellempudi , Dharma Teja Vooturi , Bharat Kaul , Pradeep Dubey

This paper addresses the challenge of dynamic multi-objective optimization problems (DMOPs) by introducing novel approaches for accelerating prediction strategies within the evolutionary algorithm framework. Since the objectives of DMOPs…

Neural and Evolutionary Computing · Computer Science 2024-11-14 Ru Lei , Lin Li , Rustam Stolkin , Bin Feng

Score-based generative models (SGMs) have gained prominence in sparse-view CT reconstruction for their precise sampling of complex distributions. In SGM-based reconstruction, data consistency in the score-based diffusion model ensures close…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weiwen Wu , Yanyang Wang

Vecchia's approximate likelihood for Gaussian process parameters depends on how the observations are ordered, which can be viewed as a deficiency because the exact likelihood is permutation-invariant. This article takes the alternative…

Computation · Statistics 2018-02-20 Joseph Guinness

Recent claims of achieving exponential quantum advantage have attracted attention to Gaussian boson sampling (GBS), a potential application of which is dense subgraph finding. We investigate the effects of sources of error including loss…

Quantum Physics · Physics 2023-02-01 Naomi R. Solomons , Oliver F. Thomas , Dara P. S. McCutcheon

In the context of variable selection, ensemble learning has gained increasing interest due to its great potential to improve selection accuracy and to reduce false discovery rate. A novel ordering-based selective ensemble learning strategy…

Machine Learning · Statistics 2017-04-28 Chunxia Zhang , Yilei Wu , Mu Zhu

We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique del Castillo

Decision tree optimization is fundamental to interpretable machine learning. The most popular approach is to greedily search for the best feature at every decision point, which is fast but provably suboptimal. Recent approaches find the…

Machine Learning · Computer Science 2025-11-19 Varun Babbar , Hayden McTavish , Cynthia Rudin , Margo Seltzer

The article considers the problem of estimating a high-dimensional sparse parameter in the presence of side information that encodes the sparsity structure. We develop a general framework that involves first using an auxiliary sequence to…

Methodology · Statistics 2019-10-21 Trambak Banerjee , Gourab Mukherjee , Wenguang Sun

Greedy algorithms have long been a workhorse for learning graphical models, and more broadly for learning statistical models with sparse structure. In the context of learning directed acyclic graphs, greedy algorithms are popular despite…

Machine Learning · Computer Science 2021-11-01 Goutham Rajendran , Bohdan Kivva , Ming Gao , Bryon Aragam

In trained deep neural networks, unstructured pruning can reduce redundant weights to lower storage cost. However, it requires the customization of hardwares to speed up practical inference. Another trend accelerates sparse model inference…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Zhuliang Yao , Shijie Cao , Wencong Xiao , Chen Zhang , Lanshun Nie

We initiate the study of distortion in stable matching. Concretely, we aim to design algorithms that have limited access to the agents' cardinal preferences and compute stable matchings of high quality with respect to some aggregate…

Computer Science and Game Theory · Computer Science 2026-02-17 Aris Filos-Ratsikas , Georgios Kalantzis

Least squares (LS)-based subset selection methods are popular in linear regression modeling. Best subset selection (BS) is known to be NP-hard and has a computational cost that grows exponentially with the number of predictors. Recently,…

Methodology · Statistics 2021-03-09 Sen Tian , Clifford M. Hurvich , Jeffrey S. Simonoff

The recent focus on the efficiency of deep neural networks (DNNs) has led to significant work on model compression approaches, of which weight pruning is one of the most popular. At the same time, there is rapidly-growing computational…

Machine Learning · Computer Science 2022-08-25 Elias Frantar , Dan Alistarh

Variable selection in linear regression settings is a much discussed problem. Best subset selection (BSS) is often considered the intuitive 'gold standard', with its use being restricted only by its NP-hard nature. Alternatives such as the…

Methodology · Statistics 2023-02-24 Moritz Hanke , Louis Dijkstra , Ronja Foraita , Vanessa Didelez

This paper proposes a simple adaptive sensing and group testing algorithm for sparse signal recovery. The algorithm, termed Compressive Adaptive Sense and Search (CASS), is shown to be near-optimal in that it succeeds at the lowest possible…

Information Theory · Computer Science 2014-04-30 Matthew L. Malloy , Robert D. Nowak