English
Related papers

Related papers: A Dimension Reduction Technique for Large-scale St…

200 papers

Spike and slab priors play a key role in inducing sparsity for sparse signal recovery. The use of such priors results in hard non-convex and mixed integer programming problems. Most of the existing algorithms to solve the optimization…

Methodology · Statistics 2019-04-02 Fekadu L. Bayisa , Zhiyong Zhou , Ottmar Cronie , Jun Yu

Active clustering aims to boost the clustering performance by integrating human-annotated pairwise constraints through strategic querying. Conventional approaches with semi-supervised clustering schemes encounter high query costs when…

Machine Learning · Computer Science 2024-07-16 Xun Deng , Junlong Liu , Han Zhong , Fuli Feng , Chen Shen , Xiangnan He , Jieping Ye , Zheng Wang

This letter proposes a novel sparsity-aware adaptive filtering scheme and algorithms based on an alternating optimization strategy with shrinkage. The proposed scheme employs a two-stage structure that consists of an alternating…

Systems and Control · Computer Science 2023-07-19 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

Large Language Models (LLMs) demonstrate impressive ability in handling reasoning tasks. However, unlike humans who can instinctively adapt their problem-solving strategies to the complexity of task, most LLM-based methods adopt a…

Computation and Language · Computer Science 2024-12-24 Jianpeng Zhou , Wanjun Zhong , Yanlin Wang , Jiahai Wang

Multisource data has spurred the development of advanced clustering algorithms, such as multi-view clustering, which critically relies on constructing similarity matrices. Traditional algorithms typically generate these matrices from sample…

Machine Learning · Computer Science 2024-10-30 Xuetong Li , Xiao-Dong Zhang

Modern solutions to the single image super-resolution (SISR) problem using deep neural networks aim not only at better performance accuracy but also at a lighter and computationally efficient model. To that end, recently, neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Yan Wu , Zhiwu Huang , Suryansh Kumar , Rhea Sanjay Sukthanker , Radu Timofte , Luc Van Gool

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

Machine Learning · Computer Science 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Sparse Inverse Covariance Estimation (SICE) is useful in many practical data analyses. Recovering the connectivity, non-connectivity graph of covariates is classified amongst the most important data mining and learning problems. In this…

Machine Learning · Computer Science 2019-04-05 Ashkan Esmaeili , Farokh Marvasti

Subspace clustering algorithms are notorious for their scalability issues because building and processing large affinity matrices are demanding. In this paper, we introduce a method that simultaneously learns an embedding space along…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Tong Zhang , Pan Ji , Mehrtash Harandi , Richard Hartley , Ian Reid

In ill-posed dynamic inverse problems expected spatial features and temporal correlation between frames can be leveraged to improve the quality of the computed solution, in particular when the available data are limited and the…

Improving Markov chain Monte Carlo algorithm efficiency is essential for enhancing computational speed and inferential accuracy in Bayesian analysis. These improvements can be effectively achieved using the ancillarity-sufficiency…

Methodology · Statistics 2025-11-13 Makoto Nakakita , Tomoki Toyabe , Teruo Nakatsuma , Takahiro Hoshino

We consider the stochastic optimization problem where a convex function is minimized observing recursively the gradients. We introduce SAEW, a new procedure that accelerates exponential weights procedures with the slow rate $1/\sqrt{T}$ to…

Statistics Theory · Mathematics 2016-10-18 Pierre Gaillard , Olivier Wintenberger

In many real-world problems, we are dealing with collections of high-dimensional data, such as images, videos, text and web documents, DNA microarray data, and more. Often, high-dimensional data lie close to low-dimensional structures…

Computer Vision and Pattern Recognition · Computer Science 2013-02-06 Ehsan Elhamifar , Rene Vidal

We provide a sparse version of the bounded degree SOS hierarchy BSOS [7] for polynomial optimization problems. It permits to treat large scale problems which satisfy a structured sparsity pattern. When the sparsity pattern satisfies the…

Optimization and Control · Mathematics 2017-05-30 Tillmann Weisser , Jean-Bernard Lasserre , Kim-Chuan Toh

In this paper, we introduce a novel linear model tailored for semisupervised/library-based unmixing. Our model incorporates considerations for library mismatch while enabling the enforcement of the abundance sum-to-one constraint (ASC).…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Behnood Rasti , Alexandre Zouaoui , Julien Mairal , Jocelyn Chanussot

Alternating structure-adapted proximal (ASAP) gradient algorithm (M. Nikolova and P. Tan, SIAM J Optim, 29:2053-2078, 2019) has drawn much attention due to its efficiency in solving nonconvex nonsmooth optimization problems. However, the…

Optimization and Control · Mathematics 2024-06-26 Ying Gao , Chunfeng Cui , Wenxing Zhang , Deren Han

Clustering is a fundamental problem in unsupervised learning. Popular methods like K-means, may suffer from poor performance as they are prone to get stuck in its local minima. Recently, the sum-of-norms (SON) model (also known as the…

Machine Learning · Computer Science 2018-10-08 Defeng Sun , Kim-Chuan Toh , Yancheng Yuan

To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Chen Tang , Wenyu Sun , Zhuqing Yuan , Yongpan Liu

Massive datasets often contain redundancy that inflates computational costs without improving generalization. Existing data reduction methods are typically task-agnostic, discarding informative boundary samples and yielding suboptimal…

Machine Learning · Computer Science 2026-04-07 Jiacheng Lyu , Bihua Bao , Shiyun Yan