English
Related papers

Related papers: Difference-of-Convex Elastic Net for Compressed Se…

200 papers

We introduce a novel and generic convolutional unit, DiCE unit, that is built using dimension-wise convolutions and dimension-wise fusion. The dimension-wise convolutions apply light-weight convolutional filtering across each dimension of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Sachin Mehta , Hannaneh Hajishirzi , Mohammad Rastegari

Compressive sensing is a signal acquisition framework based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable recovery. In this paper we introduce a new theory for…

Information Theory · Computer Science 2009-01-23 Dror Baron , Marco F. Duarte , Michael B. Wakin , Shriram Sarvotham , Richard G. Baraniuk

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

Machine Learning · Statistics 2025-02-04 Yasi Zhang , Oscar Leong

An algorithmic framework, based on the difference of convex functions algorithm (DCA), is proposed for minimizing a class of concave sparse metrics for compressed sensing problems. The resulting algorithm iterates a sequence of $\ell_1$…

Information Theory · Computer Science 2016-11-02 Penghang Yin , Jack Xin

While the depth of convolutional neural networks has attracted substantial attention in the deep learning research, the width of these networks has recently received greater interest. The width of networks, defined as the size of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Peng Liu , Xiaoxiao Zhou , Yangjunyi Li , El Basha Mohammad D , Ruogu Fang

In this paper, we develop a new framework for sensing and recovering structured signals. In contrast to compressive sensing (CS) systems that employ linear measurements, sparse representations, and computationally complex convex/greedy…

Machine Learning · Computer Science 2016-09-01 Ali Mousavi , Ankit B. Patel , Richard G. Baraniuk

We introduce Renet, a principled generalization of the Relaxed Lasso to the Elastic Net family of estimators. While, on the one hand, $\ell_1$-regularization is a standard tool for variable selection in high-dimensional regimes and, on the…

Methodology · Statistics 2026-02-12 Albert Dorador

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

Information Theory · Computer Science 2015-10-28 Sohail Bahmani , Justin Romberg

Model reduction is essential for real-time simulation of deformable objects. Linear techniques such as PCA provide structured and predictable behavior, but their limited expressiveness restricts accuracy under large or nonlinear…

Graphics · Computer Science 2026-01-28 Shixun Huang , Eitan Grinspun , Yue Chang

Difference-of-Convex Algorithm (DCA) is a well-known nonconvex optimization algorithm for minimizing a nonconvex function that can be expressed as the difference of two convex ones. Many famous existing optimization algorithms, such as SGD…

Machine Learning · Computer Science 2024-12-16 Youran Sun , Yihua Liu , Yi-Shuai Niu

We address the minimization of a smooth objective function under an $\ell_0$-constraint and simple convex constraints. When the problem has no constraints except the $\ell_0$-constraint, some efficient algorithms are available; for example,…

Optimization and Control · Mathematics 2017-01-31 Katsuya Tono , Akiko Takeda , Jun-ya Gotoh

Convolutional neural networks (CNNs) have shown great effectiveness in medical image segmentation. However, they may be limited in modeling large inter-subject variations in organ shapes and sizes and exploiting global long-range contextual…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Dense optical flow estimation is challenging when there are large displacements in a scene with heterogeneous motion dynamics, occlusion, and scene homogeneity. Traditional approaches to handle these challenges include hierarchical and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Ali Salehi , Madhusudhanan Balasubramanian

Deep neural networks face many problems in the field of hyperspectral image classification, lack of effective utilization of spatial spectral information, gradient disappearance and overfitting as the model depth increases. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Guandong Li

Support estimation (SE) of a sparse signal refers to finding the location indices of the non-zero elements in a sparse representation. Most of the traditional approaches dealing with SE problem are iterative algorithms based on greedy…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Mehmet Yamac , Mete Ahishali , Serkan Kiranyaz , Moncef Gabbouj

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

In this paper we develop a novel computational sensing framework for sensing and recovering structured signals. When trained on a set of representative signals, our framework learns to take undersampled measurements and recover signals from…

Machine Learning · Statistics 2017-07-12 Ali Mousavi , Gautam Dasarathy , Richard G. Baraniuk

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Harvesting dense pixel-level annotations to train deep neural networks for semantic segmentation is extremely expensive and unwieldy at scale. While learning from synthetic data where labels are readily available sounds promising,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Zuxuan Wu , Xintong Han , Yen-Liang Lin , Mustafa Gkhan Uzunbas , Tom Goldstein , Ser Nam Lim , Larry S. Davis

Compressive sensing (CS) is an emerging sampling technology that enables reconstructing signals from a subset of measurements and even corrupted measurements. Deep learning-based compressive sensing (DCS) has improved CS performance while…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Thuong , Nguyen Canh , Chien , Trinh Van