English
Related papers

Related papers: OCP: Orthogonal Constrained Projection for Sparse …

200 papers

Ordinal regression predicts the objects' labels that exhibit a natural ordering, which is important to many managerial problems such as credit scoring and clinical diagnosis. In these problems, the ability to explain how the attributes…

Machine Learning · Computer Science 2019-11-15 Mengzhuo Guo , Zhongzhi Xu , Qingpeng Zhang , Xiuwu Liao , Jiapeng Liu

Computed tomography has propelled scientific advances in fields from biology to materials science. This technology allows for the elucidation of 3-dimensional internal structure by the attenuation of x-rays through an object at different…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Rey Mendoza , Minh Nguyen , Judith Weng Zhu , Vincent Dumont , Talita Perciano , Juliane Mueller , Vidya Ganapati

Deep neural networks have achieved remarkable performance on a range of classification tasks, with softmax cross-entropy (CE) loss emerging as the de-facto objective function. The CE loss encourages features of a class to have a higher…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Kanchana Ranasinghe , Muzammal Naseer , Munawar Hayat , Salman Khan , Fahad Shahbaz Khan

High-quality imaging in photoacoustic computed tomography (PACT) usually requires a high-channel count system for dense spatial sampling around the object to avoid aliasing-related artefacts. To reduce system complexity, various image…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Bowei Yao , Shilong Cui , Haizhao Dai , Qing Wu , Youshen Xiao , Fei Gao , Jingyi Yu , Yuyao Zhang , Xiran Cai

Expansion-enhanced sparse lexical representation improves information retrieval (IR) by minimizing vocabulary mismatch problems during lexical matching. In this paper, we explore the potential of jointly learning dense semantic…

Machine Learning · Computer Science 2024-05-24 Biplob Biswas , Rajiv Ramnath

Computed Tomography (CT) is pivotal in industrial quality control and medical diagnostics. Sparse-view CT, offering reduced ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayang Shi , Junyi Zhu , Daniel M. Pelt , K. Joost Batenburg , Matthew B. Blaschko

Decision trees are popular Classification and Regression tools and, when small-sized, easy to interpret. Traditionally, a greedy approach has been used to build the trees, yielding a very fast training process; however, controlling sparsity…

Optimization and Control · Mathematics 2020-02-24 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

Sparse reduced rank regression is an essential statistical learning method. In the contemporary literature, estimation is typically formulated as a nonconvex optimization that often yields to a local optimum in numerical computation. Yet,…

Methodology · Statistics 2022-12-06 Canhong Wen , Ruipeng Dong , Xueqin Wang , Weiyu Li , Heping Zhang

Deep representation learning has become one of the most widely adopted approaches for visual search, recommendation, and identification. Retrieval of such representations from a large database is however computationally challenging.…

Machine Learning · Computer Science 2020-04-14 Biswajit Paria , Chih-Kuan Yeh , Ian E. H. Yen , Ning Xu , Pradeep Ravikumar , Barnabás Póczos

Recurrent neural networks are powerful tools for handling incomplete data problems in computer vision, thanks to their significant generative capabilities. However, the computational demand for these algorithms is too high to work in real…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Ozgur Yilmaz

Matching pursuit, especially its orthogonal version (OMP) and variations, is a greedy algorithm widely used in signal processing, compressed sensing, and sparse modeling. Inspired by constrained sparse signal recovery, this paper proposes a…

Optimization and Control · Mathematics 2020-03-18 Jinglai Shen , Seyedahmad Mousavi

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye

Estimating accurate 3D locations of objects from monocular images is a challenging problem because of lacking depth. Previous work shows that utilizing the object's keypoint projection constraints to estimate multiple depth candidates…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yingyan Li , Yuntao Chen , Jiawei He , Zhaoxiang Zhang

Large language models have steadily increased in size to achieve improved performance; however, this growth has also led to greater inference time and computational demands. Consequently, there is rising interest in model size reduction…

In this paper, we investigate optimization problems with nonnegative and orthogonal constraints, where any feasible matrix of size $n \times p$ exhibits a sparsity pattern such that each row accommodates at most one nonzero entry. Our…

Optimization and Control · Mathematics 2025-11-06 Lei Wang , Xin Liu , Xiaojun Chen

Recently, many practical algorithms have been proposed to recover the sparse signal from fewer measurements. Orthogonal matching pursuit (OMP) is one of the most effective algorithm. In this paper, we use the restricted isometry property to…

Functional Analysis · Mathematics 2011-06-01 Yi Shen , Song Li

Most dimensionality reduction methods employ frequency domain representations obtained from matrix diagonalization and may not be efficient for large datasets with relatively high intrinsic dimensions. To address this challenge, Correlated…

Machine Learning · Statistics 2022-06-10 Yuta Hozumi , Rui Wang , Guo-Wei Wei

High-dimensional time series forecasting suffers from severe overfitting when the number of predictors exceeds available observations, making standard local projection methods unstable and unreliable. We propose an enhanced Random Subspace…

Machine Learning · Computer Science 2026-03-10 Eman Khalid , Moimma Ali Khan , Zarmeena Ali , Abdullah Illyas , Muhammad Usman , Saoud Ahmed

As a typical dimensionality reduction technique, random projection can be simply implemented with linear projection, while maintaining the pairwise distances of high-dimensional data with high probability. Considering this technique is…

Machine Learning · Computer Science 2014-10-14 Weizhi Lu , Weiyu Li , Kidiyo Kpalma , Joseph Ronsin

This paper is concerned with the performance of Orthogonal Matching Pursuit (OMP) algorithms applied to a dictionary $\mathcal{D}$ in a Hilbert space $\mathcal{H}$. Given an element $f\in \mathcal{H}$, OMP generates a sequence of…

Numerical Analysis · Mathematics 2015-06-17 Albert Cohen , Wolfgang Dahmen , Ronald DeVore