English
Related papers

Related papers: Provably Convergent Learned Inexact Descent Algori…

200 papers

Transfer learning through fine-tuning a pre-trained neural network with an extremely large dataset, such as ImageNet, can significantly accelerate training while the accuracy is frequently bottlenecked by the limited dataset size of the new…

Machine Learning · Computer Science 2020-05-14 Xingjian Li , Haoyi Xiong , Hanchao Wang , Yuxuan Rao , Liping Liu , Zeyu Chen , Jun Huan

Extreme Learning Machine (ELM) is an efficient and effective least-square-based learning algorithm for classification, regression problems based on single hidden layer feed-forward neural network (SLFN). It has been shown in the literature…

Machine Learning · Computer Science 2020-11-05 Ramesh Ragala , Bharadwaja kumar

The $L_1$-regularized models are widely used for sparse regression or classification tasks. In this paper, we propose the orthant-wise passive descent algorithm (OPDA) for optimizing $L_1$-regularized models, as an improved substitute of…

Machine Learning · Computer Science 2018-02-23 Jianqiao Wangni

We present a novel optimization-based decoding algorithm for LDPC codes that is suitable for hardware architectures specialized to feed-forward neural networks. The algorithm is based on the projected gradient descent algorithm with a…

Information Theory · Computer Science 2019-01-16 Tadashi Wadayama , Satoshi Takabe

In this work, we present a novel self-supervised method for Low Dose Computed Tomography (LDCT) reconstruction. Reducing the radiation dose to patients during a CT scan is a crucial challenge since the quality of the reconstruction highly…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Hang Xu , Alessandro Perelli

Currently, most deep learning methods cannot solve the problem of scarcity of industrial product defect samples and significant differences in characteristics. This paper proposes an unsupervised defect detection algorithm based on a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chao Hu , Jian Yao , Weijie Wu , Weibin Qiu , Liqiang Zhu

Drawing on theoretical insights, we advocate an error-based thresholding (EBT) mechanism for learned ISTA (LISTA), which utilizes a function of the layer-wise reconstruction error to suggest a specific threshold for each observation in the…

Machine Learning · Computer Science 2023-12-20 Ziang Li , Kailun Wu , Yiwen Guo , Changshui Zhang

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

The unrolling method has been investigated for learning variational models in X-ray computed tomography. However, it has been observed that directly unrolling the regularization model through gradient descent does not produce satisfactory…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Yijie Yang , Qifeng Gao , Yuping Duan

To reduce radiation exposure and improve the diagnostic efficacy of low-dose computed tomography (LDCT), numerous deep learning-based denoising methods have been developed to mitigate noise and artifacts. However, most of these approaches…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Runze Wang , Zeli Chen , Zhiyun Song , Wei Fang , Jiajin Zhang , Danyang Tu , Yuxing Tang , Minfeng Xu , Xianghua Ye , Le Lu , Dakai Jin

In the internet era there has been an explosion in the amount of digital text information available, leading to difficulties of scale for traditional inference algorithms for topic models. Recent advances in stochastic variational inference…

Machine Learning · Computer Science 2013-05-14 James Foulds , Levi Boyles , Christopher Dubois , Padhraic Smyth , Max Welling

There has been significant recent interest in the use of deep learning for regularizing imaging inverse problems. Most work in the area has focused on regularization imposed implicitly by convolutional neural networks (CNNs) pre-trained for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Zihao Zou , Jiaming Liu , Brendt Wohlberg , Ulugbek S. Kamilov

Background: Limited-angle (LA) dual-energy (DE) cone-beam CT (CBCT) is considered as a potential solution to achieve fast and low-dose DE imaging on current CBCT scanners without hardware modification. However, its clinical implementations…

We revisit Deep Linear Discriminant Analysis (Deep LDA) from a likelihood-based perspective. While classical LDA is a simple Gaussian model with linear decision boundaries, attaching an LDA head to a neural encoder raises the question of…

Machine Learning · Statistics 2026-02-23 Maxat Tezekbayev , Arman Bolatov , Zhenisbek Assylbekov

The Extreme Learning Machine (ELM) is a growing statistical technique widely applied to regression problems. In essence, ELMs are single-layer neural networks where the hidden layer weights are randomly sampled from a specific distribution,…

Machine Learning · Statistics 2025-07-31 Daniela De Canditiis , Fabiano Veglianti

We present Epidemic Learning (EL), a simple yet powerful decentralized learning (DL) algorithm that leverages changing communication topologies to achieve faster model convergence compared to conventional DL approaches. At each round of EL,…

Machine Learning · Computer Science 2023-10-30 Martijn de Vos , Sadegh Farhadkhani , Rachid Guerraoui , Anne-Marie Kermarrec , Rafael Pires , Rishi Sharma

As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the…

Machine Learning · Computer Science 2019-07-02 Feiping Nie , Hua Wang , Zheng Wang , Heng Huang

The performance of a deep neural network is highly dependent on its training, and finding better local optimal solutions is the goal of many optimization algorithms. However, existing optimization algorithms show a preference for descent…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Huangxing Lin , Weihong Zeng , Xinghao Ding , Yue Huang , Chenxi Huang , John Paisley

The emerging Learned Compression (LC) replaces the traditional codec modules with Deep Neural Networks (DNN), which are trained end-to-end for rate-distortion performance. This approach is considered as the future of image/video…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Farhad Pakdaman , Moncef Gabbouj

The recently proposed sparsifying transform models incur low computational cost and have been applied to medical imaging. Meanwhile, deep models with nested network structure reveal great potential for learning features in different layers.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Xikai Yang , Zhishen Huang , Yong Long , Saiprasad Ravishankar