English
Related papers

Related papers: A Block Lanczos with Warm Start Technique for Acce…

200 papers

By reducing optimization to a sequence of smaller subproblems, working set algorithms achieve fast convergence times for many machine learning problems. Despite such performance, working set implementations often resort to heuristics to…

Machine Learning · Statistics 2018-07-24 Tyler B. Johnson , Carlos Guestrin

In this paper, we propose new randomization based algorithms for large scale linear discrete ill-posed problems with general-form regularization: ${\min} \|Lx\|$ subject to ${\min} \|Ax - b\|$, where $L$ is a regularization matrix. Our…

Numerical Analysis · Mathematics 2019-09-24 Zhongxiao Jia , Yanfei Yang

Short-and-sparse deconvolution (SaSD) aims to recover a short kernel and a long and sparse signal from their convolution. In the literature, formulations of blind deconvolution is either a convex programming via a matrix lifting of…

Signal Processing · Electrical Eng. & Systems 2021-11-23 Cheng Cheng , Wei Dai

A widely used method for solving SOS (Sum Of Squares) decomposition problem is to reduce it to the problem of semi-definite programs (SDPs) which can be efficiently solved in theory. In practice, although many SDP solvers can work out some…

Symbolic Computation · Computer Science 2018-01-31 Haokun Li , Bican Xia

In this paper, we propose a generic and simple strategy for utilizing stochastic gradient information in optimization. The technique essentially contains two consecutive steps in each iteration: 1) computing and normalizing each block…

Machine Learning · Computer Science 2018-04-24 Adams Wei Yu , Lei Huang , Qihang Lin , Ruslan Salakhutdinov , Jaime Carbonell

The sparse dictionary coding framework represents signals as a linear combination of a few predefined dictionary atoms. It has been employed for images, time series, graph signals and recently for 2-way (or 2D) spatio-temporal data…

Machine Learning · Computer Science 2024-06-12 Boya Ma , Maxwell McNeil , Abram Magner , Petko Bogdanov

This paper presents novel techniques for improving the error correction performance and reducing the complexity of coarsely quantized 5G-LDPC decoders. The proposed decoder design supports arbitrary message-passing schedules on a…

Information Theory · Computer Science 2025-08-19 Philipp Mohr , Gerhard Bauch

Under consideration are multicomponent minimization problems involving a separable nonsmooth convex function penalizing the components individually, and nonsmooth convex coupling terms penalizing linear mixtures of the components. We…

Optimization and Control · Mathematics 2021-08-27 Minh N. Bùi , Patrick L. Combettes , Zev C. Woodstock

Low Rank Decomposition (LRD) is a model compression technique applied to the weight tensors of deep learning models in order to reduce the number of trainable parameters and computational complexity. However, due to high number of new…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Yang Liu

Probabilistic topic models are popular unsupervised learning methods, including probabilistic latent semantic indexing (pLSI) and latent Dirichlet allocation (LDA). By now, their training is implemented on general purpose computers (GPCs),…

Machine Learning · Computer Science 2018-04-11 Zihao Xiao , Jianfei Chen , Jun Zhu

In this paper, a novel decoding algorithm for low-density parity-check (LDPC) codes based on convex optimization is presented. The decoding algorithm, called interior point decoding, is designed for linear vector channels. The linear vector…

Information Theory · Computer Science 2009-11-13 Tadashi Wadayama

The optimization of nuclear engineering designs, such as nuclear fuel assembly configurations, involves managing competing objectives like reactivity control and power distribution. This study explores the use of Optimization by Prompting,…

Numerical simulation is dominant in solving partial difference equations (PDEs), but balancing fine-grained grids with low computational costs is challenging. Recently, solving PDEs with neural networks (NNs) has gained interest, yet…

Computational Physics · Physics 2023-12-13 Wei Suo , Weiwei Zhang

A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink…

Information Theory · Computer Science 2016-10-10 Matthew W. Morency , Sergiy A. Vorobyov

Block Krylov subspace methods (KSMs) comprise building blocks in many state-of-the-art solvers for large-scale matrix equations as they arise, e.g., from the discretization of partial differential equations. While extended and rational…

Numerical Analysis · Mathematics 2020-02-06 Daniel Kressner , Kathryn Lund , Stefano Massei , Davide Palitta

This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex…

Machine Learning · Statistics 2014-12-22 Yang Cao , Yao Xie

This paper is devoted to the numerical solution of the non-isothermal instationary Bingham flow with temperature dependent parameters by semismooth Newton methods. We discuss the main theoretical aspects regarding this problem. Mainly, we…

Numerical Analysis · Mathematics 2022-05-24 Sergio González-Andrade

The ground state energy of a many-electron system can be approximated by an variational approach in which the total energy of the system is minimized with respect to one and two-body reduced density matrices (RDM) instead of many-electron…

Optimization and Control · Mathematics 2017-09-01 Yongfeng Li , Zaiwen Wen , Chao Yang , Yaxiang Yuan

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

Statistics Theory · Mathematics 2024-11-27 Zhengchi Ma , Rong Ma

A tensor nuclear norm (TNN) based method for solving the tensor recovery problem was recently proposed, and it has achieved state-of-the-art performance. However, it may fail to produce a highly accurate solution since it tends to treats…

Optimization and Control · Mathematics 2022-05-13 Quan Yu