English
Related papers

Related papers: The Multi-Block DC Function Class: Theory, Algorit…

200 papers

In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized DC (Difference-of-Convex functions) programming, which is minimizing the sum of two separable DC parts and one…

Optimization and Control · Mathematics 2023-08-07 Hongjin He , Zhiyuan Zhang

Multitask clustering tries to improve the clustering performance of multiple tasks simultaneously by taking their relationship into account. Most existing multitask clustering algorithms fall into the type of generative clustering, and none…

Machine Learning · Computer Science 2013-10-22 Xiao-Lei Zhang

We propose a new algorithm for compiling Bayesian network classifier (BNC) into class formulas. Class formulas are logical formulas that represent a classifier's input-output behavior, and are crucial in the recent line of work that uses…

Artificial Intelligence · Computer Science 2026-03-17 Yaofang Zhang , Adnan Darwiche

The cyclic block coordinate descent-type (CBCD-type) methods, which performs iterative updates for a few coordinates (a block) simultaneously throughout the procedure, have shown remarkable computational performance for solving strongly…

Optimization and Control · Mathematics 2017-11-23 Xingguo Li , Tuo Zhao , Raman Arora , Han Liu , Mingyi Hong

In this paper we consider the difference-of-convex (DC) programming problems, whose objective function is the difference of two convex functions. The classical DC Algorithm (DCA) is well-known for solving this kind of problems, which…

Optimization and Control · Mathematics 2022-04-27 Yu You , Yi-Shuai Niu

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

Numerical Analysis · Mathematics 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier

In this paper, we study a class of nonconvex and nonsmooth structured difference-of-convex (DC) programs, which contain in the convex part the sum of a nonsmooth linearly composed convex function and a differentiable function, and in the…

Optimization and Control · Mathematics 2025-05-06 Radu Ioan Bot , Rossen Nenov , Min Tao

In this paper, we introduce an inexact approach to the Boosted Difference of Convex Functions Algorithm (BDCA) for solving nonconvex and nondifferentiable problems involving the difference of two convex functions (DC functions).…

Optimization and Control · Mathematics 2024-12-10 Orizon P. Ferreira , Boris S. Mordukhovich , Wilkreffy M. S. Santos , João Carlos O. Souza

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of…

Methodology · Statistics 2022-05-04 Paris V. Giampouras , Athanasios A. Rontogiannis , Eleftherios Kofidis

Deep clustering (DC), a fusion of deep representation learning and clustering, has recently demonstrated positive results in data science, particularly text processing and computer vision. However, joint optimization of feature learning and…

Databases · Computer Science 2024-05-29 Hafiz Tayyab Rauf , Andre Freitas , Norman W. Paton

This work is concerned with the optimization of nonconvex, nonsmooth composite optimization problems, whose objective is a composition of a nonlinear mapping and a nonsmooth nonconvex function, that can be written as an infimal convolution…

Optimization and Control · Mathematics 2018-03-28 Emanuel Laude , Daniel Cremers

Multiple clustering has gathered significant attention in recent years due to its potential to reveal multiple hidden structures of the data from different perspectives. Most of multiple clustering methods first derive feature…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Jiawei Yao , Juhua Hu

In this paper, we provide a unified iteration complexity analysis for a family of general block coordinate descent (BCD) methods, covering popular methods such as the block coordinate gradient descent (BCGD) and the block coordinate…

Optimization and Control · Mathematics 2015-04-29 Mingyi Hong , Xiangfeng Wang , Meisam Razaviyayn , Zhi-Quan Luo

We propose a universal building block of Convolutional Neural Network (ConvNet) to improve the performance without any inference-time costs. The block is named Diverse Branch Block (DBB), which enhances the representational capacity of a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiaohan Ding , Xiangyu Zhang , Jungong Han , Guiguang Ding

The stochastic gradient (SG) method can minimize an objective function composed of a large number of differentiable functions, or solve a stochastic optimization problem, to a moderate accuracy. The block coordinate descent/update (BCD)…

Optimization and Control · Mathematics 2015-11-23 Yangyang Xu , Wotao Yin

We study the problem of minimizing the sum of potentially non-differentiable convex cost functions with partially overlapping dependences in an asynchronous manner, where communication in the network is not coordinated. We study the…

Optimization and Control · Mathematics 2021-02-17 Yankai Lin , Iman Shames , Dragan Nesic

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

Optimization and Control · Mathematics 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

In the framework of model-based clustering, a model, called multi-partitions clustering, allowing several latent class variables has been proposed. This model assumes that the distribution of the observed data can be factorized into several…

Methodology · Statistics 2023-01-09 Marie du Roy de Chaumaray , Vincent Vandewalle

A Task Decomposition method for iterative learning Model Predictive Control (TDMPC) for linear time-varying systems is presented. We consider the availability of state-input trajectories which solve an original task T1, and design a…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Charlott Vallon , Francesco Borrelli

A mathematical programming problem with affine equilibrium constraints (AMPEC) is a bilevel programming problem where the lower one is a parametric affine variational inequality. We formulate some classes of bilevel programming in forms of…

Optimization and Control · Mathematics 2011-05-18 Le Dung Muu , Tran Dinh Quoc , Le Thi Hoai An , Pham Dinh Tao