English
Related papers

Related papers: UDC: A Unified Neural Divide-and-Conquer Framework…

200 papers

Deep neural network (DNN) training continues to scale rapidly in terms of model size, data volume, and sequence length, to the point where multiple machines are required to fit large models for training. Different distributed and parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Xinyu Lian , Sam Ade Jacobs , Lev Kurilenko , Masahiro Tanaka , Stas Bekman , Olatunji Ruwase , Minjia Zhang

In this paper, we consider a large network containing many regions such that each region is equipped with a worker with some data processing and communication capability. For such a network, some workers may become stragglers due to the…

Systems and Control · Electrical Eng. & Systems 2022-04-14 Elie Atallah , Nazanin Rahnavard , Qiyu Sun

Network-distributed optimization has attracted significant attention in recent years due to its ever-increasing applications. However, the classic decentralized gradient descent (DGD) algorithm is communication-inefficient for large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-09 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

Over the past decade, decision diagrams (DDs) have been used to model and solve integer programming and combinatorial optimization problems. Despite successful performance of DDs in solving various discrete optimization problems, their…

Optimization and Control · Mathematics 2024-03-27 Hosseinali Salemi , Danial Davarnia

The Security-Constrained Unit Commitment (SCUC) problem presents formidable computational challenges due to its combinatorial complexity, large-scale network dimensions, and numerous security constraints. While conventional temporal…

Optimization and Control · Mathematics 2025-07-29 Jinxin Xiong , Linxin Yang , Yingxiao Wang , Yanting Huang , Jianghua Wu , Shunbo Lei , Akang Wang

Real-world systems are often formulated as constrained optimization problems. Techniques to incorporate constraints into Neural Networks (NN), such as Neural Ordinary Differential Equations (Neural ODEs), have been used. However, these…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Combinatorial optimization (CO) aims to efficiently find the best solution to NP-hard problems ranging from statistical physics to social media marketing. A wide range of CO applications can benefit from local search methods because they…

Machine Learning · Computer Science 2023-04-14 Yuanhang Shao , Tonmoy Dey , Nikola Vuckovic , Luke Van Popering , Alan Kuhnle

Many optical circuit switched data center networks (DCN) have been proposed in the past to attain higher capacity and topology reconfigurability, though commercial adoption of these architectures have been minimal. One major challenge these…

Networking and Internet Architecture · Computer Science 2020-10-02 Min Yee Teh , Shizhen Zhao , Peirui Cao , Keren Bergman

Model compression plays a vital role in the practical deployment of deep neural networks (DNNs), and evolutionary multi-objective (EMO) pruning is an essential tool in balancing the compression rate and performance of the DNNs. However, due…

Machine Learning · Computer Science 2024-01-02 Ronghua Shang , Songling Zhu , Yinan Wu , Weitong Zhang , Licheng Jiao , Songhua Xu

In this paper, we consider networks with topologies described by some connected undirected graph ${\mathcal{G}}=(V, E)$ and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and…

Optimization and Control · Mathematics 2021-12-07 Nazar Emirov , Guohui Song , Qiyu Sun

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

Co-exploration of an optimal neural architecture and its hardware accelerator is an approach of rising interest which addresses the computational cost problem, especially in low-profile systems. The large co-exploration space is often…

Machine Learning · Computer Science 2023-01-24 Deokki Hong , Kanghyun Choi , Hye Yoon Lee , Joonsang Yu , Noseong Park , Youngsok Kim , Jinho Lee

Distributed trajectory optimization via ADMM-DDP is a powerful approach for coordinating multi-agent systems, but it requires extensive tuning of tightly coupled hyperparameters that jointly govern local task performance and global…

Machine Learning · Computer Science 2025-09-08 Bingheng Wang , Yichao Gao , Tianchen Sun , Lin Zhao

Neural solvers have demonstrated remarkable success in combinatorial optimization, often surpassing traditional heuristics in speed, solution quality, and generalization. However, their efficacy deteriorates significantly when confronted…

Neural and Evolutionary Computing · Computer Science 2025-11-14 Zhanhong Fang , Debing Wang , Jinbiao Chen , Jiahai Wang , Zizhen Zhang

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

Optimization and Control · Mathematics 2026-01-15 Leandro Farias Maia

In modern scientific research, massive datasets with huge numbers of observations are frequently encountered. To facilitate the computational process, a divide-and-conquer scheme is often used for the analysis of big data. In such a…

Machine Learning · Statistics 2015-05-06 Chen Xu , Yongquan Zhang , Runze Li

Symbolic regression aims to find a function that best explains the relationship between independent variables and the objective value based on a given set of sample data. Genetic programming (GP) is usually considered as an appropriate…

Neural and Evolutionary Computing · Computer Science 2022-09-26 Changtong Luo , Chen Chen , Zonglin Jiang

Recent neural combinatorial optimization (NCO) methods have shown promising problem-solving ability without requiring domain-specific expertise. Most existing NCO methods use training and testing data with a fixed constraint value and lack…

Machine Learning · Computer Science 2025-10-31 Fu Luo , Yaoxin Wu , Zhi Zheng , Zhenkun Wang

Traditional clustering methods often perform clustering with low-level indiscriminative representations and ignore relationships between patterns, resulting in slight achievements in the era of deep learning. To handle this problem, we…

Machine Learning · Computer Science 2019-05-07 Jianlong Chang , Yiwen Guo , Lingfeng Wang , Gaofeng Meng , Shiming Xiang , Chunhong Pan

Machine learning-based intrusion detection requires complex models to capture patterns in high-dimensional, noisy, and class-imbalanced raw network traffic, yet deploying such models remains impractical on resource-constrained devices with…