English
Related papers

Related papers: Transformer-based Stagewise Decomposition for Larg…

200 papers

Decentralized bilevel optimization has garnered significant attention due to its critical role in solving large-scale machine learning problems. However, existing methods often rely on prior knowledge of problem parameters-such as…

Optimization and Control · Mathematics 2025-10-29 Zhiwei Zhai , Wenjing Yan , Ying-Jun Angela Zhang

The necessary decarbonization efforts in energy sectors entail the integration of flexibility assets, as well as increased levels of uncertainty for the planning and operation of power systems. To cope with this in a cost-effective manner,…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Stefan Borozan , Spyros Giannelos , Paola Falugi , Alexandre Moreira , Goran Strbac

Dynamic mode decomposition (DMD) is a widely used data-driven algorithm for predicting the future states of dynamical systems. However, its standard formulation often struggles with poor long-term predictive accuracy. To address this…

Numerical Analysis · Mathematics 2026-04-21 Qiuqi Li , Chang Liu , Yifei Yang

The widespread use of multisensor technology and the emergence of big datasets have created the need to develop tools to reduce, approximate, and classify large and multimodal data such as higher-order tensors. While early approaches…

Numerical Analysis · Computer Science 2018-07-03 Alp Ozdemir , Ali Zare , Mark A. Iwen , Selin Aviyente

Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck. Multi-Draft Speculative Decoding (MDSD) is a recent approach where,…

Computation and Language · Computer Science 2025-02-27 Zhengmian Hu , Tong Zheng , Vignesh Viswanathan , Ziyi Chen , Ryan A. Rossi , Yihan Wu , Dinesh Manocha , Heng Huang

Benders decomposition is a widely used method for solving large optimization problems, but its performance is often hindered by the repeated solution of subproblems. We propose a flexible and modular algorithmic framework for accelerating…

Optimization and Control · Mathematics 2025-08-05 Parth Brahmbhatt , David L. Cole , Victor M. Zavala , Styliani Avraamidou

We propose a new multistep deep learning-based algorithm for the resolution of moderate to high dimensional nonlinear backward stochastic differential equations (BSDEs) and their corresponding parabolic partial differential equations (PDE).…

Numerical Analysis · Mathematics 2023-08-29 Daniel Bussell , Camilo Andrés García-Trillos

Approximate linear programming (ALP) is an efficient approach to solving large factored Markov decision processes (MDPs). The main idea of the method is to approximate the optimal value function by a set of basis functions and optimize…

Artificial Intelligence · Computer Science 2012-06-18 Branislav Kveton , Milos Hauskrecht

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

Machine Learning · Computer Science 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

Dynamic mode decomposition (DMD) is a widely used data-driven algorithm for predicting the future states of dynamical systems. However, its standard formulation often struggles with poor long-term predictive accuracy. To address this…

Numerical Analysis · Mathematics 2025-10-23 Qiuqi Li , Chang Liu , Yifei Yang

In semidefinite programming (SDP), a number of pre-processing techniques have been developed including chordal-completion procedures, which reduce the dimension of individual constraints by exploiting sparsity therein, and facial reduction,…

Optimization and Control · Mathematics 2020-09-22 Vyacheslav Kungurtsev , Jakub Marecek

This paper investigates the problems large-scale distributed composite convex optimization, with motivations from a broad range of applications, including multi-agent systems, federated learning, smart grids, wireless sensor networks,…

Optimization and Control · Mathematics 2025-12-16 Maoran Wang , Xingju Cai , Yongxin Chen

A sequential piecewise linear programming method is presented where bounded domains of non-convex functions are successively contracted about the solution of a piecewise linear program at each iteration of the algorithm. Although…

Optimization and Control · Mathematics 2020-04-21 James P. L. Tan

We present a data-driven method for separating complex, multiscale systems into their constituent time-scale components using a recursive implementation of dynamic mode decomposition (DMD). Local linear models are built from windowed…

Systems and Control · Computer Science 2019-06-26 Daniel Dylewsky , Molei Tao , J. Nathan Kutz

The hardware-friendly implementation of transcendental functions remains a longstanding challenge in design automation. These functions, which cannot be expressed as finite combinations of algebraic operations, pose significant complexity…

Emerging Technologies · Computer Science 2026-01-13 Mehran Moghadam , Sercan Aygun , M. Hassan Najafi

System Level Synthesis (SLS) allows us to construct internally stabilizing controllers for large-scale systems. However, solving large-scale SLS problems is computationally expensive and the state-of-the-art methods consider only state…

Optimization and Control · Mathematics 2022-06-07 Lauren Conger , Shih-Hao Tseng

In recent years, finding an effective and efficient strategy for exploiting spatial and temporal information has been a hot research topic in video saliency prediction (VSP). With the emergence of spatio-temporal transformers, the weakness…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Morteza Moradi , Simone Palazzo , Concetto Spampinato

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

This work proposes a compositional data-driven technique for the construction of finite Markov decision processes (MDPs) for large-scale stochastic networks with unknown mathematical models. Our proposed framework leverages dissipativity…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Abolfazl Lavaei