English
Related papers

Related papers: WeCon: An Efficient Weight-Conditioned Neural Solv…

200 papers

In this letter, we present an alternative mixed-integer non-liner programming formulation of the reactive optimal power flow (ROPF) problem. We utilize a mixed-integer second-order cone programming (MISOCP) based approach to find global…

Optimization and Control · Mathematics 2021-03-12 Sezen Ece Kayacık , Burak Kocuk

While fusing heterogeneous open-source LLMs with varying architectures and sizes can potentially integrate the strengths of different models, existing fusion methods face significant challenges, such as vocabulary alignment and merging…

Computation and Language · Computer Science 2025-02-27 Ziyi Yang , Fanqi Wan , Longguang Zhong , Tianyuan Shi , Xiaojun Quan

PDE-Constrained Optimization (PDECO) problems can be accelerated significantly by employing gradient-based methods with surrogate models like neural operators compared to traditional numerical solvers. However, this approach faces two key…

Machine Learning · Computer Science 2025-06-17 Ze Cheng , Zhuoyu Li , Xiaoqiang Wang , Jianing Huang , Zhizhou Zhang , Zhongkai Hao , Hang Su

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the key issues of…

Machine Learning · Computer Science 2023-11-14 Dogacan Yilmaz , İ. Esra Büyüktahtakın

Multimodal large language models suffer from severe computational and memory bottlenecks, as the number of visual tokens far exceeds that of textual tokens. While recent methods employ projector modules to align and compress visual tokens…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhongyang Li , Yaqian Li , Faming Fang , Rinyoichi Takezoe , Zi-Hao Bo , Cheng Qian , Mo Guang , Guixu Zhang , Kaiwen Long

We introduce a multi-phase rocket landing guidance framework that can handle nonlinear dynamics and does not mandate any additional mixed-integer or nonconvex constraints to handle discrete temporal events/switching. To achieve this, we…

Optimization and Control · Mathematics 2023-05-30 Abhinav G. Kamath , Purnanand Elango , Yue Yu , Skye Mceowen , Govind M. Chari , John M. Carson , Behçet Açıkmeşe

Learning high-quality, robust, efficient, and disentangled representations is a central challenge in artificial intelligence (AI). Deep metric learning frameworks tackle this challenge primarily using architectural and optimization…

Machine Learning · Computer Science 2025-09-30 Shreyas Gokhale

Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in…

Machine Learning · Computer Science 2024-03-20 Heshan Fernando , Han Shen , Miao Liu , Subhajit Chaudhury , Keerthiram Murugesan , Tianyi Chen

Combinatorial optimization problems are ubiquitous in industry. In addition to finding a solution with minimum cost, problems of high relevance involve a number of constraints that the solution must satisfy. Variational quantum algorithms…

The compression of deep learning models is of fundamental importance in deploying such models to edge devices. The selection of compression parameters can be automated to meet changes in the hardware platform and application using…

Machine Learning · Computer Science 2022-01-21 Nesma M. Rezk , Tomas Nordström , Dimitrios Stathis , Zain Ul-Abdin , Eren Erdal Aksoy , Ahmed Hemani

Convolution-type integral equations arise from various fields, \textit{e.g.}, finite impulse response filters in signal processing and deblurring problems in image processing. When solving these equations, conventional numerical methods,…

Numerical Analysis · Mathematics 2026-05-11 Raymond Chan , Lingfeng Li

Neural Combinatorial Optimization (NCO) has emerged as a powerful framework for solving combinatorial optimization problems by integrating deep learning-based models. This work focuses on improving existing inference techniques to enhance…

This paper introduces the Random-Key Optimizer (RKO), a versatile and efficient stochastic local search method tailored for combinatorial optimization problems. Using the random-key concept, RKO encodes solutions as vectors of random keys…

Mixed-Integer Programs (MIPs) are NP-hard optimization models that arise in a broad range of decision-making applications, including finance, logistics, energy systems, and network design. Although modern commercial solvers have achieved…

We present a scalable and efficient neural waveform coding system for speech compression. We formulate the speech coding problem as an autoencoding task, where a convolutional neural network (CNN) performs encoding and decoding as a neural…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beak , Minje Kim

Existing visual token compression methods for Multimodal Large Language Models (MLLMs) predominantly operate as post-encoder modules, limiting their potential for efficiency gains. To address this limitation, we propose LaCo (Layer-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Juntao Liu , Liqiang Niu , Wenchao Chen , Jie Zhou , Fandong Meng

Combinatorial optimization assumes that all parameters of the optimization problem, e.g. the weights in the objective function is fixed. Often, these weights are mere estimates and increasingly machine learning techniques are used to for…

Machine Learning · Computer Science 2019-11-25 Jaynta Mandi , Emir Demirović , Peter. J Stuckey , Tias Guns

Combinatorial Optimization (CO) encompasses a wide range of problems that arise in many real-world scenarios. While significant progress has been made in developing learning-based methods for specialized CO problems, a unified model with a…

Machine Learning · Computer Science 2025-05-13 Zefang Zong , Xiaochen Wei , Guozhen Zhang , Chen Gao , Huandong Wang , Yong Li

Relevant combinatorial optimization problems (COPs) are often NP-hard. While they have been tackled mainly via handcrafted heuristics in the past, advances in neural networks have motivated the development of general methods to learn…

Machine Learning · Computer Science 2025-09-05 Tim Dernedde , Daniela Thyssens , Sören Dittrich , Maximilian Stubbemann , Lars Schmidt-Thieme

Learning under non-smooth objectives remains a fundamental challenge in machine learning, as abrupt changes in conditioning variables can induce highly non-smooth loss landscapes and destabilize optimization. This difficulty is particularly…

Optimization and Control · Mathematics 2026-03-16 Gyeongwan Gu , Jinwoo Hyun , Hyeontae Jo , Jae Kyoung Kim