中文
相关论文

相关论文: Optimal training of integer-valued neural networks…

200 篇论文

This paper addresses a mixed integer programming (MIP) formulation for the multi-item uncapacitated lot-sizing problem that is inspired from the trailer manufacturer. The proposed MIP model has been utilized to find out the optimum order…

最优化与控制 · 数学 2012-06-01 Maryam Mohammadi , Masine Md. Tap

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving partial differential equations~(PDEs) in various scientific and engineering domains. However, traditional PINN architectures typically rely on large, fully…

计算工程、金融与科学 · 计算机科学 2024-04-22 Stefano Markidis

Bilevel programs (BPs) find a wide range of applications in fields such as energy, transportation, and machine learning. As compared to BPs with continuous (linear/convex) optimization problems in both levels, the BPs with discrete decision…

最优化与控制 · 数学 2024-07-25 Bo Zhou , Ruiwei Jiang , Siqian Shen

Integer programming (IP) has proven to be highly effective in solving many path-based optimization problems in robotics. However, the applications of IP are generally done in an ad-hoc, problem specific manner. In this work, after examined…

机器人学 · 计算机科学 2019-03-04 Shuai D. Han , Jingjin Yu

One of the primary areas of interest in High Performance Computing is the improvement of performance of parallel workloads. Nowadays, compilable source code-based optimization tasks that employ deep learning often exploit LLVM Intermediate…

分布式、并行与集群计算 · 计算机科学 2024-07-03 Akash Dutta , Ali Jannesari

The ability to train ever-larger neural networks brings artificial intelligence to the forefront of scientific and technical discoveries. However, their exponentially increasing size creates a proportionally greater demand for energy and…

Finding optimal join orders is among the most crucial steps to be performed by query optimisers. Though extensively studied in data management research, the problem remains far from solved: While query optimisers rely on exhaustive search…

数据库 · 计算机科学 2025-10-24 Manuel Schönberger , Immanuel Trummer , Wolfgang Mauerer

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

机器学习 · 计算机科学 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

Mixed-integer linear programming (MILP), a widely used modeling framework for combinatorial optimization, are central to many scientific and engineering applications, yet remains computationally challenging at scale. Recent advances in deep…

人工智能 · 计算机科学 2026-01-09 Peixin Huang , Yaoxin Wu , Yining Ma , Cathy Wu , Wen Song , Wei Zhang

Machine Learning models are increasingly used for decision making, in particular in high-stakes applications such as credit scoring, medicine or recidivism prediction. However, there are growing concerns about these models with respect to…

机器学习 · 计算机科学 2023-04-12 Julien Rouzot , Julien Ferry , Marie-José Huguet

Deep learning training involves a large number of operations, which are dominated by high dimensionality Matrix-Vector Multiplies (MVMs). This has motivated hardware accelerators to enhance compute efficiency, but where data movement and…

系统与控制 · 电气工程与系统科学 2022-07-07 Christopher Grimm , Naveen Verma

This paper presents a model predictive control (MPC) for dynamic systems whose nonlinearity and uncertainty are modelled by deep neural networks (NNs), under input and state constraints. Since the NN output contains a high-order complex…

系统与控制 · 电气工程与系统科学 2024-05-20 Jianglin Lan

Solving mixed-integer optimization problems with embedded neural networks with ReLU activation functions is challenging. Big-M coefficients that arise in relaxing binary decisions related to these functions grow exponentially with the…

最优化与控制 · 数学 2025-02-06 Christoph Plate , Mirko Hahn , Alexander Klimek , Caroline Ganzer , Kai Sundmacher , Sebastian Sager

Integer programming (IP) is a general optimization framework widely applicable to a variety of unstructured and structured problems arising in, e.g., scheduling, production planning, and graph optimization. As IP models many provably hard…

机器学习 · 计算机科学 2020-07-22 Yunhao Tang , Shipra Agrawal , Yuri Faenza

The use of Mixed-Integer Linear Programming (MILP) models to represent neural networks with Rectified Linear Unit (ReLU) activations has become increasingly widespread in the last decade. This has enabled the use of MILP technology to…

最优化与控制 · 数学 2024-02-01 Fabian Badilla , Marcos Goycoolea , Gonzalo Muñoz , Thiago Serra

By exploiting the correlation between the structure and the solution of Mixed-Integer Linear Programming (MILP), Machine Learning (ML) has become a promising method for solving large-scale MILP problems. Existing ML-based MILP solvers…

机器学习 · 计算机科学 2025-01-03 Yixuan Li , Can Chen , Jiajun Li , Jiahui Duan , Xiongwei Han , Tao Zhong , Vincent Chau , Weiwei Wu , Wanyuan Wang

Physics-informed neural networks (PINNs) are a newly emerging research frontier in machine learning, which incorporate certain physical laws that govern a given data set, e.g., those described by partial differential equations (PDEs), into…

神经与进化计算 · 计算机科学 2023-07-11 Bo Wang , A. K. Qin , Sajjad Shafiei , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

To explore the vulnerability of deep neural networks (DNNs), many attack paradigms have been well studied, such as the poisoning-based backdoor attack in the training stage and the adversarial attack in the inference stage. In this paper,…

机器学习 · 计算机科学 2021-02-23 Jiawang Bai , Baoyuan Wu , Yong Zhang , Yiming Li , Zhifeng Li , Shu-Tao Xia

The selection of branching variables is a key component of branch-and-bound algorithms for solving Mixed-Integer Programming (MIP) problems since the quality of the selection procedure is likely to have a significant effect on the size of…

最优化与控制 · 数学 2016-08-23 Pierre Le Bodic , George L. Nemhauser

Binary neural networks, i.e., neural networks whose parameters and activations are constrained to only two possible values, offer a compelling avenue for the deployment of deep learning models on energy- and memory-limited devices. However,…