中文
相关论文

相关论文: Efficient Generative Transformer Operators For Mil…

200 篇论文

The training of generative adversarial networks (GANs) is usually vulnerable to mode collapse and vanishing gradients. The evolutionary generative adversarial network (E-GAN) attempts to alleviate these issues by optimizing the learning…

神经与进化计算 · 计算机科学 2022-11-02 Junjie Li , Jingyao Li , Wenbo Zhou , Shuai Lü

This paper proposes a novel meta-learning approach to optimize a robust portfolio ensemble. The method uses a deep generative model to generate diverse and high-quality sub-portfolios combined to form the ensemble portfolio. The generative…

神经与进化计算 · 计算机科学 2023-07-18 Kamer Ali Yuksel

Machine learning solvers for partial differential equations (PDEs) have attracted growing interest. However, most existing approaches, such as neural network solvers, rely on stochastic training, which is inefficient and typically requires…

机器学习 · 计算机科学 2026-03-27 Qiwei Yuan , Zhitong Xu , Yinghao Chen , Yiming Xu , Houman Owhadi , Shandian Zhe

In this paper, we implement Neural Ordinary Differential Equations in a Variational Autoencoder setting for generative time series modeling. An object-oriented approach to the code was taken to allow for easier development and research and…

机器学习 · 计算机科学 2022-01-14 M. L. Garsdal , V. Søgaard , S. M. Sørensen

Diffusion models and flow matching have become a cornerstone of robotic imitation learning, yet they suffer from a structural inefficiency where inference is often bound to a fixed integration schedule that is agnostic to state complexity.…

机器人学 · 计算机科学 2026-04-28 Zunzhe Zhang , Runhan Huang , Yicheng Liu , Shaoting Zhu , Linzhan Mou , Hang Zhao

This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the…

数值分析 · 数学 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Hongsheng Liu , Zidong Wang , Bin Dong

Neural operators have emerged as powerful data-driven solvers for PDEs, offering substantial acceleration over classical numerical methods. However, existing transformer-based operators still face critical challenges when modeling PDEs on…

人工智能 · 计算机科学 2026-05-12 Chun-Wun Cheng , Sifan Wang , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

Neural operators are promising surrogates for dynamical systems but when trained with standard L2 losses they tend to oversmooth fine-scale turbulent structures. Here, we show that combining operator learning with generative modeling…

流体动力学 · 物理学 2025-09-11 Vivek Oommen , Siavash Khodakarami , Aniruddha Bora , Zhicheng Wang , George Em Karniadakis

Pre-training has been investigated to improve the efficiency and performance of training neural operators in data-scarce settings. However, it is largely in its infancy due to the inherent complexity and diversity, such as long…

机器学习 · 计算机科学 2024-05-08 Zhongkai Hao , Chang Su , Songming Liu , Julius Berner , Chengyang Ying , Hang Su , Anima Anandkumar , Jian Song , Jun Zhu

While the capabilities of generative models heavily improved in different domains (images, text, graphs, molecules, etc.), their evaluation metrics largely remain based on simplified quantities or manual inspection with limited…

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

机器学习 · 统计学 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Overparameterized stochastic differential equation (SDE) models have achieved remarkable success in various complex environments, such as PDE-constrained optimization, stochastic control and reinforcement learning, financial engineering,…

最优化与控制 · 数学 2024-09-27 Shengbo Wang , Jose Blanchet , Peter Glynn

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

机器学习 · 计算机科学 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

It is desirable to include more controllable attributes to enhance the diversity of generated responses in open-domain dialogue systems. However, existing methods can generate responses with only one controllable attribute or lack a…

计算与语言 · 计算机科学 2021-06-29 Haiqin Yang , Xiaoyuan Yao , Yiqun Duan , Jianping Shen , Jie Zhong , Kun Zhang

We present a novel unified framework that concurrently tackles recognition and future prediction for human hand pose and action modeling. Previous works generally provide isolated solutions for either recognition or prediction, which not…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yilin Wen , Hao Pan , Takehiko Ohkawa , Lei Yang , Jia Pan , Yoichi Sato , Taku Komura , Wenping Wang

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards…

机器学习 · 计算机科学 2023-03-21 Johannes Brandstetter , Daniel Worrall , Max Welling

Effective trajectory generation is essential for reliable on-board spacecraft autonomy. Among other approaches, learning-based warm-starting represents an appealing paradigm for solving the trajectory generation problem, effectively…

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

机器学习 · 计算机科学 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Deep generative models like GAN and VAE have shown impressive results in generating unconstrained objects like images. However, many design settings arising in industrial design, material science, computer graphics and more require that the…

机器学习 · 计算机科学 2024-06-07 Aaron Ferber , Arman Zharmagambetov , Taoan Huang , Bistra Dilkina , Yuandong Tian

This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of…

机器学习 · 计算机科学 2024-12-17 Katsiaryna Haitsiukevich , Onur Poyraz , Pekka Marttinen , Alexander Ilin