English
Related papers

Related papers: Efficient Generative Transformer Operators For Mil…

200 papers

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

Creating high-quality sound effects from videos and text prompts requires precise alignment between visual and audio domains, both semantically and temporally, along with step-by-step guidance for professional audio generation. However,…

Sound · Computer Science 2025-03-31 Haomin Zhang , Sizhe Shan , Haoyu Wang , Zihao Chen , Xiulong Liu , Chaofan Ding , Xinhan Di

The neural operator (NO) framework has emerged as a powerful tool for solving partial differential equations (PDEs). Recent NOs are dominated by the Transformer architecture, which offers NOs the capability to capture long-range…

Machine Learning · Computer Science 2025-05-20 Xi Han , Jingwei Zhang , Dimitris Samaras , Fei Hou , Hong Qin

While Large Language Models and their underlying Transformer architecture are remarkably efficient, they do not reflect how our brain processes and learns a diversity of cognitive tasks such as language, nor how it leverages working memory.…

Machine Learning · Computer Science 2026-02-09 Yannis Bendi-Ouis , Xavier Hinaut

Partial differential equations (PDEs) are fundamental to modeling complex and nonlinear physical phenomena, but their numerical solution often requires significant computational resources, particularly when a large number of forward full…

Computational Physics · Physics 2025-07-08 Qibang Liu , Seid Koric

Recent advances in data-driven evolutionary algorithms (EAs) have demonstrated the potential of leveraging historical data to improve optimization accuracy and adaptability. Despite these advancements, existing methods remain reliant on…

Neural and Evolutionary Computing · Computer Science 2026-02-16 Tao Jiang , Kebin Sun , Zhenyu Liang , Ran Cheng , Yaochu Jin , Kay Chen Tan

Neural operators have emerged as an efficient paradigm for solving PDEs, overcoming the limitations of traditional numerical methods and significantly improving computational efficiency. However, due to the diversity and complexity of PDE…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dengdi Sun , Xiaoya Zhou , Xiao Wang , Hao Si , Wanli Lyu , Jin Tang , Bin Luo

Test-time reinforcement learning generates multiple candidate answers via repeated rollouts and performs online updates using pseudo-labels constructed by majority voting. To reduce overhead and improve exploration, prior work introduces…

Machine Learning · Computer Science 2026-05-28 Chu Zhao , Enneng Yang , Yuting Liu , Jianzhe Zhao , Guibing Guo

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

We present ECHO, an edge--cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Haozhe Jia , Jianfei Song , Yuan Zhang , Honglei Jin , Youcheng Fan , Wenshuo Chen , Wei Zhang , Yutao Yue

Trajectory generation has recently drawn growing interest in privacy-preserving urban mobility studies and location-based service applications. Although many studies have used deep learning or generative AI methods to model trajectories and…

Machine Learning · Computer Science 2026-03-25 Yuanbo Tang , Yan Tang , Zixuan Zhang , Zihui Zhao , Yang Li

This paper introduces a novel generative encoder (GE) model for generative imaging and image processing with applications in compressed sensing and imaging, image compression, denoising, inpainting, deblurring, and super-resolution. The GE…

Image and Video Processing · Electrical Eng. & Systems 2019-06-03 Lin Chen , Haizhao Yang

Numerical simulation of time-dependent partial differential equations (PDEs) is central to scientific and engineering applications, but high-fidelity solvers are often prohibitively expensive for long-horizon or time-critical settings.…

Machine Learning · Computer Science 2025-12-23 Rajyasri Roy , Dibyajyoti Nayak , Somdatta Goswami

Echo State Network (ESN) presents a distinguished kind of recurrent neural networks. It is built upon a sparse, random and large hidden infrastructure called reservoir. ESNs have succeeded in dealing with several non-linear problems such as…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

Learning solution operators of partial differential equations (PDEs) from data has emerged as a promising route to fast surrogate models in multi-query scientific workflows. However, for geometric PDEs whose inputs and outputs transform…

Artificial Intelligence · Computer Science 2026-03-17 Pengcheng Cheng

We introduce the Neural Preconditioning Operator (NPO), a novel approach designed to accelerate Krylov solvers in solving large, sparse linear systems derived from partial differential equations (PDEs). Unlike classical preconditioners that…

Computational Engineering, Finance, and Science · Computer Science 2025-02-10 Zhihao Li , Di Xiao , Zhilu Lai , Wei Wang

We develop a class of data-driven generative models that approximate the solution operator for parameter-dependent partial differential equations (PDE). We propose a novel probabilistic formulation of the operator learning problem based on…

Numerical Analysis · Mathematics 2026-04-21 Ting Wang , Petr Plechac , Jaroslaw Knap

The very challenging task of learning solution operators of PDEs on arbitrary domains accurately and efficiently is of vital importance to engineering and industrial simulations. Despite the existence of many operator learning algorithms to…

Machine Learning · Computer Science 2026-01-14 Shizheng Wen , Arsh Kumbhat , Levi Lingsch , Sepehr Mousavi , Yizhou Zhao , Praveen Chandrashekar , Siddhartha Mishra

Representation and generative learning, as reconstruction-based methods, have demonstrated their potential for mutual reinforcement across various domains. In the field of point cloud processing, although existing studies have adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Hongliang Zeng , Ping Zhang , Fang Li , Jiahua Wang , Tingyu Ye , Pengteng Guo

This dissertation attempts to drive innovation in the field of generative modeling for computer vision, by exploring novel formulations of conditional generative models, and innovative applications in images, 3D animations, and video. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Vikram Voleti