中文
相关论文

相关论文: Flexible and Efficient Surrogate Gradient Modeling…

200 篇论文

Supervised learning in deep neural networks is commonly performed using error backpropagation. However, the sequential propagation of errors during the backward pass limits its scalability and applicability to low-powered neuromorphic…

机器学习 · 计算机科学 2023-08-22 Florian Bacho , Dominique Chu

We introduce Perturbative Gradient Training (PGT), a novel training paradigm that overcomes a critical limitation of physical reservoir computing: the inability to perform backpropagation due to the black-box nature of physical reservoirs.…

机器学习 · 计算机科学 2025-06-06 Cliff B. Abbott , Mark Elo , Dmytro A. Bozhko

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike events. While these…

神经与进化计算 · 计算机科学 2019-06-04 Johannes Christian Thiele , Olivier Bichler , Antoine Dupret

Magnetic Resonance Fingerprinting (MRF) enables fast quantitative imaging, yet reconstructing high-resolution 3D data remains computationally demanding. Non-Cartesian reconstructions require repeated non-uniform FFTs, and the commonly used…

图像与视频处理 · 电气工程与系统科学 2026-02-13 Yonatan Urman , Mark Nishimura , Daniel Abraham , Xiaozhi Cao , Kawin Setsompop

One significant advantage of superconducting processors is their extensive design flexibility, which encompasses various types of qubits and interactions. Given the large number of tunable parameters of a processor, the ability to perform…

量子物理 · 物理学 2025-04-25 Ziang Wang , Feng Wu , Hui-Hai Zhao , Xin Wan , Xiaotong Ni

Reinforcement learning is essential for neural architecture search and hyperparameter optimization, but the conventional approaches impede widespread use due to prohibitive time and computational costs. Inspired by DeepSeek-V3 multi-token…

机器学习 · 计算机科学 2025-06-19 Zheng Li , Jerry Cheng , Huanying Helen Gu

Computational Fluid Dynamics (CFD) is used in the design and optimization of gas turbines and many other industrial/ scientific applications. However, the practical use is often limited by the high computational cost, and the accurate…

流体动力学 · 物理学 2023-11-29 Jan Hückelheim , Tadbhagya Kumar , Krishnan Raghavan , Pinaki Pal

The increased penetration of wind power introduces more operational changes of critical corridors and the traditional time-consuming transient stability constrained total transfer capability (TTC) operational planning is unable to meet the…

系统与控制 · 电气工程与系统科学 2020-06-30 Gao Qiu , Youbo Liu , Junyong Liu , Junbo Zhao , Lingfeng Wang , Tingjian Liu , Hongjun Gao

Graph representation learning aims at transforming graph data into meaningful low-dimensional vectors to facilitate the employment of machine learning and data mining algorithms designed for general data. Most current graph representation…

社会与信息网络 · 计算机科学 2018-09-24 Fei Jiang , Lei Zheng , Jin Xu , Philip S. Yu

Computational Fluid Dynamics (CFD) is central to race-car aerodynamic development, yet its cost -- tens of thousands of core-hours per high-fidelity evaluation -- severely limits the design space exploration feasible within realistic…

AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. These models leverage data-driven methods to predict physical quantities traditionally…

机器学习 · 计算机科学 2025-05-06 Yu-hsuan Chen , Jing Bi , Cyril Ngo Ngoc , Victor Oancea , Jonathan Cagan , Levent Burak Kara

Spiking neural networks (SNNs) have shown their competence in handling spatial-temporal event-based data with low energy consumption. Similar to conventional artificial neural networks (ANNs), SNNs are also vulnerable to gradient-based…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Li Lun , Kunyu Feng , Qinglong Ni , Ling Liang , Yuan Wang , Ying Li , Dunshan Yu , Xiaoxin Cui

Graph neural networks (GNNs) have achieved remarkable success across a wide range of applications, such as recommendation, drug discovery, and question answering. Behind the success of GNNs lies the backpropagation (BP) algorithm, which is…

机器学习 · 计算机科学 2024-04-16 Namyong Park , Xing Wang , Antoine Simoulin , Shuai Yang , Grey Yang , Ryan Rossi , Puja Trivedi , Nesreen Ahmed

This paper introduces a new architectural framework, known as input fast-forwarding, that can enhance the performance of deep networks. The main idea is to incorporate a parallel path that sends representations of input values forward to…

计算机视觉与模式识别 · 计算机科学 2017-05-25 Ahmed Ibrahim , A. Lynn Abbott , Mohamed E. Hussein

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

信号处理 · 电气工程与系统科学 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

Multi-label audio tagging consists of assigning sets of tags to audio recordings. At inference time, thresholds are applied on the confidence scores outputted by a probabilistic classifier, in order to decide which classes are detected…

人工智能 · 计算机科学 2021-03-02 Thomas Pellegrini , Timothée Masquelier

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Michael Fischer , Tobias Ritschel

Recent advances in 3D Gaussian Splatting (3DGS) present two main directions: feed-forward models offer fast inference in sparse-view settings, while per-scene optimization yields high-quality renderings but is computationally expensive. To…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Yueh-Cheng Liu , Jozef Hladký , Matthias Nießner , Angela Dai

Optimization and uncertainty quantification have been playing an increasingly important role in computational hemodynamics. However, existing methods based on principled modeling and classic numerical techniques have faced significant…

医学物理 · 物理学 2022-09-07 Pan Du , Xiaozhi Zhu , Jian-Xun Wang

Deep learning-based surrogate models offer a computationally efficient alternative to high-fidelity computational fluid dynamics (CFD) simulations for predicting urban wind flow. However, conventional approaches usually only yield…

大气与海洋物理 · 物理学 2025-11-03 Reda Snaiki , Jiachen Lu , Shaopeng Li , Negin Nazarian