English
Related papers

Related papers: NOVA: Discovering Well-Conditioned Winograd Transf…

200 papers

The joint detection and classification of RF signals has been a critical problem in the field of wideband RF spectrum sensing. Recent advancements in deep learning models have revolutionized this field, remarkably through the application of…

Signal Processing · Electrical Eng. & Systems 2024-08-14 Xiwen Kang , Hua-mei Chen , Genshe Chen , Kuo-Chu Chang , Thomas M. Clemons

High-performance computing enables simulation of high-dimensional physical systems, but downstream analyses such as inverse problems and control remain computationally expensive, motivating model order reduction (MOR) to construct efficient…

Fluid Dynamics · Physics 2026-05-28 Tomoki Koike , Prakash Mohan , Marc T. Henry de Frahan , Elizabeth Qian , Julie Bessac

We present an algorithm based on numerical techniques that have become standard for solving nonlinear integral equations: Newton's method, homotopy continuation, the multilevel method and random projection to solve the inversion problem…

Computational Physics · Physics 2021-05-26 Michael Jasiulek

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

Machine Learning · Computer Science 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang

Matrix-based optimizers have demonstrated immense potential in training Large Language Models (LLMs), however, designing an ideal optimizer remains a formidable challenge. A superior optimizer must satisfy three core desiderata: efficiency,…

Machine Learning · Computer Science 2026-05-06 Jinghui Yuan , Jiaxuan Zou , Shuo Wang , Yong Liu , Feiping Nie

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov…

Machine Learning · Computer Science 2025-11-11 Di Zhang

This paper studies first order methods for solving smooth minimax optimization problems $\min_x \max_y g(x,y)$ where $g(\cdot,\cdot)$ is smooth and $g(x,\cdot)$ is concave for each $x$. In terms of $g(\cdot,y)$, we consider two settings --…

Optimization and Control · Mathematics 2019-07-03 Kiran Koshy Thekumparampil , Prateek Jain , Praneeth Netrapalli , Sewoong Oh

We present a carefully designed, systematic study of the angular resolution dependence of simulations with the Prometheus-Vertex neutrino-hydrodynamics code. Employing a simplified neutrino heating-cooling scheme in the Prometheus…

High Energy Astrophysical Phenomena · Physics 2020-03-11 Tobias Melson , Daniel Kresse , H. -Thomas Janka

Many fundamental problems in machine learning can be formulated by the convex program \[ \min_{\theta\in R^d}\ \sum_{i=1}^{n}f_{i}(\theta), \] where each $f_i$ is a convex, Lipschitz function supported on a subset of $d_i$ coordinates of…

Optimization and Control · Mathematics 2022-08-09 Sally Dong , Haotian Jiang , Yin Tat Lee , Swati Padmanabhan , Guanghao Ye

Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to training samples or VAE latents as data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Qinyu Zhao , Guangting Zheng , Tao Yang , Rui Zhu , Xingjian Leng , Stephen Gould , Liang Zheng

Text recognition in natural images remains a challenging yet essential task, with broad applications spanning computer vision and natural language processing. This paper introduces a novel end-to-end framework that combines ResNet and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Naphat Nithisopa , Teerapong Panboonyuen

Computational Fluid Dynamics (CFD) is crucial for automotive design, requiring the analysis of large 3D point clouds to study how vehicle geometry affects pressure fields and drag forces. However, existing deep learning approaches for CFD…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chris Choy , Alexey Kamenev , Jean Kossaifi , Max Rietmann , Jan Kautz , Kamyar Azizzadenesheli

Rotation invariance is essential for precise, object-level segmentation in UAV aerial imagery, where targets can have arbitrary orientations and exhibit fine-scale details. Conventional segmentation architectures like U-Net rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Manduhu Manduhu , Alexander Dow , Gerard Dooly , James Riordan

We focus on analyzing the classical stochastic projected gradient methods under a general dependent data sampling scheme for constrained smooth nonconvex optimization. We show the worst-case rate of convergence $\tilde{O}(t^{-1/4})$ and…

Optimization and Control · Mathematics 2023-06-26 Ahmet Alacaoglu , Hanbaek Lyu

Hybrid pipelines that combine deep learning with classical optimization have established themselves as the dominant approach to visual odometry (VO). By integrating neural network predictions with bundle adjustment, these models estimate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Vlardimir Yugay , Duy-Kien Nguyen , Theo Gevers , Cees G. M. Snoek , Martin R. Oswald

Neural Operators (NOs) are a powerful deep learning framework designed to learn the solution operator that arise from partial differential equations. This study investigates NOs ability to capture the stiff spatio-temporal dynamics of the…

Machine Learning · Computer Science 2026-03-19 Luca Pellegrini

Convolutional neural networks (CNNs) are currently among the most widely-used deep neural network (DNN) architectures available and achieve state-of-the-art performance for many problems. Originally applied to computer vision tasks, CNNs…

Machine Learning · Computer Science 2024-02-29 Inés Gonzalez Pepe , Yohan Chatelain , Gregory Kiar , Tristan Glatard

Convolution is a broadly useful operation with applications including signal processing, machine learning, probability, optics, polynomial multiplication, and efficient parsing. Usually, however, this operation is understood and implemented…

Programming Languages · Computer Science 2019-03-27 Conal Elliott

We propose the Inverse Neural Operator (INO), a two-stage framework for recovering hidden ODE parameters from sparse, partial observations. In Stage 1, a Conditional Fourier Neural Operator (C-FNO) with cross-attention learns a…

Machine Learning · Computer Science 2026-03-13 Zhi-Song Liu , Wenqing Peng , Helmi Toropainen , Ammar Kheder , Andreas Rupp , Holger Froning , Xiaojie Lin , Michael Boy

Robust estimation is essential in computer vision, robotics, and navigation, aiming to minimize the impact of outlier measurements for improved accuracy. We present a fast algorithm for Geman-McClure robust estimation, FracGM, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Bang-Shien Chen , Yu-Kai Lin , Jian-Yu Chen , Chih-Wei Huang , Jann-Long Chern , Ching-Cherng Sun