English
Related papers

Related papers: Escaping Spectral Bias without Backpropagation: Fa…

200 papers

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

End-to-end training with full-depth backpropagation remains the dominant paradigm for optimizing deep neural networks, but its efficiency deteriorates as models grow deeper. Since every block must be executed and differentiated under a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuming Zhang , Peizhe Wang , Tianyang Han , Hengyu Shi , Junhao Su , Dongzhi Guan , Jiabin Liu , Jiaji Wang

We present a fast and accurate analytical method for fluorescence lifetime imaging microscopy (FLIM) using the extreme learning machine (ELM). We used extensive metrics to evaluate ELM and existing algorithms. First, we compared these…

Biological Physics · Physics 2022-03-28 Zhenya Zang , Dong Xiao , Quan Wang , Zinuo Li , Wujun Xie , Yu Chen , David Day Uei Li

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Implicit Neural Representation (INR), which utilizes a neural network to map coordinate inputs to corresponding attributes, is causing a revolution in the field of signal processing. However, current INR techniques suffer from a restricted…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zhen Liu , Hao Zhu , Qi Zhang , Jingde Fu , Weibing Deng , Zhan Ma , Yanwen Guo , Xun Cao

Implicit Neural Representations (INRs) are proving to be a powerful paradigm in unifying task modeling across diverse data domains, offering key advantages such as memory efficiency and resolution independence. Conventional deep learning…

Machine Learning · Computer Science 2025-03-20 Amirhossein Kazerouni , Soroush Mehraban , Michael Brudno , Babak Taati

Recent advancements in Simultaneous Localization and Mapping (SLAM) have increasingly highlighted the robustness of LiDAR-based techniques. At the same time, Neural Radiance Fields (NeRF) have introduced new possibilities for 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Qi Zhang , He Wang , Ru Li , Wenbin Li

Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy consumption. These advantages make them particularly well…

Machine Learning · Computer Science 2026-02-18 Luca Colombo , Fabrizio Pittorino , Daniele Zambon , Carlo Baldassi , Manuel Roveri , Cesare Alippi

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

Masked Image Modeling (MIM) is a powerful self-supervised strategy for visual pre-training without the use of labels. MIM applies random crops to input images, processes them with an encoder, and then recovers the masked inputs with a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Maryam Haghighat , Peyman Moghadam , Shaheer Mohamed , Piotr Koniusz

Self-supervised learning for computer vision has achieved tremendous progress and improved many downstream vision tasks such as image classification, semantic segmentation, and object detection. Among these, generative self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jun Chen , Ming Hu , Boyang Li , Mohamed Elhoseiny

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong

Objective: To develop, and demonstrate the feasibility of, a novel image reconstruction method for absolute Electrical Impedance Tomography (a-EIT) that pairs deep learning techniques with real-time robust D-bar methods. Approach: A D-bar…

Numerical Analysis · Mathematics 2018-12-03 S. J. Hamilton , A. Hänninen , A. Hauptmann , V. Kolehmainen

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

Machine Learning · Computer Science 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Incremental learning of semantic segmentation has emerged as a promising strategy for visual scene interpretation in the open- world setting. However, it remains challenging to acquire novel classes in an online fashion for the segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Shipeng Yan , Jiale Zhou , Jiangwei Xie , Songyang Zhang , Xuming He

Element segmentation is a key step in nondestructive testing of Printed Circuit Boards (PCB) based on Computed Tomography (CT) technology. In recent years, the rapid development of self-supervised pretraining technology can obtain general…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Chen Chen , Kai Qiao , Jie Yang , Jian Chen , Bin Yan

Implicit neural representations (INRs) can parameterize continuous beamforming functions in continuous aperture arrays (CAPAs) and thus enable efficient online inference. Existing INR-based beamforming methods for CAPAs, however, typically…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Shiyong Chen , Jia Guo , Shengqian Han

We propose an efficient inference procedure for non-autoregressive machine translation that iteratively refines translation purely in the continuous space. Given a continuous latent variable model for machine translation (Shu et al., 2020),…

Computation and Language · Computer Science 2020-09-16 Jason Lee , Raphael Shu , Kyunghyun Cho

Recently, Implicit Neural Representations (INRs) parameterized by neural networks have emerged as a powerful and promising tool to represent different kinds of signals due to its continuous, differentiable properties, showing superiorities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Wentao Yuan , Qingtian Zhu , Xiangyue Liu , Yikang Ding , Haotian Zhang , Chi Zhang