English
Related papers

Related papers: Coordinate-Aware Modulation for Neural Fields

200 papers

We show that typical implicit regularization assumptions for deep neural networks (for regression) do not hold for coordinate-MLPs, a family of MLPs that are now ubiquitous in computer vision for representing high-frequency signals. Lack of…

Machine Learning · Computer Science 2022-02-03 Sameera Ramasinghe , Lachlan MacDonald , Simon Lucey

The Class Activation Map (CAM) lookup of a neural network tells us to which regions the neural network focuses when it makes a decision. In the past, the CAM search method was dependent upon a specific internal module of the network. It has…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yitao Peng , Longzhen Yang , Yihang Liu , Lianghua He

Semantic segmentation has recently achieved notable advances by exploiting "class-level" contextual information during learning. However, these approaches simply concatenate class-level information to pixel features to boost the pixel…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ye Huang , Di Kang , Liang Chen , Wenjing Jia , Xiangjian He , Lixin Duan , Xuefei Zhe , Linchao Bao

This paper presents a collaborative implicit neural simultaneous localization and mapping (SLAM) system with RGB-D image sequences, which consists of complete front-end and back-end modules including odometry, loop detection, sub-map…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Jiarui Hu , Mao Mao , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

This paper introduces CoFie, a novel local geometry-aware neural surface representation. CoFie is motivated by the theoretical analysis of local SDFs with quadratic approximation. We find that local shapes are highly compressive in an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Hanwen Jiang , Haitao Yang , Georgios Pavlakos , Qixing Huang

Implicit neural representations (INR) has found successful applications across diverse domains. To employ INR in real-life, it is important to speed up training. In the field of INR for video applications, the state-of-the-art approach…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Seungjun Shin , Suji Kim , Dokwan Oh

Parametric feature grid encodings have gained significant attention as an encoding approach for neural fields since they allow for much smaller MLPs, which significantly decreases the inference time of the models. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Mihir Mahajan , Florian Hofherr , Daniel Cremers

Recently, the explanation of neural network models has garnered considerable research attention. In computer vision, CAM (Class Activation Map)-based methods and LRP (Layer-wise Relevance Propagation) method are two common explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Changqing Qiu , Fusheng Jin , Yining Zhang

In this work, we investigate the structure and representation capacity of sinusoidal MLPs - multilayer perceptron networks that use sine as the activation function. These neural networks (known as neural fields) have become fundamental in…

Machine Learning · Computer Science 2023-09-12 Tiago Novello

We present a novel differentiable grid-based representation for efficiently solving differential equations (DEs). Widely used architectures for neural solvers, such as sinusoidal neural networks, are coordinate-based MLPs that are both…

Machine Learning · Computer Science 2026-01-16 Navami Kairanda , Shanthika Naik , Marc Habermann , Avinash Sharma , Christian Theobalt , Vladislav Golyanik

In deep learning, Multi-Layer Perceptrons (MLPs) have once again garnered attention from researchers. This paper introduces MC-MLP, a general MLP-like backbone for computer vision that is composed of a series of fully-connected (FC) layers.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zhimin Zhu , Jianguo Zhao , Tong Mu , Yuliang Yang , Mengyu Zhu

Neural fields, a category of neural networks trained to represent high-frequency signals, have gained significant attention in recent years due to their impressive performance in modeling complex 3D data, such as signed distance (SDFs) or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Marko Mihajlovic , Sergey Prokudin , Marc Pollefeys , Siyu Tang

Due to their weak inductive bias, Multi-Layer Perceptrons (MLPs) have subpar performance at low-compute levels compared to standard architectures such as convolution-based networks (CNN). Recent work, however, has shown that the performance…

Machine Learning · Computer Science 2024-10-15 Sean Wu , Jordan Hong , Keyu Bai , Gregor Bachmann

Continual Learning (CL) aims to enable models to sequentially learn multiple tasks without forgetting previous knowledge. Recent studies have shown that optimizing towards flatter loss minima can improve model generalization. However,…

Machine Learning · Computer Science 2026-01-13 Yanan Chen , Tieliang Gong , Yunjiao Zhang , Wen Wen

Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic parameters is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Meenakshi Subhash Chippa , Prakash Chandra Chhipa , Kanjar De , Marcus Liwicki , Rajkumar Saini

Recent advances in vision-language models have made zero-shot navigation feasible, enabling robots to follow natural language instructions without requiring labeling. However, existing methods that explicitly store language vectors in grid…

Robotics · Computer Science 2026-02-13 Sibaek Lee , Hyeonwoo Yu , Giseop Kim , Sunwook Choi

There are many challenges in the classification of hyper spectral images such as large dimensionality, scarcity of labeled data and spatial variability of spectral signatures. In this proposed method, we make a hybrid classifier (MLP-SVM)…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Ginni Garg , Dheeraj Kumar , ArvinderPal , Yash Sonker , Ritu Garg

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

As deep learning continues to advance, the transparency of neural network decision-making remains a critical challenge, limiting trust and applicability in high-stakes domains. Class Activation Mapping (CAM) techniques have emerged as a key…

Machine Learning · Computer Science 2025-04-24 Hongjie He , Xu Pan , Yudong Yao

Multi-view action recognition (MVAR) leverages complementary temporal information from different views to improve the learning performance. Obtaining informative view-specific representation plays an essential role in MVAR. Attention has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Yue Bai , Zhiqiang Tao , Lichen Wang , Sheng Li , Yu Yin , Yun Fu