English
Related papers

Related papers: Beyond Grid-Locked Voxels: Neural Response Functio…

200 papers

Graph Neural Networks (GNN) can capture the geometric properties of neural representations in EEG data. Here we utilise those to study how reinforcement-based motor learning affects neural activity patterns during motor planning, leveraging…

Machine Learning · Computer Science 2024-11-01 Federico Nardi , Jinpei Han , Shlomi Haar , A. Aldo Faisal

This article presents a novel undersampled magnetic resonance imaging (MRI) technique that leverages the concept of Neural Radiance Field (NeRF). With radial undersampling, the corresponding imaging problem can be reformulated into an image…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Tae Jun Jang , Chang Min Hyun

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

Neural shape representation generally refers to representing 3D geometry using neural networks, e.g., computing a signed distance or occupancy value at a specific spatial position. In this paper we present a neural-network architecture…

Machine Learning · Computer Science 2024-08-22 Stefan Rhys Jeske , Jonathan Klein , Dominik L. Michels , Jan Bender

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Neural Radiance Fields (NeRFs) have emerged as a standard framework for representing 3D scenes and objects, introducing a novel data type for information exchange and storage. Concurrently, significant progress has been made in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Francesco Ballerini , Pierluigi Zama Ramirez , Roberto Mirabella , Samuele Salti , Luigi Di Stefano

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

The study of representations is widespread across fields, including neuroscience, psychology, and artificial intelligence. While representations are often studied and compared through similarities between stimuli, current methods provide…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Florian P. Mahner , Ka Chun Lam , Francisco Pereira , Martin N. Hebart

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Neural fields, also known as implicit neural representations (INRs), have shown a remarkable capability of representing, generating, and manipulating various data types, allowing for continuous data reconstruction at a low memory footprint.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

Registration is a fundamental task in medical image analysis which can be applied to several tasks including image segmentation, intra-operative tracking, multi-modal image alignment, and motion analysis. Popular registration tools such as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Wentao Zhu , Andriy Myronenko , Ziyue Xu , Wenqi Li , Holger Roth , Yufang Huang , Fausto Milletari , Daguang Xu

Conditional Neural Fields (CNFs) are increasingly being leveraged as continuous signal representations, by associating each data-sample with a latent variable that conditions a shared backbone Neural Field (NeF) to reconstruct the sample.…

Positional encodings are a common component of neural scene reconstruction methods, and provide a way to bias the learning of neural fields towards coarser or finer representations. Current neural surface reconstruction methods use a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Thomas Walker , Octave Mariotti , Amir Vaxman , Hakan Bilen

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

Graphics · Computer Science 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

Recent advances in Multimodal Large Language Models (MLLMs) have shown remarkable capabilities in understanding both images and 3D data, yet these modalities face inherent limitations in comprehensively representing object geometry and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Andrea Amaduzzi , Pierluigi Zama Ramirez , Giuseppe Lisanti , Samuele Salti , Luigi Di Stefano

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yudan Ren , Pengcheng Shi , Zihan Ma , Xiaowei He , Xiao Li

Magnetic Resonance Fingerprinting (MRF) has emerged as a promising quantitative MR imaging approach. Deep learning methods have been proposed for MRF and demonstrated improved performance over classical compressed sensing algorithms.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-27 Dongdong Chen , Mike E. Davies , Mohammad Golbabaee