English
Related papers

Related papers: Towards Better Gradient Consistency for Neural Sig…

200 papers

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance degradation when…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zelin Gao , Weichen Dai , Yu Zhang

Stochastic gradient descent (SGD), a widely used algorithm in deep-learning neural networks has attracted continuing studies for the theoretical principles behind its success. A recent work reports an anomaly (inverse) relation between the…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Xia Xiong , Yong-Cong Chen , Chunxiao Shi , Ping Ao

Topological consistency plays a crucial role in the task of boundary segmentation for reticular images, such as cell membrane segmentation in neuron electron microscopic images, grain boundary segmentation in material microscopic images and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Chuni Liu , Boyuan Ma , Xiaojuan Ban , Yujie Xie , Hao Wang , Weihua Xue , Jingchao Ma , Ke Xu

Reconstructing 3D vehicles from noisy and sparse partial point clouds is of great significance to autonomous driving. Most existing 3D reconstruction methods cannot be directly applied to this problem because they are elaborately designed…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yibo Liu , Kelly Zhu , Guile Wu , Yuan Ren , Bingbing Liu , Yang Liu , Jinjun Shan

We study the convergence properties of gradient descent for training deep linear neural networks, i.e., deep matrix factorizations, by extending a previous analysis for the related gradient flow. We show that under suitable conditions on…

Machine Learning · Computer Science 2021-11-25 Gabin Maxime Nguegnang , Holger Rauhut , Ulrich Terstiege

Signed distance fields (SDFs) are a form of surface representation widely used in computer graphics, having applications in rendering, collision detection and modelling. In interactive media such as games, high-resolution SDFs are commonly…

Graphics · Computer Science 2022-10-13 Yu Wei Tan , Nicholas Chua , Clarence Koh , Anand Bhojan

Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a…

Machine Learning · Computer Science 2019-02-28 Weihao Gao , Ashok Vardhan Makkuva , Sewoong Oh , Pramod Viswanath

Grasping unknown objects from a single view has remained a challenging topic in robotics due to the uncertainty of partial observation. Recent advances in large-scale models have led to benchmark solutions such as GraspNet-1Billion.…

Robotics · Computer Science 2025-07-17 Hao Chen , Takuya Kiyokawa , Zhengtao Hu , Weiwei Wan , Kensuke Harada

Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rui Peng , Xiaodong Gu , Luyang Tang , Shihe Shen , Fanqi Yu , Ronggang Wang

We present novel empirical observations regarding how stochastic gradient descent (SGD) navigates the loss landscape of over-parametrized deep neural networks (DNNs). These observations expose the qualitatively different roles of learning…

Machine Learning · Statistics 2018-05-31 Chen Xing , Devansh Arpit , Christos Tsirigotis , Yoshua Bengio

Image restoration has seen substantial progress in recent years. However, existing methods often neglect depth information, which hurts similarity matching, results in attention distractions in shallow depth-of-field (DoF) scenarios, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Junyi He , Liuling Chen , Hongyang Zhou , Zhang xiaoxing , Xiaobin Zhu , Shengxiang Yu , Jingyan Qin , Xu-Cheng Yin

Microvascular networks are challenging to model because these structures are currently near the diffraction limit for most advanced three-dimensional imaging modalities, including confocal and light sheet microscopy. This makes semantic…

Image and Video Processing · Electrical Eng. & Systems 2024-04-04 Meher Niger , Helya Goharbavang , Taeyong Ahn , Emily K. Alley , Joshua D. Wythe , Guoning Chen , David Mayerich

We propose a feed-forward method for dense Signed Distance Field (SDF) regression from unstructured image collections in less than three seconds, without camera calibration or post-hoc fusion. Our key insight is that the intermediate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Laura Fink , Linus Franke , George Kopanas , Marc Stamminger , Peter Hedman

In the field of Connectomics, a primary problem is that of 3D neuron segmentation. Although deep learning-based methods have achieved remarkable accuracy, errors still exist, especially in regions with image defects. One common type of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Jules Berman , Dmitri B. Chklovskii , Jingpeng Wu

Stochastic gradient descent (SGD) is an essential element in Machine Learning (ML) algorithms. Asynchronous parallel shared-memory SGD (AsyncSGD), including synchronization-free algorithms, e.g. HOGWILD!, have received interest in certain…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-19 Karl Bäckström , Ivan Walulya , Marina Papatriantafilou , Philippas Tsigas

Federated learning (FL) is a promising way to use the computing power of mobile devices while maintaining the privacy of users. Current work in FL, however, makes the unrealistic assumption that the users have ground-truth labels on their…

Machine Learning · Computer Science 2021-03-10 Zhengming Zhang , Yaoqing Yang , Zhewei Yao , Yujun Yan , Joseph E. Gonzalez , Michael W. Mahoney

3D dynamic point clouds provide a discrete representation of real-world objects or scenes in motion, which have been widely applied in immersive telepresence, autonomous driving, surveillance, etc. However, point clouds acquired from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Qianjiang Hu , Wei Hu

Environmental perception systems are crucial for high-precision mapping and autonomous navigation, with LiDAR serving as a core sensor providing accurate 3D point cloud data. Efficiently processing unstructured point clouds while extracting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chuang Chen , Yi Lin , Bo Wang , Jing Hu , Xi Wu , Wenyi Ge

Surface reconstruction from point clouds is a crucial task in the fields of computer vision and computer graphics. SDF-based methods excel at reconstructing smooth meshes with minimal error and artefacts but struggle with representing open…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Hui Tian , Kai Xu

We present a novel non-iterative learnable method for partial-to-partial 3D shape registration. The partial alignment task is extremely complex, as it jointly tries to match between points and identify which points do not appear in the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Dvir Ginzburg , Dan Raviv