English
Related papers

Related papers: Topological Regularization for Dense Prediction

200 papers

Image segmentation is to extract meaningful objects from a given image. For degraded images due to occlusions, obscurities or noises, the accuracy of the segmentation result can be severely affected. To alleviate this problem, prior…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Daoping Zhang , Lok Ming Lui

Recently, methods have been developed to accurately predict the testing performance of a Deep Neural Network (DNN) on a particular task, given statistics of its underlying topological structure. However, further leveraging this newly found…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Stuart Synakowski , Fabian Benitez-Quiroz , Aleix M. Martinez

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

Machine Learning · Computer Science 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

The complexity and non-Euclidean structure of graph data hinder the development of data augmentation methods similar to those in computer vision. In this paper, we propose a feature augmentation method for graph nodes based on topological…

Machine Learning · Computer Science 2021-04-07 Rui Song , Fausto Giunchiglia , Ke Zhao , Hao Xu

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks. It was shown that these models exhibit an implicit…

Machine Learning · Computer Science 2022-09-20 Noam Razin , Asaf Maman , Nadav Cohen

Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may…

Machine Learning · Computer Science 2022-03-08 Robin Vandaele , Bo Kang , Jefrey Lijffijt , Tijl De Bie , Yvan Saeys

Topology optimization is computationally demanding that requires the assembly and solution to a finite element problem for each material distribution hypothesis. As a complementary alternative to the traditional physics-based topology…

Machine Learning · Computer Science 2018-08-23 Saurabh Banga , Harsh Gehani , Sanket Bhilare , Sagar Patel , Levent Kara

We introduce a consistent estimator for the homology (an algebraic structure representing connected components and cycles) of level sets of both density and regression functions. Our method is based on kernel estimation. We apply this…

Statistics Theory · Mathematics 2016-09-30 Omer Bobrowski , Sayan Mukherjee , Jonathan E. Taylor

Topology optimization has emerged as a popular approach to refine a component's design and increase its performance. However, current state-of-the-art topology optimization frameworks are compute-intensive, mainly due to multiple finite…

Machine Learning · Computer Science 2022-10-27 Jaydeep Rade , Aditya Balu , Ethan Herron , Jay Pathak , Rishikesh Ranade , Soumik Sarkar , Adarsh Krishnamurthy

Despite huge successes on a wide range of tasks, neural networks are known to sometimes struggle to generalise to unseen data. Many approaches have been proposed over the years to promote the generalisation ability of neural networks,…

Machine Learning · Computer Science 2026-02-02 Christiaan P. Opperman , Anna S. Bosman , Katherine M. Malan

Although neural networks are capable of reaching astonishing performances on a wide variety of contexts, properly training networks on complicated tasks requires expertise and can be expensive from a computational perspective. In industrial…

Machine Learning · Statistics 2021-05-11 Théo Lacombe , Yuichi Ike , Mathieu Carriere , Frédéric Chazal , Marc Glisse , Yuhei Umeda

The representations learned by deep neural networks are difficult to interpret in part due to their large parameter space and the complexities introduced by their multi-layer structure. We introduce a method for computing persistent…

Machine Learning · Computer Science 2019-05-31 Thomas Gebhart , Paul Schrater , Alan Hylton

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

Machine Learning · Computer Science 2020-01-08 E Zhenqian , Gao Weiguo

There is a growing body of work that leverages features extracted via topological data analysis to train machine learning models. While this field, sometimes known as topological machine learning (TML), has seen some notable successes, an…

Machine Learning · Computer Science 2022-11-16 Sarah McGuire , Shane Jackson , Tegan Emerson , Henry Kvinge

Persistent homology analysis provides means to capture the connectivity structure of data sets in various dimensions. On the mathematical level, by defining a metric between the objects that persistence attaches to data sets, we can…

Machine Learning · Computer Science 2019-06-12 Henri Riihimäki , José Licón-Saláiz

A neural network with fixed topology can be regarded as a parametrization of functions, which decides on the correlations between functional variations when parameters are adapted. We propose an analysis, based on a differential geometry…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Marc Toussaint

Modelling statistical relationships beyond the conditional mean is crucial in many settings. Conditional density estimation (CDE) aims to learn the full conditional probability density from data. Though highly expressive, neural network…

Machine Learning · Statistics 2020-02-17 Jonas Rothfuss , Fabio Ferreira , Simon Boehm , Simon Walther , Maxim Ulrich , Tamim Asfour , Andreas Krause

Accurate delineation of fine-scale structures is a very important yet challenging problem. Existing methods use topological information as an additional training loss, but are ultimately making pixel-wise predictions. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Xiaoling Hu , Dimitris Samaras , Chao Chen