English
Related papers

Related papers: Preserving Derivative Information while Transformi…

200 papers

This paper proposes a fractional order gradient method for the backward propagation of convolutional neural networks. To overcome the problem that fractional order gradient method cannot converge to real extreme point, a simplified…

Optimization and Control · Mathematics 2020-01-07 Dian Sheng , Yiheng Wei , Yuquan Chen , Yong Wang

Jet point cloud images are high dimensional data structures that needs to be transformed to a separable feature space for machine learning algorithms to distinguish them with simple decision boundaries. In this article, the authors focus on…

High Energy Physics - Phenomenology · Physics 2024-07-08 Jairo Orozco Sandoval , Vidya Manian , Sudhir Malik

Neuromorphology is crucial to identifying neuronal subtypes and understanding learning. It is also implicated in neurological disease. However, standard morphological analysis focuses on macroscopic features such as branching frequency and…

Neurons and Cognition · Quantitative Biology 2022-03-10 Thomas L. Athey , Jacopo Teneggi , Joshua T. Vogelstein , Daniel Tward , Ulrich Mueller , Michael I. Miller

We propose a novel sequence prediction method for sequential data capturing node traversals in graphs. Our method builds on a statistical modelling framework that combines multiple higher-order network models into a single multi-order…

Machine Learning · Computer Science 2023-10-25 Christoph Gote , Giona Casiraghi , Frank Schweitzer , Ingo Scholtes

Networks are a powerful tool to model the structure and dynamics of complex systems across scales. Direct connections between system components are often represented as edges, while paths and walks capture indirect interactions. This…

Physics and Society · Physics 2025-01-15 Rohit Sahasrabuddhe , Renaud Lambiotte , Martin Rosvall

Transformers can generate predictions in two approaches: 1. auto-regressively by conditioning each sequence element on the previous ones, or 2. directly produce an output sequences in parallel. While research has mostly explored upon this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Andrea Alfieri , Yancong Lin , Jan C. van Gemert

This paper identifies and solves a new optimization problem: Given a belief network (BN) and a target ordering on its variables, how can we efficiently derive its minimal I-map whose arcs are consistent with the target ordering? We present…

Artificial Intelligence · Computer Science 2013-03-08 Izhar Matzkevich , Bruce Abramson

Segmentation algorithms are prone to make topological errors on fine-scale structures, e.g., broken connections. We propose a novel method that learns to segment with correct topology. In particular, we design a continuous-valued loss…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Xiaoling Hu , Li Fuxin , Dimitris Samaras , Chao Chen

Image-based jet analysis is built upon the jet image representation of jets that enables a direct connection between high energy physics and the fields of computer vision and deep learning. Through this connection, a wide array of new jet…

Data Analysis, Statistics and Probability · Physics 2020-12-21 Michael Kagan

Embedding symmetries in the architectures of deep neural networks can improve classification and network convergence in the context of jet substructure. These results hint at the existence of symmetries in jet energy depositions, such as…

High Energy Physics - Phenomenology · Physics 2024-10-08 Alexis Romero , Daniel Whiteson

Most deep learning models are limited to specific datasets or tasks because of network structures using fixed layers. In this paper, we discuss the differences between existing neural networks and real human neurons, propose association…

Artificial Intelligence · Computer Science 2023-01-31 Seokjun Kim , Jaeeun Jang , Hyeoncheol Kim

This paper considers the problem of inferring the structure of a network from indirect observations. Each observation (a "trace") is the unordered set of nodes which are activated along a path through the network. Since a trace does not…

Data Structures and Algorithms · Computer Science 2013-01-30 Vincent Gripon , Michael Rabbat

Fractional gradient descent has been studied extensively, with a focus on its ability to extend traditional gradient descent methods by incorporating fractional-order derivatives. This approach allows for more flexibility in navigating…

Machine Learning · Computer Science 2024-11-25 Teodor Alexandru Szente , James Harrison , Mihai Zanfir , Cristian Sminchisescu

In recent times, an increasing number of researchers have been devoted to utilizing deep neural networks for end-to-end flight navigation. This approach has gained traction due to its ability to bridge the gap between perception and…

Robotics · Computer Science 2024-10-11 Zhichao Han , Long Xu , Liuao Pei , Fei Gao

The neurons of artificial neural networks were originally invented when much less was known about biological neurons than is known today. Our work explores a modification to the core neuron unit to make it more parallel to a biological…

Neural and Evolutionary Computing · Computer Science 2025-01-31 Rorry Brenner , Laurent Itti

Deep neural networks (DNNs) and decision trees (DTs) are both state-of-the-art classifiers. DNNs perform well due to their representational learning capabilities, while DTs are computationally efficient as they perform inference along one…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Noam Gottlieb , Michael Werman

Many types of data from fields including natural language processing, computer vision, and bioinformatics, are well represented by discrete, compositional structures such as trees, sequences, or matchings. Latent structure models are a…

Machine Learning · Computer Science 2026-02-04 Vlad Niculae , Caio F. Corro , Nikita Nangia , Tsvetomila Mihaylova , André F. T. Martins

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

The diffusion of minimally invasive, endovascular interventions motivates the development of visualization methods for complex vascular networks. We propose a planar representation of blood vessel trees which preserves the properties that…

Image and Video Processing · Electrical Eng. & Systems 2025-10-23 Guillaume Houry , Tom Boeken , Stéphanie Allassonnière , Jean Feydy

Obstacle avoidance from monocular images is a challenging problem for robots. Though multi-view structure-from-motion could build 3D maps, it is not robust in textureless environments. Some learning based methods exploit human demonstration…

Robotics · Computer Science 2017-05-01 Shichao Yang , Sandeep Konam , Chen Ma , Stephanie Rosenthal , Manuela Veloso , Sebastian Scherer