English
Related papers

Related papers: Trainable Spectrally Initializable Matrix Transfor…

200 papers

Simple image rotations significantly reduce the accuracy of deep neural networks. Moreover, training with all possible rotations increases the data set, which also increases the training duration. In this work, we address trainable rotation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Wolfgang Fuhl , Enkelejda Kasneci

In this paper we report on improved part segmentation performance using convolutional neural networks to reduce the dependency on the large amount of manually annotated empirical images. This was achieved by optimising the visual realism of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Ruud Barth , Jochen Hemming , Eldert J. van Henten

Graph kernels have been successfully applied to many graph classification problems. Typically, a kernel is first designed, and then an SVM classifier is trained based on the features defined implicitly by this kernel. This two-stage…

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Semidefinite programming is a fundamental problem class in convex optimization, but despite recent advances in solvers, solving large-scale semidefinite programs remains challenging. Generally the matrix functions involved are spectral or…

Optimization and Control · Mathematics 2025-11-04 Daniel Cederberg , Stephen Boyd

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

While variational methods have been among the most powerful tools for solving linear inverse problems in imaging, deep (convolutional) neural networks have recently taken the lead in many challenging benchmarks. A remaining drawback of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tim Meinhardt , Michael Moeller , Caner Hazirbas , Daniel Cremers

Traditional (unstructured) pruning methods for a Transformer model focus on regularizing the individual weights by penalizing them toward zero. In this work, we explore spectral-normalized identity priors (SNIP), a structured pruning…

Computation and Language · Computer Science 2020-10-06 Zi Lin , Jeremiah Zhe Liu , Zi Yang , Nan Hua , Dan Roth

Deep learning models have a large number of free parameters that must be estimated by efficient training of the models on a large number of training data samples to increase their generalization performance. In real-world applications, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Hojjat Salehinejad , Shahrokh Valaee , Timothy Dowdell , Joseph Barfett

We introduce a new function-preserving transformation for efficient neural architecture search. This network transformation allows reusing previously trained networks and existing successful architectures that improves sample efficiency. We…

Machine Learning · Computer Science 2018-06-08 Han Cai , Jiacheng Yang , Weinan Zhang , Song Han , Yong Yu

Deformable templates, or atlases, are images that represent a prototypical anatomy for a population, and are often enhanced with probabilistic anatomical label maps. They are commonly used in medical image analysis for population studies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Marianne Rakic , Andrew Hoopes , S. Mazdak Abulnaga , Mert R. Sabuncu , John V. Guttag , Adrian V. Dalca

Convolutional Neural Networks have revolutionized vision applications. There are image domains and representations, however, that cannot be handled by standard CNNs (e.g., spherical images, superpixels). Such data are usually processed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 David Hart , Michael Whitney , Bryan Morse

Vision transformers have gained popularity recently, leading to the development of new vision backbones with improved features and consistent performance gains. However, these advancements are not solely attributable to novel feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Xiaowei Hu , Min Shi , Weiyun Wang , Sitong Wu , Linjie Xing , Wenhai Wang , Xizhou Zhu , Lewei Lu , Jie Zhou , Xiaogang Wang , Yu Qiao , Jifeng Dai

Vision Transformers have achieved great success in computer visions, delivering exceptional performance across various tasks. However, their inherent reliance on sequential input enforces the manual partitioning of images into patch…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Changzhen Li , Jie Zhang , Yang Wei , Zhilong Ji , Jinfeng Bai , Shiguang Shan

We address the problem of determining correspondences between two images in agreement with a geometric model such as an affine or thin-plate spline transformation, and estimating its parameters. The contributions of this work are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Ignacio Rocco , Relja Arandjelović , Josef Sivic

Standard convolutional neural networks assume a grid structured input is available and exploit discrete convolutions as their fundamental building blocks. This limits their applicability to many real-world applications. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shenlong Wang , Simon Suo , Wei-Chiu Ma , Andrei Pokrovsky , Raquel Urtasun

Image translation with convolutional neural networks has recently been used as an approach to multimodal change detection. Existing approaches train the networks by exploiting supervised information of the change areas, which, however, is…

Network data can be conveniently modeled as a graph signal, where data values are assigned to nodes of a graph that describes the underlying network topology. Successful learning from network data is built upon methods that effectively…

Machine Learning · Computer Science 2021-05-26 Fernando Gama , Elvin Isufi , Geert Leus , Alejandro Ribeiro