English
Related papers

Related papers: Total Variation Optimization Layers for Computer V…

200 papers

In practical applications of tomographic imaging, there are often challenges for image reconstruction due to under-sampling and insufficient data. In computed tomography (CT), for example, image reconstruction from few views would enable…

Medical Physics · Physics 2009-04-30 Emil Y. Sidky , Chien-Min Kao , Xiaochuan Pan

A novel class of semi-norms, generalising the notion of the isotropic total variation $TV_{2}$ and the an-isotropic total variation $TV_{1}$ is introduced. A supervised learning method via bilevel optimisation is proposed for the…

Analysis of PDEs · Mathematics 2019-03-29 Pan Liu , Carola-Bibiane Schönlieb

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

Convolutional Neural Network (CNN) features have been successfully employed in recent works as an image descriptor for various vision tasks. But the inability of the deep CNN features to exhibit invariance to geometric transformations and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Konda Reddy Mopuri , R. Venkatesh Babu

This paper studies the efficiency problem for visual transformers by excavating redundant calculation in given networks. The recent transformer architecture has demonstrated its effectiveness for achieving excellent performance on a series…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yehui Tang , Kai Han , Yunhe Wang , Chang Xu , Jianyuan Guo , Chao Xu , Dacheng Tao

This paper is focused on studying the view-manifold structure in the feature spaces implied by the different layers of Convolutional Neural Networks (CNN). There are several questions that this paper aims to answer: Does the learned CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Amr Bakry , Mohamed Elhoseiny , Tarek El-Gaaly , Ahmed Elgammal

We consider the problem of minimizing the continuous valued total variation subject to different unary terms on trees and propose fast direct algorithms based on dynamic programming to solve these problems. We treat both the convex and the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Vladimir Kolmogorov , Thomas Pock , Michal Rolinek

The field of computer vision has grown very rapidly in the past few years due to networks like convolution neural networks and their variants. The memory required to store the model and computational expense are very high for such a network…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Ranjith M S , S Parameshwara , Pavan Yadav A , Shriganesh Hegde

Total Generalized Variation (TGV) regularization in image reconstruction relies on an infimal convolution type combination of generalized first- and second-order derivatives. This helps to avoid the staircasing effect of Total Variation…

Optimization and Control · Mathematics 2022-05-09 Michael Hintermüller , Kostas Papafitsoros , Carlos N. Rautenberg , Hongpeng Sun

Recently proposed Graph Neural Networks (GNNs) for vertex clustering are trained with an unsupervised minimum cut objective, approximated by a Spectral Clustering (SC) relaxation. However, the SC relaxation is loose and, while it offers a…

Machine Learning · Computer Science 2023-05-01 Jonas Berg Hansen , Filippo Maria Bianchi

In this paper, we consider a backward problem for a time-space fractional diffusion process. For this problem, we propose to construct the initial data by minimizing data residual error in fourier space domain and variable total variation…

Numerical Analysis · Mathematics 2016-05-24 Junxiong Jia , Jigen Peng , Jinghuai Gao , Yujiao Li

Deep supervision, or known as 'intermediate supervision' or 'auxiliary supervision', is to add supervision at hidden layers of a neural network. This technique has been increasingly applied in deep neural network learning systems for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Renjie Li , Xinyi Wang , Guan Huang , Wenli Yang , Kaining Zhang , Xiaotong Gu , Son N. Tran , Saurabh Garg , Jane Alty , Quan Bai

Convolutional neural networks have been proven effective in a variety of image restoration tasks. Most state-of-the-art solutions, however, are trained using images with a single particular degradation level, and their performance…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Yiwen Guo , Ming Lu , Wangmeng Zuo , Changshui Zhang , Yurong Chen

Extensive work has demonstrated the effectiveness of Vision Transformers. The plain Vision Transformer tends to obtain multi-scale features by selecting fixed layers, or the last layer of features aiming to achieve higher performance in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Fangjian Lin , Yizhe Ma , Shengwei Tian

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

Vision Transformers (ViT) have made many breakthroughs in computer vision tasks. However, considerable redundancy arises in the spatial dimension of an input image, leading to massive computational costs. Therefore, We propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Mengzhao Chen , Mingbao Lin , Ke Li , Yunhang Shen , Yongjian Wu , Fei Chao , Rongrong Ji

This paper introduces a novel approach to securing machine learning model deployments against potential distribution shifts in practical applications, the Total Variation Out-of-Distribution (TV-OOD) detection method. Existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dabiao Ma , Zhiba Su , Jian Yang , Haojun Fei

Recently, convolutional neural networks (CNNs) have shown great success on the task of monocular depth estimation. A fundamental yet unanswered question is: how CNNs can infer depth from a single image. Toward answering this question, we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Junjie Hu , Yan Zhang , Takayuki Okatani

Motivated in part by models arising from mathematical descriptions of Bose-Einstein condensation, we consider total variation minimization problems in which the total variation is weighted by a function that may degenerate near the domain…

Mathematical Physics · Physics 2015-09-15 Prashant Athavale , Robert L. Jerrard , Matteo Novaga , Giandomenico Orlandi

In this paper we demonstrate that the framework of nonlinear spectral decompositions based on total variation (TV) regularization is very well suited for image fusion as well as more general image manipulation tasks. The well-localized and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Martin Benning , Michael Möller , Raz Z. Nossek , Martin Burger , Daniel Cremers , Guy Gilboa , Carola-Bibiane Schönlieb