English
Related papers

Related papers: Total Variation and Euler's Elastica for Supervise…

200 papers

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data variance. It can be shown…

Machine Learning · Computer Science 2022-08-23 Yuhta Takida , Wei-Hsiang Liao , Chieh-Hsin Lai , Toshimitsu Uesaka , Shusuke Takahashi , Yuki Mitsufuji

Seismic data often undergoes severe noise due to environmental factors, which seriously affects subsequent applications. Traditional hand-crafted denoisers such as filters and regularizations utilize interpretable domain knowledge to design…

Signal Processing · Electrical Eng. & Systems 2023-04-21 Zitai Xu , Yisi Luo , Bangyu Wu , Deyu Meng

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

Machine Learning · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

We study the qualitative properties of optimal regularisation parameters in variational models for image restoration. The parameters are solutions of bilevel optimisation problems with the image restoration problem as constraint. A general…

Optimization and Control · Mathematics 2020-02-13 Juan Carlos De Los Reyes , Carola-Bibiane Schönlieb , Tuomo Valkonen

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Subhadip Mukherjee , Marcello Carioni , Ozan Öktem , Carola-Bibiane Schönlieb

In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a…

Machine Learning · Statistics 2021-12-30 Hwan Goh , Sheroze Sheriffdeen , Jonathan Wittmer , Tan Bui-Thanh

Sparsification of neural networks is one of the effective complexity reduction methods to improve efficiency and generalizability. We consider the problem of learning a one hidden layer convolutional neural network with ReLU activation…

Optimization and Control · Mathematics 2020-02-26 Thu Dinh , Jack Xin

The supervised learning paradigm is limited by the cost - and sometimes the impracticality - of data collection and labeling in multiple domains. Self-supervised learning, a paradigm which exploits the structure of unlabeled data to create…

Bayesian deep learning plays an important role especially for its ability evaluating epistemic uncertainty (EU). Due to computational complexity issues, approximation methods such as variational inference (VI) have been used in practice to…

Machine Learning · Statistics 2022-10-12 Futoshi Futami , Tomoharu Iwata , Naonori Ueda , Issei Sato , Masashi Sugiyama

We present a novel approach to unsupervised learning for video object segmentation (VOS). Unlike previous work, our formulation allows to learn dense feature representations directly in a fully convolutional regime. We rely on uniform grid…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Nikita Araslanov , Simone Schaub-Meyer , Stefan Roth

This paper is dedicated to investigating the adaptive Euler-Maruyama (EM) schemes for the approximation of McKean-Vlasov stochastic differential equations (SDEs) with common noise. When the drift and diffusion coefficients both satisfy the…

Numerical Analysis · Mathematics 2025-09-03 Hu Liu , Shuaibin Gao , Junhao Hu

This paper aims to numerically solve the two-dimensional electrical impedance tomography (EIT) with Cauchy data. This inverse problem is highly challenging due to its severe ill-posed nature and strong nonlinearity, which necessitates…

Numerical Analysis · Mathematics 2025-07-22 Kai Li , Kwancheol Shin , Zhi Zhou

A feature learning task involves training models that are capable of inferring good representations (transformations of the original space) from input data alone. When working with limited or unlabelled data, and also when multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Gabriel B. Cavallari , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

In this paper, we consider using total variation minimization to recover signals whose gradients have a sparse support, from a small number of measurements. We establish the proof for the performance guarantee of total variation (TV)…

Information Theory · Computer Science 2013-10-14 Jian-Feng Cai , Weiyu Xu

Learning disentangled representations without supervision or inductive biases, often leads to non-interpretable or undesirable representations. On the other hand, strict supervision requires detailed knowledge of the true generative…

Machine Learning · Computer Science 2020-08-25 Vasilis Margonis , Athanasios Davvetas , Iraklis A. Klampanos

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

We propose a new spectrum allocation strategy, aided by unsupervised learning, for multiuser terahertz communication systems. In this strategy, adaptive sub-band bandwidth is considered such that the spectrum of interest can be divided into…

Machine Learning · Computer Science 2024-10-28 Akram Shafie , Chunhui Li , Nan Yang , Xiangyun Zhou , Trung Q. Duong

In this work, we consider the development of implicit explicit total variation diminishing (TVD) methods (also termed SSP: strong stability preserving) for the compressible isentropic Euler system in the low Mach number regime. The scheme…

Numerical Analysis · Mathematics 2018-08-01 Giacomo Dimarco , Raphaël Loubère , Victor Michel-Dansac , Marie-Hélène Vignal