English
Related papers

Related papers: Understanding and Improving Interpolation in Autoe…

200 papers

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

The simplest way to obtain continuous interpolation between two points in high dimensional space is to draw a line between them. While previous works focused on the general connectivity between model parameters, we explored linear…

Computation and Language · Computer Science 2022-11-23 Mark Rofin , Nikita Balagansky , Daniil Gavrilov

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

We train multi-task autoencoders on linguistic tasks and analyze the learned hidden sentence representations. The representations change significantly when translation and part-of-speech decoders are added. The more decoders a model…

Computation and Language · Computer Science 2018-01-19 Gino Brunner , Yuyi Wang , Roger Wattenhofer , Michael Weigelt

Modern text classification methods heavily rely on contextual embeddings from large language models (LLMs). Compared to human-engineered features, these embeddings provide automatic and effective representations for classification model…

Computation and Language · Computer Science 2025-07-29 Xuansheng Wu , Wenhao Yu , Xiaoming Zhai , Ninghao Liu

Deep learning is playing an instrumental role in the design of the next generation of communication systems. In this letter, we address the massive MIMO interconnect's bandwidth constraint relaxation using autoencoders. The autoencoder is…

Signal Processing · Electrical Eng. & Systems 2019-09-20 Messaoud Ahmed Ouameur , Daniel Massicotte

We introduce a new convolutional AutoEncoder architecture for user modelling and recommendation tasks with several improvements over the state of the art. Firstly, our model has the flexibility to learn a set of associations and…

Machine Learning · Computer Science 2025-09-10 Antoine Ledent , Petr Kasalický , Rodrigo Alves , Hady W. Lauw

We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Images are embedded in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Pierrick Chatillon , Yann Gousseau , Sidonie Lefebvre

An ill-posed inverse problem of autoconvolution type is investigated. This inverse problem occurs in nonlinear optics in the context of ultrashort laser pulse characterization. The novelty of the mathematical model consists in a physically…

Mathematical Physics · Physics 2013-01-28 Daniel Gerth , Bernd Hofmann , Simon Birkholz , Sebastian Koke , Günter Steinmeyer

In recent literature there are plenty of works that combine handcrafted and learnable regularizers to solve inverse imaging problems. While this hybrid approach has demonstrated promising results, the motivation for combining handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Mixup - a neural network regularization technique based on linear interpolation of labeled sample pairs - has stood out by its capacity to improve model's robustness and generalizability through a surprisingly simple formalism. However, its…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Shahine Bouabid , Vincent Delaitre

We consider the problem of image representation for the tasks of unsupervised learning and semi-supervised learning. In those learning tasks, the raw image vectors may not provide enough representation for their intrinsic structures due to…

Machine Learning · Computer Science 2014-02-20 Yiyi Liao , Yue Wang , Yong Liu

Autoencoders learn data representations through reconstruction. Robust training is the key factor affecting the quality of the learned representations and, consequently, the accuracy of the application that use them. Previous works…

Neural and Evolutionary Computing · Computer Science 2018-07-11 Maisa Doaud , Michael Mayo

One-class classification refers to approaches of learning using data from a single class only. In this paper, we propose a deep learning one-class classification method suitable for multimodal data, which relies on two convolutional…

Machine Learning · Computer Science 2023-09-26 Firas Laakom , Fahad Sohrab , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Existing video frame interpolation methods can only interpolate the frame at a given intermediate time-step, e.g. 1/2. In this paper, we aim to explore a more generalized kind of video frame interpolation, that at an arbitrary time-step. To…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Shixing Yu , Yiyang Ma , Wenhan Yang , Wei Xiang , Jiaying Liu

Anomaly detection is to identify samples that do not conform to the distribution of the normal data. Due to the unavailability of anomalous data, training a supervised deep neural network is a cumbersome task. As such, unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , John Taylor Jewell , Yalda Mohsenzadeh

Sparse representations of images are useful in many computer vision applications. Sparse coding with an $l_1$ penalty and a learned linear dictionary requires regularization of the dictionary to prevent a collapse in the $l_1$ norms of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Katrina Evtimova , Yann LeCun

In meta-learning approaches, it is difficult for a practitioner to make sense of what kind of representations the model employs. Without this ability, it can be difficult to both understand what the model knows as well as to make meaningful…

Machine Learning · Computer Science 2022-04-05 Pedro Sandoval-Segura , Wallace Lawson

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Spectral unmixing has been extensively studied with a variety of methods and used in many applications. Recently, data-driven techniques with deep learning methods have obtained great attention to spectral unmixing for its superior learning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Min Zhao , Jie Chen , Nicolas Dobigeon