English
Related papers

Related papers: Null Space Properties of Neural Networks with Appl…

200 papers

Overparametrization has been remarkably successful for deep learning studies. This study investigates an overlooked but important aspect of overparametrized neural networks, that is, the null components in the parameters of neural networks,…

Machine Learning · Computer Science 2021-06-10 Sho Sonoda , Isao Ishikawa , Masahiro Ikeda

Just like weights, bias terms are the learnable parameters of many popular machine learning models, including neural networks. Biases are thought to enhance the representational power of neural networks, enabling them to solve a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Chuqin Geng , Xiaojie Xu , Haolin Ye , Xujie Si

Despite recent progress, deep neural networks generally continue to be vulnerable to so-called adversarial examples--input images with small perturbations that can result in changes in the output classifications, despite no such change in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Matthew J. Roos

Modern neural networks often contain significantly more parameters than the size of their training data. We show that this excess capacity provides an opportunity for embedding secret machine learning models within a trained neural network.…

Machine Learning · Computer Science 2021-05-25 Chuan Guo , Ruihan Wu , Kilian Q. Weinberger

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

In the realm of advanced steganography, the scale of the model typically correlates directly with the resolution of the fundamental grid, necessitating the training of a distinct neural network for message extraction. This paper proposes an…

Cryptography and Security · Computer Science 2024-06-05 Zhong Yangjie , Liu Jia , Ke Yan , Liu Meiqi

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

Numerical Analysis · Mathematics 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

One of the most prominent attributes of Neural Networks (NNs) constitutes their capability of learning to extract robust and descriptive features from high dimensional data, like images. Hence, such an ability renders their exploitation as…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Ioannis Kansizoglou , Loukas Bampis , Antonios Gasteratos

Image steganography is the process of concealing secret information in images through imperceptible changes. Recent work has formulated this task as a classic constrained optimization problem. In this paper, we argue that image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-30 Xiangyu Chen , Varsha Kishore , Kilian Q Weinberger

Deep image steganography is a data hiding technology that conceal data in digital images via deep neural networks. However, existing deep image steganography methods only consider the visual similarity of container images to host images,…

Cryptography and Security · Computer Science 2022-01-20 Yanzhen Ren , Ting Liu , Liming Zhai , Lina Wang

Image steganography is the art of concealing secret information in images in a way that is imperceptible to unauthorized parties. Recent advances show that is possible to use a fixed neural network (FNN) for secret embedding and extraction.…

Cryptography and Security · Computer Science 2023-09-19 Zicong Luo , Sheng Li , Guobiao Li , Zhenxing Qian , Xinpeng Zhang

The ability to control for the kinds of information encoded in neural representation has a variety of use cases, especially in light of the challenge of interpreting these models. We present Iterative Null-space Projection (INLP), a novel…

Computation and Language · Computer Science 2020-04-30 Shauli Ravfogel , Yanai Elazar , Hila Gonen , Michael Twiton , Yoav Goldberg

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

Machine Learning · Computer Science 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

The paper presents StegBlocks, which defines a new concept for performing undetectable hidden communication. StegBlocks is a general approach for constructing methods of network steganography. In StegBlocks, one has to determine objects…

Multimedia · Computer Science 2015-06-09 Wojciech Fraczek , Krzysztof Szczypiorski

Steganography is an art of obscuring data inside another quotidian file of similar or varying types. Hiding data has always been of significant importance to digital forensics. Previously, steganography has been combined with cryptography…

Multimedia · Computer Science 2020-01-03 Kartik Sharma , Ashutosh Aggarwal , Tanay Singhania , Deepak Gupta , Ashish Khanna

Zero-shot learning deals with the ability to recognize objects without any visual training sample. To counterbalance this lack of visual data, each class to recognize is associated with a semantic prototype that reflects the essential…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Steganography is the art of hiding a secret message inside a publicly visible carrier message. Ideally, it is done without modifying the carrier, and with minimal loss of information in the secret message. Recently, various deep learning…

Multimedia · Computer Science 2020-03-31 Shivam Agarwal , Siddarth Venkatraman

This work theoretically studies stochastic neural networks, a main type of neural network in use. We prove that as the width of an optimized stochastic neural network tends to infinity, its predictive variance on the training set decreases…

Machine Learning · Computer Science 2022-05-25 Liu Ziyin , Hanlin Zhang , Xiangming Meng , Yuting Lu , Eric Xing , Masahito Ueda

Two major uncertainties, dataset bias and adversarial examples, prevail in state-of-the-art AI algorithms with deep neural networks. In this paper, we present an intuitive explanation for these issues as well as an interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Yifei Fan , Anthony Yezzi

Artificial and biological agents cannon learn given completely random and unstructured data. The structure of data is encoded in the metric relationships between data points. In the context of neural networks, neuronal activity within a…

Machine Learning · Computer Science 2022-11-03 Kosio Beshkov , Jonas Verhellen , Mikkel Elle Lepperød
‹ Prev 1 2 3 10 Next ›