English
Related papers

Related papers: Watermarking Pre-trained Encoders in Contrastive L…

200 papers

Contrastive learning has been applied successfully to learn vector representations of text. Previous research demonstrated that learning high-quality representations benefits from batch-wise contrastive loss with a large number of…

Machine Learning · Computer Science 2021-06-16 Luyu Gao , Yunyi Zhang , Jiawei Han , Jamie Callan

Contrastive pretraining on image-text pairs from the web is one of the most popular large-scale pretraining strategies for vision backbones, especially in the context of large multimodal models. At the same time, image captioning on this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Michael Tschannen , Manoj Kumar , Andreas Steiner , Xiaohua Zhai , Neil Houlsby , Lucas Beyer

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Digital image watermarking is the process of embedding and extracting watermark covertly on a carrier image. Incorporating deep learning networks with image watermarking has attracted increasing attention during recent years. However,…

Multimedia · Computer Science 2020-07-07 Xin Zhong , Frank Y. Shih

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Federated graph learning (FedGL) is an emerging learning paradigm to collaboratively train graph data from various clients. However, during the development and deployment of FedGL models, they are susceptible to illegal copying and model…

Cryptography and Security · Computer Science 2024-10-24 Yuxin Yang , Qiang Li , Yuan Hong , Binghui Wang

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Digital image watermarking is the process of embedding and extracting a watermark covertly on a cover-image. To dynamically adapt image watermarking algorithms, deep learning-based image watermarking schemes have attracted increased…

Multimedia · Computer Science 2020-07-07 Xin Zhong , Pei-Chi Huang , Spyridon Mastorakis , Frank Y. Shih

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang

This paper introduces a blind watermarking based on a convolutional neural network (CNN). We propose an iterative learning framework to secure robustness of watermarking. One loop of learning process consists of the following three stages:…

Multimedia · Computer Science 2019-03-21 Seung-Min Mun , Seung-Hun Nam , Han-Ul Jang , Dongkyu Kim , Heung-Kyu Lee

Deep neural networks have recently achieved significant progress. Sharing trained models of these deep neural networks is very important in the rapid progress of researching or developing deep neural network systems. At the same time, it is…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Yusuke Uchida , Yuki Nagai , Shigeyuki Sakazawa , Shin'ichi Satoh

With the growth of editing and sharing images through the internet, the importance of protecting the images' authorship has increased. Robust watermarking is a known approach to maintaining copyright protection. Robustness and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Arezoo PariZanganeh , Ghazaleh Ghorbanzadeh , Zahra Nabizadeh ShahreBabak , Nader Karimi , Shadrokh Samavi

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Watermarking is an operation of embedding an information into an image in a way that allows to identify ownership of the image despite applying some distortions on it. In this paper, we presented a novel end-to-end solution for embedding…

Multimedia · Computer Science 2022-01-11 Marcin Plata , Piotr Syga

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

Machine Learning · Computer Science 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Multimodal contrastive learning is a methodology for linking different data modalities; the canonical example is linking image and text data. The methodology is typically framed as the identification of a set of encoders, one for each…

Machine Learning · Statistics 2025-06-02 Ricardo Baptista , Andrew M. Stuart , Son Tran

Graph Neural Networks (GNNs) are widely deployed in industry, making their intellectual property valuable. However, protecting GNNs from unauthorized use remains a challenge. Watermarking offers a solution by embedding ownership information…

Cryptography and Security · Computer Science 2026-05-12 Jane Downer , Yingdan Shi , Ziyan Liu , Ren Wang , Binghui Wang

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin