中文
相关论文

相关论文: Cross-feature Contrastive Loss for Decentralized D…

200 篇论文

A crucial challenge in decentralized systems is state estimation in the presence of unknown inputs, particularly within heterogeneous sensor networks with dynamic topologies. While numerous consensus algorithms have been introduced, they…

系统与控制 · 电气工程与系统科学 2024-12-13 Zida Wu , Ankur Mehta

Large facial variations are the main challenge in face recognition. To this end, previous variation-specific methods make full use of task-related prior to design special network losses, which are typically not general among different tasks…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Yuge Huang , Pengcheng Shen , Ying Tai , Shaoxin Li , Xiaoming Liu , Jilin Li , Feiyue Huang , Rongrong Ji

We consider the problem of decentralized clustering and estimation over multi-task networks, where agents infer and track different models of interest. The agents do not know beforehand which model is generating their own data. They also do…

最优化与控制 · 数学 2017-05-24 Sahar Khawatmi , Ali H. Sayed , Abdelhak M. Zoubir

Infrared and visible image fusion plays a critical role in enhancing scene perception by combining complementary information from different modalities. Despite recent advances, achieving high-quality image fusion with lightweight models…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Yuhao Wang , Lingjuan Miao , Zhiqiang Zhou , Yajun Qiao , Lei Zhang

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

机器学习 · 计算机科学 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Data-free knowledge distillation transfers knowledge by recovering training data from a pre-trained model. Despite the recent success of seeking global data diversity, the diversity within each class and the similarity among different…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yingping Liang , Ying Fu

We present a novel and unified deep learning framework which is capable of learning domain-invariant representation from data across multiple domains. Realized by adversarial training with additional ability to exploit domain-specific…

计算机视觉与模式识别 · 计算机科学 2018-10-30 Alexander H. Liu , Yen-Cheng Liu , Yu-Ying Yeh , Yu-Chiang Frank Wang

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

人工智能 · 计算机科学 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

The deep layers of modern neural networks extract a rather rich set of features as an input propagates through the network. This paper sets out to harvest these rich intermediate representations for quantization with minimal accuracy loss…

机器学习 · 计算机科学 2020-03-04 Ahmed T. Elthakeb , Prannoy Pilligundla , Alex Cloninger , Hadi Esmaeilzadeh

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

机器学习 · 计算机科学 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang

Deep image translation methods have recently shown excellent results, outputting high-quality images covering multiple modes of the data distribution. There has also been increased interest in disentangling the internal representations…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Abel Gonzalez-Garcia , Joost van de Weijer , Yoshua Bengio

Deep neural networks (DNNs) have achieved state-of-the-art results in various pattern recognition tasks. However, they perform poorly on out-of-distribution adversarial examples i.e. inputs that are specifically crafted by an adversary to…

密码学与安全 · 计算机科学 2019-05-09 Chirag Agarwal , Anh Nguyen , Dan Schonfeld

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

计算机视觉与模式识别 · 计算机科学 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

机器学习 · 计算机科学 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

Contrastive representation learning, which aims to learnthe shared information between different views of unlabeled data by maximizing the mutual information between them, has shown its powerful competence in self-supervised learning for…

机器学习 · 计算机科学 2024-08-21 Xuechu Yu

Contrastive learning (CL), a self-supervised learning approach, can effectively learn visual representations from unlabeled data. Given the CL training data, generative models can be trained to generate synthetic data to supplement the real…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

In recent years, deep perceptual loss has been widely and successfully used to train machine learning models for many computer vision tasks, including image synthesis, segmentation, and autoencoding. Deep perceptual loss is a type of loss…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Gustav Grund Pihlgren , Konstantina Nikolaidou , Prakash Chandra Chhipa , Nosheen Abid , Rajkumar Saini , Fredrik Sandin , Marcus Liwicki

Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Bolun Cai , Pengfei Xiong , Shangxuan Tian

Recent methods for reinforcement learning from images use auxiliary tasks to learn image features that are used by the agent's policy or Q-function. In particular, methods based on contrastive learning that induce linearity of the latent…

机器学习 · 计算机科学 2022-03-04 Bang You , Oleg Arenz , Youping Chen , Jan Peters

We propose a new causal inference framework to learn causal effects from multiple, decentralized data sources in a federated setting. We introduce an adaptive transfer algorithm that learns the similarities among the data sources by…

机器学习 · 计算机科学 2023-01-03 Thanh Vinh Vo , Arnab Bhattacharyya , Young Lee , Tze-Yun Leong