English
Related papers

Related papers: Frequency-Masked Embedding Inference: A Non-Contra…

200 papers

Deep learning has been actively studied for time series forecasting, and the mainstream paradigm is based on the end-to-end training of neural network architectures, ranging from classical LSTM/RNNs to more recent TCNs and Transformers.…

Machine Learning · Computer Science 2022-05-06 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsupervised outlier…

Machine Learning · Computer Science 2019-10-23 Hamed Sarvari , Carlotta Domeniconi , Bardh Prenkaj , Giovanni Stilo

Few-shot Relation Extraction (FSRE) aims to extract relational facts from a sparse set of labeled corpora. Recent studies have shown promising results in FSRE by employing Pre-trained Language Models (PLMs) within the framework of…

Computation and Language · Computer Science 2024-03-12 Da Luo , Yanglei Gan , Rui Hou , Run Lin , Qiao Liu , Yuxiang Cai , Wannian Gao

Deep retrieval models are widely used for learning entity representations and recommendations. Federated learning provides a privacy-preserving way to train these models without requiring centralization of user data. However, federated deep…

Machine Learning · Computer Science 2021-11-03 Lin Ning , Karan Singhal , Ellie X. Zhou , Sushant Prakash

Counterfactual Explanations (CFEs) interpret machine learning models by identifying the smallest change to input features needed to change the model's prediction to a desired output. For classification tasks, CFEs determine how close a…

Machine Learning · Computer Science 2025-10-01 Margarita A. Guerrero , Cristian R. Rojas

Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential…

Information Retrieval · Computer Science 2021-03-22 Zhe Xie , Chengxuan Liu , Yichi Zhang , Hongtao Lu , Dong Wang , Yue Ding

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Identifying influential nodes in complex networks is a fundamental task in network analysis with wide-ranging applications across domains. While deep learning has advanced node influence detection, existing supervised approaches remain…

Social and Information Networks · Computer Science 2025-09-04 Yanmei Hu , Yihang Wu , Bing Sun , Xue Yue , Biao Cai , Xiangtao Li , Yang Chen

Recent learning-based correction approaches in EPI estimate a displacement field, unwarp the reversed-PE image pair with the estimated field, and average the unwarped pair to yield a corrected image. Unsupervised learning in these…

Image and Video Processing · Electrical Eng. & Systems 2023-10-12 Abdallah Zaid Alkilani , Tolga Çukur , Emine Ulku Saritas

Continuous word representation (aka word embedding) is a basic building block in many neural network-based models used in natural language processing tasks. Although it is widely accepted that words with similar semantics should be close to…

Computation and Language · Computer Science 2020-03-18 Chengyue Gong , Di He , Xu Tan , Tao Qin , Liwei Wang , Tie-Yan Liu

The rise of video-sharing platforms has attracted more and more people to shoot videos and upload them to the Internet. These videos mostly contain a carefully-edited background audio track, where serious speech change, pitch shifting and…

Sound · Computer Science 2020-10-27 Zhesong Yu , Xingjian Du , Bilei Zhu , Zejun Ma

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

The innate correlation between a person's face and voice has recently emerged as a compelling area of study, especially within the context of multilingual environments. This paper introduces our novel solution to the Face-Voice Association…

Sound · Computer Science 2024-08-20 Wuyang Chen , Yanjie Sun , Kele Xu , Yong Dou

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

In this work, we propose ENSEI, a secure inference (SI) framework based on the frequency-domain secure convolution (FDSC) protocol for the efficient execution of privacy-preserving visual recognition. Our observation is that, under the…

Cryptography and Security · Computer Science 2021-11-02 Song Bian , Tianchen Wang , Masayuki Hiromoto , Yiyu Shi , Takashi Sato

Current methods for detecting spurious correlations rely on analyzing dataset statistics or error patterns, leaving many harmful shortcuts invisible when counterexamples are absent. We introduce BEE (Bridging Explainability and Embeddings),…

Artificial Intelligence · Computer Science 2026-02-12 Cristian Daniel Păduraru , Antonio Bărbălau , Radu Filipescu , Andrei Liviu Nicolicioiu , Elena Burceanu

This paper investigates unsupervised representation learning for facial expression analysis. We think Unsupervised Facial Expression Representation (UFER) deserves exploration and has the potential to address some key challenges in facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Fanglei Xue , Yifan Sun , Yi Yang

This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images despite limited training data. Existing frequency-based paradigms have relied on frequency-level…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chuangchuang Tan , Yao Zhao , Shikui Wei , Guanghua Gu , Ping Liu , Yunchao Wei

Artificial intelligence (AI) has revolutionized software engineering (SE) by enhancing software development efficiency. The advent of pre-trained models (PTMs) leveraging transfer learning has significantly advanced AI for SE. However,…

Software Engineering · Computer Science 2024-04-25 Zixiang Xian , Rubing Huang , Dave Towey , Chunrong Fang , Zhenyu Chen

We propose Few-Example Clustering (FEC), a novel algorithm that performs contrastive learning to cluster few examples. Our method is composed of the following three steps: (1) generation of candidate cluster assignments, (2) contrastive…

Machine Learning · Computer Science 2022-07-12 Minguk Jang , Sae-Young Chung