English
Related papers

Related papers: Representation learning with a transformer by cont…

200 papers

With technological advances leading to an increase in mechanisms for image tampering, fraud detection methods must continue to be upgraded to match their sophistication. One problem with current methods is that they require prior knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Robin Elizabeth Yancey

Meta-learning algorithms adapt quickly to new tasks that are drawn from the same task distribution as the training tasks. The mechanism leading to fast adaptation is the conditioning of a downstream predictive model on the inferred…

Machine Learning · Computer Science 2021-07-23 Muhammad Waleed Gondal , Shruti Joshi , Nasim Rahaman , Stefan Bauer , Manuel Wüthrich , Bernhard Schölkopf

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Although transformer-based models have shown strong performance in word- and sentence-level tasks, effectively representing long documents, especially in fields like law and medicine, remains difficult. Sparse attention mechanisms can…

Computation and Language · Computer Science 2026-01-01 Waheed Ahmed Abro , Zied Bouraoui

How to obtain informative representations of transactions and then perform the identification of fraudulent transactions is a crucial part of ensuring financial security. Recent studies apply Graph Neural Networks (GNNs) to the transaction…

Machine Learning · Computer Science 2023-07-12 Yue Tian , Guanjun Liu

Contrastive learning has recently emerged as a promising approach for learning data representations that discover and disentangle the explanatory factors of the data. Previous analyses of such approaches have largely focused on individual…

Machine Learning · Computer Science 2023-11-09 Stefan Matthes , Zhiwei Han , Hao Shen

In this paper, we focused on using deep learning methods for detecting money laundering in financial transaction networks, in order to demonstrate that it can be used as a complement or instead of the more commonly used rule-based systems…

Machine Learning · Computer Science 2025-09-25 Mashkhal Abdalwahid Sidiq , Yimamu Kirubel Wondaferew

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by…

Machine Learning · Computer Science 2020-07-14 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Money laundering enables organized crime by moving illicit funds into the legitimate economy. Although trillions of dollars are laundered each year, detection rates remain low because launderers evade oversight, confirmed cases are rare,…

Social and Information Networks · Computer Science 2025-09-26 Johan Östman , Edvin Callisen , Anton Chen , Kristiina Ausmees , Emanuel Gårdh , Jovan Zamac , Jolanta Goldsteine , Hugo Wefer , Simon Whelan , Markus Reimegård

Anti-money laundering (AML) systems are important for protecting the global economy. However, conventional rule-based methods rely on domain knowledge, leading to suboptimal accuracy and a lack of scalability. Graph neural networks (GNNs)…

Machine Learning · Computer Science 2026-03-26 Chung-Hoo Poon , James Kwok , Calvin Chow , Jang-Hyeon Choi

How to weigh the Benjamini-Hochberg procedure? In the context of multiple hypothesis testing, we propose a new step-wise procedure that controls the false discovery rate (FDR) and we prove it to be more powerful than any weighted…

Statistics Theory · Mathematics 2009-07-13 Etienne Roquain , Mark Van De Wiel

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

Machine Learning · Statistics 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

A novel network-based approach is introduced to analyze banking systems, focusing on two main themes: identifying influential nodes within global banking networks using Bank for International Settlements data and developing an algorithm to…

Social and Information Networks · Computer Science 2025-03-12 Anthony Bonato , Juan Chavez Palan , Adam Szava

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

Time series forecasting (TSF) holds significant importance in modern society, spanning numerous domains. Previous representation learning-based TSF algorithms typically embrace a contrastive learning paradigm featuring segregated…

Machine Learning · Computer Science 2023-12-12 Jiaxin Gao , Yuxiao Hu , Qinglong Cao , Siqi Dai , Yuntian Chen

We propose TimeHUT, a novel method for learning time-series representations by hierarchical uniformity-tolerance balancing of contrastive representations. Our method uses two distinct losses to learn strong representations with the aim of…

Machine Learning · Computer Science 2025-10-06 Amin Jalali , Milad Soltany , Michael Greenspan , Ali Etemad

We present a representation learning framework for financial time series forecasting. One challenge of using deep learning models for finance forecasting is the shortage of available training data when using small datasets. Direct trend…

Machine Learning · Computer Science 2021-05-10 Hanwei Wu , Ather Gattami , Markus Flierl

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

We present a study on the efficacy of adversarial training on transformer neural network models, with respect to the task of detecting check-worthy claims. In this work, we introduce the first adversarially-regularized, transformer-based…

Computation and Language · Computer Science 2020-05-22 Kevin Meng , Damian Jimenez , Fatma Arslan , Jacob Daniel Devasier , Daniel Obembe , Chengkai Li

In this article, we propose a generalized weighted version of the well-known Benjamini-Hochberg (BH) procedure. The rigorous weighting scheme used by our method enables it to encode structural information from simultaneous multi-way…

Methodology · Statistics 2021-05-25 Shinjini Nandi , Sanat K. Sarkar