English
Related papers

Related papers: Evaluation of Contrastive Learning with Various Co…

200 papers

Recent advances in large-scale code generation models have led to remarkable progress in producing high-quality code. These models are trained in a self-supervised manner on extensive unlabeled code corpora using a decoder-only…

Software Engineering · Computer Science 2026-02-12 Jiayi Lin , Yanlin Wang , Yibiao Yang , Lei Zhang , Yutao Xie

Having similar code fragments, also called clones, in software systems can lead to unnecessary comprehension, review and change efforts. Syntactically similar clones can often be encountered in practice. The same is not clear for only…

Software Engineering · Computer Science 2018-05-23 Verena Käfer , Stefan Wagner , Rainer Koschke

During the recent years, tampering of digital images has become a general habit among people and professionals. As a result, establishment of image authenticity has become a key issue in fields those make use of digital images.…

Multimedia · Computer Science 2014-07-28 Minati Mishra , M. C. Adhikary

Investigating the code fragments of code clones detected by code clone detection tools is a time-consuming task, especially when a large number of reference source files are available. This paper proposes (i) a method for clustering a clone…

Software Engineering · Computer Science 2021-10-05 Daisuke Nishioka , Toshihiro Kamiya

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

Machine Learning · Computer Science 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

This study aims to assess the performance of two advanced Large Language Models (LLMs), GPT-3.5 and GPT-4, in the task of code clone detection. The evaluation involves testing the models on a variety of code pairs of different clone types…

Software Engineering · Computer Science 2024-07-03 Zixian Zhang , Takfarinas Saber

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Recent studies highlight various machine learning (ML)-based techniques for code clone detection, which can be integrated into developer tools such as static code analysis. With the advancements brought by ML in code understanding, ML-based…

Software Engineering · Computer Science 2025-09-30 Teeradaj Racharak , Chaiyong Ragkhitwetsagul , Chayanee Junplong , Akara Supratak

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

The capability of accurately determining code similarity is crucial in many tasks related to software development. For example, it might be essential to identify code duplicates for performing software maintenance. This research introduces…

Software Engineering · Computer Science 2025-04-25 Jorge Martinez-Gil

Code clones are similar code fragments that often arise from copy-and-paste programming. Neural networks can classify pairs of code fragments as clone/not-clone with high accuracy. However, finding clones in industrial-scale code needs a…

Software Engineering · Computer Science 2025-04-28 Gul Aftab Ahmed , Muslim Chochlov , Abdul Razzaq , James Vincent Patten , Yuanhua Han , Guoxian Lu , Jim Buckley , David Gregg

Graph-level representations are critical in various real-world applications, such as predicting the properties of molecules. But in practice, precise graph annotations are generally very expensive and time-consuming. To address this issue,…

Machine Learning · Computer Science 2022-07-26 Shuai Lin , Pan Zhou , Zi-Yuan Hu , Shuojia Wang , Ruihui Zhao , Yefeng Zheng , Liang Lin , Eric Xing , Xiaodan Liang

We integrate contrastive learning (CL) with adversarial learning to co-optimize the robustness and accuracy of code models. Different from existing works, we show that code obfuscation, a standard code transformation operation, provides…

Machine Learning · Computer Science 2023-03-07 Jinghan Jia , Shashank Srikant , Tamara Mitrovska , Chuang Gan , Shiyu Chang , Sijia Liu , Una-May O'Reilly

Code clone detection plays a critical role in software maintenance and vulnerability analysis. Substantial methods have been proposed to detect code clones. However, they struggle to extract high-level program semantics directly from a…

Software Engineering · Computer Science 2026-02-06 Changguo Jia , Yi Zhan , Tianqi Zhao , Hengzhi Ye , Minghui Zhou

Duplicated code or code clones are a kind of code smell that have both positive and negative impacts on the development and maintenance of software systems. Software clone research in the past mostly focused on the detection and analysis of…

Software Engineering · Computer Science 2020-05-05 Chanchal K. Roy , Minhaz F. Zibran , Rainer Koschke

Code reuse is common in modern software development, but it can also spread vulnerabilities when developers unknowingly copy risky code. The code fragments that preserve the logic of known vulnerabilities are known as vulnerable code clones…

Code clones are identical or similar code segments. The wide existence of code clones can increase the cost of maintenance and jeopardise the quality of software. The research community has developed many techniques to detect code clones,…

Software Engineering · Computer Science 2022-04-12 Wahidur Rahman , Yisen Xu , Fan Pu , Jifeng Xuan , Xiangyang Jia , Michail Basios , Leslie Kanthan , Lingbo Li , Fan Wu , Baowen Xu