English
Related papers

Related papers: MGS3: A Multi-Granularity Self-Supervised Code Sea…

200 papers

Multi-Modal Self-Supervised Learning from videos has been shown to improve model's performance on various downstream tasks. However, such Self-Supervised pre-training requires large batch sizes and a large amount of computation resources…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Duo Wang , Salah Karout

With large-scale well-labeled datasets, deep learning has shown significant success in medical image segmentation. However, it is challenging to acquire abundant annotations in clinical practice due to extensive expertise requirements and…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Ziyuan Zhao , Jinxuan Hu , Zeng Zeng , Xulei Yang , Peisheng Qian , Bharadwaj Veeravalli , Cuntai Guan

Semantic code search technology allows searching for existing code snippets through natural language, which can greatly improve programming efficiency. Smart contracts, programs that run on the blockchain, have a code reuse rate of more…

Software Engineering · Computer Science 2021-11-30 Chaochen Shi , Yong Xiang , Jiangshan Yu , Longxiang Gao

Finding codes given natural language query isb eneficial to the productivity of software developers. Future progress towards better semantic matching between query and code requires richer supervised training resources. To remedy this, we…

Computation and Language · Computer Science 2021-05-28 Junjie Huang , Duyu Tang , Linjun Shou , Ming Gong , Ke Xu , Daxin Jiang , Ming Zhou , Nan Duan

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities across a wide range of vision-language tasks. However, due to the restricted input resolutions, MLLMs face significant challenges in precisely understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lu Zhang , Jiazuo Yu , Haomiao Xiong , Ping Hu , Yunzhi Zhuge , Huchuan Lu , You He

The progress made in code modeling has been tremendous in recent years thanks to the design of natural language processing learning approaches based on state-of-the-art model architectures. Nevertheless, we believe that the current…

Software Engineering · Computer Science 2022-02-22 Martin Weyssow , Houari Sahraoui , Bang Liu

Most complex machine learning and modelling techniques are prone to over-fitting and may subsequently generalise poorly to future data. Artificial neural networks are no different in this regard and, despite having a level of implicit…

Machine Learning · Statistics 2022-05-26 Vincent Szolnoky , Viktor Andersson , Balazs Kulcsar , Rebecka Jörnsten

Code retrieval techniques and tools have been playing a key role in facilitating software developers to retrieve existing code fragments from available open-source repositories given a user query. Despite the existing efforts in improving…

Software Engineering · Computer Science 2019-10-01 Yao Wan , Jingdong Shu , Yulei Sui , Guandong Xu , Zhou Zhao , Jian Wu , Philip S. Yu

Multi-domain detection of the machine-generated code snippets in various programming languages is a challenging task. SemEval-2026 Task~13 copes with this challenge in various angles, as a binary detection problem as well as attribution of…

Machine Learning · Computer Science 2026-04-24 Adam Skurla , Dominik Macko , Jakub Simko

Recent advancements in biology and chemistry have leveraged multi-modal learning, integrating molecules and their natural language descriptions to enhance drug discovery. However, current pre-training frameworks are limited to two…

Machine Learning · Computer Science 2025-02-05 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

Deep neural network models have achieved remarkable progress in 3D scene understanding while trained in the closed-set setting and with full labels. However, the major bottleneck is that these models do not have the capacity to recognize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kangcheng Liu , Yong-Jin Liu , Baoquan Chen

Neural visual decoding is a central problem in brain computer interface research, aiming to reconstruct human visual perception and to elucidate the structure of neural representations. However, existing approaches overlook a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yang Du , Siyuan Dai , Yonghao Song , Paul M. Thompson , Haoteng Tang , Liang Zhan

Leveraging supervised information can lead to superior retrieval performance in the image hashing domain but the performance degrades significantly without enough labeled data. One effective solution to boost performance is to employ…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Khoa D. Doan , Jianwen Xie , Yaxuan Zhu , Yang Zhao , Ping Li

Learning hash functions/codes for similarity search over multi-view data is attracting increasing attention, where similar hash codes are assigned to the data objects characterizing consistently neighborhood relationship across views.…

Machine Learning · Computer Science 2016-11-18 Lin Wu , Yang Wang

We approach the important challenge of code autocompletion as an open-domain task, in which a sequence-to-sequence code generator model is enhanced with the ability to attend to reference code snippets supplied by a semantic code search…

Information Retrieval · Computer Science 2021-04-14 Dawn Drain , Changran Hu , Chen Wu , Mikhail Breslav , Neel Sundaresan

Recent advances in large-scale code generation models have led to remarkable progress in producing high-quality code. These models are trained in a self-supervised manner on extensive unlabeled code corpora using a decoder-only…

Software Engineering · Computer Science 2026-02-12 Jiayi Lin , Yanlin Wang , Yibiao Yang , Lei Zhang , Yutao Xie

Semi-supervised learning through deep generative models and multi-lingual pretraining techniques have orchestrated tremendous success across different areas of NLP. Nonetheless, their development has happened in isolation, while the…

Computation and Language · Computer Science 2021-01-27 Yi Zhu , Ehsan Shareghi , Yingzhen Li , Roi Reichart , Anna Korhonen

Document images are a ubiquitous source of data where the text is organized in a complex hierarchical structure ranging from fine granularity (e.g., words), medium granularity (e.g., regions such as paragraphs or figures), to coarse…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zilong Wang , Jiuxiang Gu , Chris Tensmeyer , Nikolaos Barmpalios , Ani Nenkova , Tong Sun , Jingbo Shang , Vlad I. Morariu

Code clone detection is a fundamental task in software engineering that underpins refactoring, debugging, plagiarism detection, and vulnerability analysis. Existing methods often rely on singular representations such as abstract syntax…

Software Engineering · Computer Science 2025-10-29 Zixian Zhang , Takfarinas Saber

The continuous evolution of system specifications necessitates frequent evaluation of conflicting requirements, a process that is traditionally labour intensive. Although large language models (LLMs) have demonstrated significant potential…

Software Engineering · Computer Science 2026-03-26 Shreyas Patil , Pragati Kumari , Novarun Deb , Gouri Ginde