English
Related papers

Related papers: CodeTransOcean: A Comprehensive Multilingual Bench…

200 papers

Code understanding and generation have fast become some of the most popular applications of language models (LMs). Nonetheless, research on multilingual aspects of Code-LMs (i.e., LMs for code generation) such as cross-lingual transfer…

Artificial Intelligence · Computer Science 2024-04-16 Indraneil Paul , Goran Glavaš , Iryna Gurevych

The use of multilingualism in the new generation is widespread in the form of code-mixed data on social media, and therefore a robust translation system is required for catering to the monolingual users, as well as for easier comprehension…

Computation and Language · Computer Science 2019-11-25 Sainik Kumar Mahata , Soumil Mandal , Dipankar Das , Sivaji Bandyopadhyay

The ability to match pieces of code to their corresponding natural language descriptions and vice versa is fundamental for natural language search interfaces to software repositories. In this paper, we propose a novel multi-perspective…

Software Engineering · Computer Science 2024-04-12 Rajarshi Haldar , Lingfei Wu , Jinjun Xiong , Julia Hockenmaier

The advent of large language models (LLMs) has ushered in a new era in automated code translation across programming languages. Since most code-specific LLMs are pretrained on well-commented code from large repositories like GitHub, it is…

Software Engineering · Computer Science 2026-01-26 Monika Gupta , Ajay Meena , Anamitra Roy Choudhury , Vijay Arya , Srikanta Bedathur

As software systems evolve, developers increasingly work across multiple programming languages and often face the need to migrate code from one language to another. While automatic code translation offers a promising solution, it has long…

Software Engineering · Computer Science 2025-12-09 Fazle Rabbi , Soumit Kanti Saha , Tri Minh Triet Pham , Song Wang , Jinqiu Yang

The inaccurate translation of numbers can lead to significant security issues, ranging from financial setbacks to medical inaccuracies. While large language models (LLMs) have made significant advancements in machine translation, their…

Computation and Language · Computer Science 2025-01-10 Wei Tang , Jiawei Yu , Yuang Li , Yanqing Zhao , Weidong Zhang , Wei Feng , Min Zhang , Hao Yang

Although large language models (LLMs) show promising potential in code translation, they still struggle to generate accurate translations using the commonly adopted direct code-to-code translation approach, which converts an original…

Software Engineering · Computer Science 2026-02-24 Songqiang Chen , Congying Xu , Jingyi Chen , Jialun Cao , Jiarong Wu , Shing-Chi Cheung

Practical needs of developing task-oriented dialogue assistants require the ability to understand many languages. Novel benchmarks for multilingual natural language understanding (NLU) include monolingual sentences in several languages,…

Computation and Language · Computer Science 2021-11-23 Alexey Birshert , Ekaterina Artemova

Large Language Models (LLMs) have revolutionized both general natural language processing and domain-specific applications such as code synthesis, legal reasoning, and finance. However, while prior studies have explored individual model…

Software Engineering · Computer Science 2025-12-05 Gunjan Das , Paheli Bhattacharya , Rishabh Gupta

Large foundation models are fundamentally transforming the software engineering landscape, demonstrating exceptional capabilities across diverse tasks such as code generation, debugging, and testing. Despite this rapid progress, a…

Software Engineering · Computer Science 2025-10-21 Shuzheng Gao , Eric John Li , Man Ho Lam , Jingyu Xiao , Yuxuan Wan , Chaozheng Wang , Ng Man Tik , Michael R. Lyu

Code generation and comprehension by Large Language Models (LLMs) have emerged as core drivers of industrial intelligence and decision optimization, finding widespread application in fields such as finance, automation, and aerospace.…

Software Engineering · Computer Science 2026-04-06 Puyu Zeng , Zhaoxi Wang , Zhixu Duan , Liang Feng , Shaobo Wang , Cunxiang Wang , Jinghang Wang , Bing Zhao , Hu Wei , Linfeng Zhang

Understanding code represents a core ability needed for automating software development tasks. While foundation models like LLMs show impressive results across many software engineering challenges, the extent of their true semantic…

Software Engineering · Computer Science 2025-04-16 Serge Lionel Nikiema , Jordan Samhi , Abdoul Kader Kaboré , Jacques Klein , Tegawendé F. Bissyandé

Representation learning of source code is essential for applying machine learning to software engineering tasks. Learning code representation from a multilingual source code dataset has been shown to be more effective than learning from…

Software Engineering · Computer Science 2022-12-07 Weiguo Pian , Hanyu Peng , Xunzhu Tang , Tiezhu Sun , Haoye Tian , Andrew Habib , Jacques Klein , Tegawendé F. Bissyandé

High-Level Synthesis (HLS) enables hardware design from C/C++ kernels but requires extensive transformations, such as restructuring code, inserting pragmas, adapting data types, and repairing non-synthesizable constructs, to achieve…

Hardware Architecture · Computer Science 2025-12-05 Qingyun Zou , Nuo Chen , Yao Chen , Bingsheng He , WengFei Wong

Large language models (LLMs) have made significant strides in code generation, achieving impressive capabilities in synthesizing code snippets from natural language instructions. However, a critical challenge remains in ensuring LLMs…

Computation and Language · Computer Science 2025-12-23 Jian Yang , Wei Zhang , Yizhi Li , Shawn Guo , Haowen Wang , Aishan Liu , Ge Zhang , Zili Wang , Zhoujun Li , Xianglong Liu , Weifeng Lv

The NLP community has witnessed steep progress in a variety of tasks across the realms of monolingual and multilingual language processing recently. These successes, in conjunction with the proliferating mixed language interactions on…

Computation and Language · Computer Science 2021-06-14 Sai Muralidhar Jayanthi , Kavya Nerella , Khyathi Raghavi Chandu , Alan W Black

The evaluation of Large Language Models (LLMs) for software engineering has shifted towards complex, repository-level tasks. However, existing benchmarks predominantly rely on coarse-grained pass rates that treat programming proficiency as…

Software Engineering · Computer Science 2026-01-08 Lingyue Fu , Hao Guan , Bolun Zhang , Haowei Yuan , Yaoming Zhu , Jun Xu , Zongyu Wang , Lin Qiu , Xunliang Cai , Xuezhi Cao , Weiwen Liu , Weinan Zhang , Yong Yu

This paper introduces Code-Vision, a benchmark designed to evaluate the logical understanding and code generation capabilities of Multimodal Large Language Models (MLLMs). It challenges MLLMs to generate a correct program that fulfills…

Computation and Language · Computer Science 2025-02-18 Hanbin Wang , Xiaoxuan Zhou , Zhipeng Xu , Keyuan Cheng , Yuxin Zuo , Kai Tian , Jingwei Song , Junting Lu , Wenhui Hu , Xueyang Liu

Code-switching is a data augmentation scheme mixing words from multiple languages into source lingual text. It has achieved considerable generalization performance of cross-lingual transfer tasks by aligning cross-lingual contextual word…

Computation and Language · Computer Science 2024-06-21 Zhuoran Li , Chunming Hu , Junfan Chen , Zhijun Chen , Xiaohui Guo , Richong Zhang

Existing navigation decision support systems often perform poorly when handling non-predefined navigation scenarios. Leveraging the generalization capabilities of large language model (LLM) in handling unknown scenarios, this research…

Artificial Intelligence · Computer Science 2025-02-25 Feng Ma , Xiu-min Wang , Chen Chen , Xiao-bin Xu , Xin-ping Yan