English
Related papers

Related papers: Evaluating Cross-lingual Knowledge Consistency in …

200 papers

We consider the well-known and important tasks of clone detection and information retrieval for source code. The most standard setup is to search clones inside the same language code snippets. But it is also useful to find code snippets…

Computation and Language · Computer Science 2024-12-16 Anton Tikhonov , Nikita Sorokin , Dmitry Abulkhanov , Irina Piontkovskaya , Sergey Nikolenko , Valentin Malykh

Analogies test a model's ability to infer implicit relationships between concepts, making them a key benchmark for evaluating reasoning capabilities. While large language models (LLMs) are widely evaluated for reasoning in English, their…

Computation and Language · Computer Science 2025-07-25 Ashray Gupta , Rohan Joseph , Sunny Rai

Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that the application of…

Computation and Language · Computer Science 2018-04-25 Irshad Ahmad Bhat , Riyaz Ahmad Bhat , Manish Shrivastava , Dipti Misra Sharma

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang

Multilingual Large Language Models(MLLMs) demonstrate strong generalization across languages, yet they remain prone to hallucinations, especially in low-resource languages, due to training data imbalances. These hallucinations, which…

Computation and Language · Computer Science 2025-07-22 Weihua Zheng , Roy Ka-Wei Lee , Zhengyuan Liu , Kui Wu , AiTi Aw , Bowei Zou

We present a novel approach to data preparation for developing multilingual Indic large language model. Our meticulous data acquisition spans open-source and proprietary sources, including Common Crawl, Indic books, news articles, and…

Finding codes given natural language query isb eneficial to the productivity of software developers. Future progress towards better semantic matching between query and code requires richer supervised training resources. To remedy this, we…

Computation and Language · Computer Science 2021-05-28 Junjie Huang , Duyu Tang , Linjun Shou , Ming Gong , Ke Xu , Daxin Jiang , Ming Zhou , Nan Duan

Multilingual programming, which involves using multiple programming languages (PLs) in a single project, is increasingly common due to its benefits. However, it introduces cross-language bugs (CLBs), which arise from interactions between…

Software Engineering · Computer Science 2026-04-22 Zengyang Li , Yimeng Li , Binbin Huang , Peng Liang , Ran Mo , Hui Liu , Yutao Ma

Large-scale cross-lingual pre-trained language models (xPLMs) have shown effectiveness in cross-lingual sequence labeling tasks (xSL), such as cross-lingual machine reading comprehension (xMRC) by transferring knowledge from a high-resource…

Computation and Language · Computer Science 2022-04-12 Nuo Chen , Linjun Shou , Ming Gong , Jian Pei , Daxin Jiang

Just like the previous generation of task-tuned models, large language models (LLMs) that are adapted to tasks via prompt-based methods like in-context-learning (ICL) perform well in some setups but not in others. This lack of consistency…

Computation and Language · Computer Science 2023-12-11 Lucas Weber , Elia Bruni , Dieuwke Hupkes

Consistency, which refers to the capability of generating the same predictions for semantically similar contexts, is a highly desirable property for a sound language understanding model. Although recent pretrained language models (PLMs)…

Computation and Language · Computer Science 2021-08-17 Myeongjun Jang , Deuk Sin Kwon , Thomas Lukasiewicz

India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-04 Mari Ganesh Kumar , Jom Kuriakose , Anand Thyagachandran , Arun Kumar A , Ashish Seth , Lodagala Durga Prasad , Saish Jaiswal , Anusha Prakash , Hema Murthy

NLP research on aligning lexical representation spaces to one another has so far focused on aligning language spaces in their entirety. However, cognitive science has long focused on a local perspective, investigating whether translation…

Computation and Language · Computer Science 2024-10-11 Taelin Karidi , Eitan Grossman , Omri Abend

This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs. To enhance translation quality in this low-resource scenario, we…

Computation and Language · Computer Science 2025-07-29 Xuchen Wei , Yangxin Wu , Yaoyin Zhang , Henglyu Liu , Kehai Chen , Xuefeng Bai , Min Zhang

This paper investigates the cross-lingual inconsistencies observed in Large Language Models (LLMs), such as ChatGPT, Llama, and Baichuan, which have shown exceptional performance in various Natural Language Processing (NLP) tasks. Despite…

Computation and Language · Computer Science 2024-07-02 Xiaolin Xing , Zhiwei He , Haoyu Xu , Xing Wang , Rui Wang , Yu Hong

In this work, we propose a new approach for language identification using multi-head self-attention combined with raw waveform based 1D convolutional neural networks for Indian languages. Our approach uses an encoder, multi-head…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Krishna D N , Ankita Patil

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Human listeners readily adjust to unfamiliar speakers and language varieties through exposure, but do these adaptation benefits extend to state-of-the-art spoken language models? We introduce a scalable framework that allows for in-context…

Computation and Language · Computer Science 2025-05-22 Nathan Roll , Calbert Graham , Yuka Tatsumi , Kim Tien Nguyen , Meghan Sumner , Dan Jurafsky

In a multilingual or sociolingual configuration Intra-sentential Code Switching (ICS) or Code Mixing (CM) is frequently observed nowadays. In the world, most of the people know more than one language. CM usage is especially apparent in…

Computation and Language · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

In this work, we present the development of a reverse transliteration model to convert romanized Malayalam to native script using an encoder-decoder framework built with attention-based bidirectional Long Short Term Memory (Bi-LSTM)…

Computation and Language · Computer Science 2024-12-16 Bajiyo Baiju , Kavya Manohar , Leena G Pillai , Elizabeth Sherly