English
Related papers

Related papers: Learning-From-Mistakes Prompting for Indigenous La…

200 papers

Conversational query rewriting is crucial for effective conversational search, yet traditional supervised methods require substantial labeled data, which is scarce in low-resource settings. This paper introduces Prompt-Guided In-Context…

Computation and Language · Computer Science 2025-02-24 Raymond Wilson , Chase Carter , Cole Graham

Partly automated creation of interlinear glossed text (IGT) has the potential to assist in linguistic documentation. We argue that LLMs can make this process more accessible to linguists because of their capacity to follow natural-language…

Computation and Language · Computer Science 2025-03-25 Micha Elsner , David Liu

Imposing constraints on machine translation systems presents a challenging issue because these systems are not trained to make use of constraints in generating adequate, fluent translations. In this paper, we leverage the capabilities of…

Computation and Language · Computer Science 2024-07-19 Pengcheng Huang , Yongyu Mu , Yuzhang Wu , Bei Li , Chunyang Xiao , Tong Xiao , Jingbo Zhu

Low-resource languages (LRLs) face challenges in supervised neural machine translation due to limited parallel data, prompting research into unsupervised methods. Unsupervised neural machine translation (UNMT) methods, including…

Computation and Language · Computer Science 2024-01-17 Shilong Pan , Zhiliang Tian , Liang Ding , Zhen Huang , Zhihua Wen , Dongsheng Li

Low-resource languages pose a challenge for machine translation with large language models (LLMs), which require large amounts of training data. One potential way to circumvent this data dependence is to rely on LLMs' ability to use…

Computation and Language · Computer Science 2026-04-09 Jackson Petty , Jaulie Goe , Tal Linzen

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Language models (LLMs) offer potential as a source of knowledge for agents that need to acquire new task competencies within a performance environment. We describe efforts toward a novel agent capability that can construct cues (or…

Machine Learning · Computer Science 2022-11-22 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios

Evaluating large language models (LLMs) on their linguistic reasoning capabilities is an important task to understand the gaps in their skills that may surface during large-scale adoption. In this work, we investigate the abilities of such…

Computation and Language · Computer Science 2024-12-25 Raghav Ramji , Keshav Ramji

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

Computation and Language · Computer Science 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

Learned metrics such as BLEURT have in recent years become widely employed to evaluate the quality of machine translation systems. Training such metrics requires data which can be expensive and difficult to acquire, particularly for…

Computation and Language · Computer Science 2023-02-08 Amirkeivan Mohtashami , Mauro Verzetti , Paul K. Rubenstein

Neural Machine translation is a challenging task due to the inherent complex nature and the fluidity that natural languages bring. Nonetheless, in recent years, it has achieved state-of-the-art performance in several language pairs.…

Computation and Language · Computer Science 2023-04-19 Vakul Goyle , Parvathy Krishnaswamy , Kannan Girija Ravikumar , Utsa Chattopadhyay , Kartikay Goyle

While large language models (LLMs) have been pre-trained on multilingual corpora, their performance still lags behind in most languages compared to a few resource-rich languages. One common approach to mitigate this issue is to translate…

Computation and Language · Computer Science 2024-02-20 Yuanchi Zhang , Yile Wang , Zijun Liu , Shuo Wang , Xiaolong Wang , Peng Li , Maosong Sun , Yang Liu

Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LRLs). However, conventional single-stage fine-tuning methods…

Computation and Language · Computer Science 2025-03-31 Sarubi Thillainathan , Songchen Yuan , En-Shiun Annie Lee , Sanath Jayasena , Surangika Ranathunga

No-resource languages - those with minimal or no digital representation - pose unique challenges for machine translation (MT). Unlike low-resource languages, which rely on limited but existent corpora, no-resource languages often have fewer…

Computation and Language · Computer Science 2025-06-03 Madhavendra Thakur

Large Language Models (LLM) have demonstrated their strong ability in the field of machine translation (MT), yet they suffer from high computational cost and latency. Therefore, transferring translation knowledge from giant LLMs to…

Computation and Language · Computer Science 2024-04-02 Jiahuan Li , Shanbo Cheng , Shujian Huang , Jiajun Chen

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai

Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however,…

Computation and Language · Computer Science 2024-09-04 Zhuo Li , Yuhao Du , Jinpeng Hu , Xiang Wan , Anningzhe Gao

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen