English
Related papers

Related papers: GeMQuAD : Generating Multilingual Question Answeri…

200 papers

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

Computation and Language · Computer Science 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

Large language models (LLMs) with decoder-only architectures demonstrate remarkable in-context learning (ICL) capabilities. This feature enables them to effectively handle both familiar and novel tasks by utilizing examples provided within…

Information Retrieval · Computer Science 2024-09-25 Chaofan Li , MingHao Qin , Shitao Xiao , Jianlyu Chen , Kun Luo , Yingxia Shao , Defu Lian , Zheng Liu

Pretrained large language models (LLMs) are currently state-of-the-art for solving the vast majority of natural language processing tasks. While many real-world applications still require fine-tuning to reach satisfactory levels of…

Large language models (LLMs) have shown impressive abilities in answering questions across various domains, but they often encounter hallucination issues on questions that require professional and up-to-date knowledge. To address this…

Computation and Language · Computer Science 2025-03-03 Hansi Yang , Qi Zhang , Wei Jiang , Jianguo Li

Large Language Models (LLMs) have achieved impressive progress across a wide range of tasks, yet their heavy reliance on English-centric training data leads to significant performance degradation in non-English languages. While existing…

Computation and Language · Computer Science 2025-10-20 Hamin Koo , Jaehyung Kim

In the realm of education, student evaluation holds equal significance to imparting knowledge. To be evaluated, students usually need to go through text-based academic assessment methods. Instructors need to make a diverse set of questions…

Computation and Language · Computer Science 2025-09-30 Md. Alvee Ehsan , A. S. M Mehedi Hasan , Kefaya Benta Shahnoor , Syeda Sumaiya Tasneem

The language ability of Large Language Models (LLMs) is often unbalanced towards English because of the imbalance in the distribution of the pre-training data. This disparity is demanded in further fine-tuning and affecting the…

Computation and Language · Computer Science 2024-10-30 Leonardo Ranaldi , Giulia Pucci , Andre Freitas

Building machine translation (MT) systems for low-resource languages is notably difficult due to the scarcity of high-quality data. Although Large Language Models (LLMs) have improved MT system performance, adapting them to…

Computation and Language · Computer Science 2026-02-05 Luis Frentzen Salim , Esteban Carlin , Alexandre Morinvil , Xi Ai , Lun-Wei Ku

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

Computation and Language · Computer Science 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

Large language Models (LLMs) are usually used to answer questions, but many high-stakes applications (e.g., tutoring, clinical support) require the complementary skill of asking questions: detecting missing information, requesting…

Artificial Intelligence · Computer Science 2026-01-07 Rajeev Bhatt Ambati , Tianyi Niu , Aashu Singh , Shlok Mishra , Snigdha Chaturvedi , Shashank Srivastava

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

Despite their sophisticated capabilities, large language models (LLMs) encounter a major hurdle in effective assessment. This paper first revisits the prevalent evaluation method-multiple choice question answering (MCQA), which allows for…

Computation and Language · Computer Science 2024-03-13 Fangyun Wei , Xi Chen , Lin Luo

Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and…

Computation and Language · Computer Science 2024-07-02 Tal Schuster , Adam D. Lelkes , Haitian Sun , Jai Gupta , Jonathan Berant , William W. Cohen , Donald Metzler

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

Computation and Language · Computer Science 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large language models (LLMs) famously exhibit emergent in-context learning (ICL) -- the ability to rapidly adapt to new tasks using few-shot examples provided as a prompt, without updating the model's weights. Built on top of LLMs, vision…

Machine Learning · Computer Science 2025-04-02 Yongshuo Zong , Ondrej Bohdal , Timothy Hospedales

Long-context large language models (LLMs) are able to process inputs containing up to several million tokens. In the scope of in-context learning (ICL), this translates into using hundreds/thousands of demonstrations in the input prompt,…

Computation and Language · Computer Science 2025-09-03 Shahriar Golchin , Yanfei Chen , Rujun Han , Manan Gandhi , Tianli Yu , Swaroop Mishra , Mihai Surdeanu , Rishabh Agarwal , Chen-Yu Lee , Tomas Pfister

Few-shot learning for open domain multi-hop question answering typically relies on the incontext learning capability of large language models (LLMs). While powerful, these LLMs usually contain tens or hundreds of billions of parameters,…

Computation and Language · Computer Science 2024-02-14 Mingda Chen , Xilun Chen , Wen-tau Yih

The availability of large, high-quality datasets has been one of the main drivers of recent progress in question answering (QA). Such annotated datasets however are difficult and costly to collect, and rarely exist in languages other than…

Computation and Language · Computer Science 2023-08-08 Priyanka Agrawal , Chris Alberti , Fantine Huot , Joshua Maynez , Ji Ma , Sebastian Ruder , Kuzman Ganchev , Dipanjan Das , Mirella Lapata

Automating data generation with Large Language Models (LLMs) has become increasingly popular. In this work, we investigate the feasibility and effectiveness of LLM-based data generation in the challenging setting of source-grounded…

Computation and Language · Computer Science 2024-10-16 Lotem Golany , Filippo Galgani , Maya Mamo , Nimrod Parasol , Omer Vandsburger , Nadav Bar , Ido Dagan

The remarkable performance of large language models (LLMs) in zero-shot language understanding has garnered significant attention. However, employing LLMs for large-scale inference or domain-specific fine-tuning requires immense…

Computation and Language · Computer Science 2024-04-16 Ruohong Zhang , Yau-Shian Wang , Yiming Yang