English
Related papers

Related papers: Leveraging Large Language Models for Multiple Choi…

200 papers

Multi-modal open-domain question answering typically requires evidence retrieval from databases across diverse modalities, such as images, tables, passages, etc. Even Large Language Models (LLMs) like GPT-4 fall short in this task. To…

Computation and Language · Computer Science 2023-10-23 Le Zhang , Yihong Wu , Fengran Mo , Jian-Yun Nie , Aishwarya Agrawal

Multiple-Choice Questions (MCQs) constitute a critical area of research in the study of Large Language Models (LLMs). Previous works have investigated the selection bias problem in MCQs within few-shot scenarios, in which the LLM's…

Computation and Language · Computer Science 2024-06-07 Mengge Xue , Zhenyu Hu , Liqun Liu , Kuo Liao , Shuang Li , Honglin Han , Meng Zhao , Chengguo Yin

Finding preferences expressed in natural language is an important but challenging task. State-of-the-art(SotA) methods leverage transformer-based models such as BERT, RoBERTa, etc. and graph neural architectures such as graph attention…

Computation and Language · Computer Science 2023-10-13 Inwon Kang , Sikai Ruan , Tyler Ho , Jui-Chien Lin , Farhad Mohsin , Oshani Seneviratne , Lirong Xia

Large Vision-Language Models (LVLMs) have achieved strong performance on vision-language tasks, particularly Visual Question Answering (VQA). While prior work has explored unimodal biases in VQA, the problem of selection bias in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Md. Atabuzzaman , Ali Asgarov , Chris Thomas

Although large language models (LLMs) often produce impressive outputs, it remains unclear how they perform in real-world scenarios requiring strong reasoning skills and expert domain knowledge. We set out to investigate whether close- and…

Computation and Language · Computer Science 2023-12-27 Valentin Liévin , Christoffer Egeberg Hother , Andreas Geert Motzfeldt , Ole Winther

Large Language Models (LLMs) have shown remarkable capabilities across tasks, yet they often require additional prompting techniques when facing complex problems. While approaches like self-correction and response selection have emerged as…

Computation and Language · Computer Science 2025-04-15 Zichong Li , Xinyu Feng , Yuheng Cai , Zixuan Zhang , Tianyi Liu , Chen Liang , Weizhu Chen , Haoyu Wang , Tuo Zhao

Multiple Choice Question Answering (MCQA) is an important problem with numerous real-world applications, such as medicine, law, and education. The high cost of building MCQA datasets makes few-shot learning pivotal in this domain. While…

Computation and Language · Computer Science 2024-12-31 Patrick Sutanto , Joan Santoso , Esther Irawati Setiawan , Aji Prasetya Wibawa

Multiple-choice question answering (MCQA) is easy to evaluate but adds a meta-task: models must both solve the problem and output the symbol that *represents* the answer, conflating reasoning errors with symbol-binding failures. We study…

Computation and Language · Computer Science 2026-01-08 Hugh Mee Wong , Rick Nouwen , Albert Gatt

Large language models (LLMs) have rapidly advanced natural language processing, driving significant breakthroughs in tasks such as text generation, machine translation, and domain-specific reasoning. The field now faces a critical dilemma…

Computation and Language · Computer Science 2025-10-15 Jiya Manchanda , Laura Boettcher , Matheus Westphalen , Jasser Jasser

This study explores the effectiveness of Large Language Models (LLMs) for Automatic Question Generation in educational settings. Three LLMs are compared in their ability to create questions from university slide text without fine-tuning.…

Computation and Language · Computer Science 2024-09-17 Ivo Lodovico Molina , Valdemar Švábenský , Tsubasa Minematsu , Li Chen , Fumiya Okubo , Atsushi Shimada

Multiple choice question answering (MCQA) is popular for LLM evaluation due to its simplicity and human-like testing, but we argue for its reform. We first reveal flaws in MCQA's format, as it struggles to: 1) test generation/subjectivity;…

Computation and Language · Computer Science 2025-06-03 Nishant Balepur , Rachel Rudinger , Jordan Lee Boyd-Graber

The integration of artificial intelligence into various domains is rapidly increasing, with Large Language Models (LLMs) becoming more prevalent in numerous applications. This work is included in an overall project which aims to train an…

Computational Physics · Physics 2025-01-09 Christophe Bajan , Guillaume Lambard

Evaluating Video Language Models (VLMs) is a challenging task. Due to its transparency, Multiple-Choice Question Answering (MCQA) is widely used to measure the performance of these models through accuracy. However, existing MCQA benchmarks…

Computation and Language · Computer Science 2025-06-02 Olga Loginova , Oleksandr Bezrukov , Ravi Shekhar , Alexey Kravets

Multiple-choice questions (MCQs) are widely used in the evaluation of large language models (LLMs) due to their simplicity and efficiency. However, there are concerns about whether MCQs can truly measure LLM's capabilities, particularly in…

Computation and Language · Computer Science 2024-05-24 Wangyue Li , Liangzhi Li , Tong Xiang , Xiao Liu , Wei Deng , Noa Garcia

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

Machine Learning · Computer Science 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

While Large Language Models (LLMs) can achieve human-level performance in various tasks, they continue to face challenges when it comes to effectively tackling multi-step physics reasoning tasks. To identify the shortcomings of existing…

Computation and Language · Computer Science 2024-04-16 Avinash Anand , Janak Kapuriya , Apoorv Singh , Jay Saraf , Naman Lal , Astha Verma , Rushali Gupta , Rajiv Shah

Multiple choice questions (MCQs) serve as a common yet important task format in the evaluation of large language models (LLMs). This work shows that modern LLMs are vulnerable to option position changes in MCQs due to their inherent…

Computation and Language · Computer Science 2024-02-23 Chujie Zheng , Hao Zhou , Fandong Meng , Jie Zhou , Minlie Huang

In recent years, the use of large language models (LLMs) has significantly increased, and these models have demonstrated remarkable performance in a variety of general language tasks. However, the evaluation of their performance in…

Computation and Language · Computer Science 2025-01-14 Iman Barati , Arash Ghafouri , Behrouz Minaei-Bidgoli

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

Computation and Language · Computer Science 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li