English
Related papers

Related papers: Cutting Through the Noise: Boosting LLM Performanc…

200 papers

When LLM agents work together, they seem to be more powerful than a single LLM in mathematical question answering. However, are they also more robust to adversarial inputs? We investigate this question using adversarially perturbed math…

Computation and Language · Computer Science 2026-03-17 Khashayar Alavi , Zhastay Yeltay , Lucie Flek , Akbar Karimi

Long-context large language models (LLMs) have recently shown strong performance in information retrieval and long-document QA. However, to tackle the most challenging intellectual problems, LLMs must reason effectively in long and complex…

Computation and Language · Computer Science 2025-02-11 Yang Zhou , Hongyi Liu , Zhuoming Chen , Yuandong Tian , Beidi Chen

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

With the increasing capabilities of large language models (LLMs), these high-performance models have achieved state-of-the-art results on a wide range of natural language processing (NLP) tasks. However, the models' performance on…

Computation and Language · Computer Science 2023-10-11 Guanting Dong , Jinxu Zhao , Tingfeng Hui , Daichi Guo , Wenlong Wan , Boqi Feng , Yueyan Qiu , Zhuoma Gongque , Keqing He , Zechen Wang , Weiran Xu

Mathematics is often perceived as a complex subject by students, leading to high failure rates in exams. To improve Mathematics skills, it is important to provide sample questions for students to practice problem-solving. Manually creating…

Despite their success in many natural language tasks, solving math problems remains a significant challenge for large language models (LLMs). A large gap exists between LLMs' pass-at-one and pass-at-N performance in solving math problems,…

Computation and Language · Computer Science 2023-10-17 Yixin Liu , Avi Singh , C. Daniel Freeman , John D. Co-Reyes , Peter J. Liu

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

Artificial Intelligence · Computer Science 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

Large Language Models (LLMs) have showcased remarkable capabilities in following human instructions. However, recent studies have raised concerns about the robustness of LLMs when prompted with instructions combining textual adversarial…

Computation and Language · Computer Science 2024-02-27 Yuansen Zhang , Xiao Wang , Zhiheng Xi , Han Xia , Tao Gui , Qi Zhang , Xuanjing Huang

The astonishing performance of large language models (LLMs) and their remarkable achievements in production and daily life have led to their widespread application in collaborative tasks. However, current large models face challenges such…

Computation and Language · Computer Science 2025-02-10 Xiaoyu Deng , Ye Zhang , Tianmin Guo , Yongzhe Zhang , Zhengjian Kang , Hang Yang

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

Computation and Language · Computer Science 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

Large Language Models (LLMs) can generate text by transferring style attributes like formality resulting in formal or informal text. However, instructing LLMs to generate text that when spoken, is more intelligible in an acoustically…

Computation and Language · Computer Science 2024-08-09 Anupama Chingacham , Miaoran Zhang , Vera Demberg , Dietrich Klakow

Instruction-tuning plays a vital role in enhancing the task-solving abilities of large language models (LLMs), improving their usability in generating helpful responses on various tasks. However, previous work has demonstrated that they are…

Computation and Language · Computer Science 2025-11-13 Ahmed Alajrami , Xingwei Tan , Nikolaos Aletras

We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K. To our knowledge, this is the first independent evaluation of ChatGPT. We found that…

Computation and Language · Computer Science 2023-03-01 Paulo Shakarian , Abhinav Koyyalamudi , Noel Ngu , Lakshmivihari Mareedu

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

The emergence of Large Language Models (LLMs) has shifted language model evaluation toward reasoning and problem-solving tasks as measures of general intelligence. Small Language Models (SLMs) -- defined here as models under 10B parameters…

Computation and Language · Computer Science 2026-01-08 Gabriel Benedict , Matthew Butler , Naved Merchant , Eetu Salama-Laine

Recent studies on post-training large language models (LLMs) for reasoning through reinforcement learning (RL) typically focus on tasks that can be accurately verified and rewarded, such as solving math problems. In contrast, our research…

Computation and Language · Computer Science 2025-05-29 Ang Lv , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Rui Yan

To guarantee safe and robust deployment of large language models (LLMs) at scale, it is critical to accurately assess their adversarial robustness. Existing adversarial attacks typically target harmful responses in single-point greedy…

Machine Learning · Computer Science 2026-02-24 Tim Beyer , Yan Scholten , Leo Schwinn , Stephan Günnemann

The deployment of large language models (LLMs) has raised security concerns due to their susceptibility to producing harmful or policy-violating outputs when exposed to adversarial prompts. While alignment and guardrails mitigate common…

Computation and Language · Computer Science 2026-01-23 Rishit Chugh

The rise of large language models (LLMs) offers new opportunities for automatic error detection in education, particularly for math word problems (MWPs). While prior studies demonstrate the promise of LLMs as error detectors, they overlook…

Computation and Language · Computer Science 2024-12-24 Hang Li , Tianlong Xu , Kaiqi Yang , Yucheng Chu , Yanling Chen , Yichi Song , Qingsong Wen , Hui Liu

Recent advancements in Large Language Models (LLMs) have generated growing interest in their structured reasoning capabilities, particularly in tasks involving abstraction and pattern recognition. The Abstraction and Reasoning Corpus (ARC)…

Artificial Intelligence · Computer Science 2025-04-25 Nikhil Khandalkar , Pavan Yadav , Krishna Shinde , Lokesh B. Ramegowda , Rajarshi Das