English
Related papers

Related papers: Diagnosing Capability Gaps in Fine-Tuning Data

200 papers

Ensuring large language model (LLM) reliability requires distinguishing objective unsolvability (inherent contradictions) from subjective capability limitations (tasks exceeding model competence). Current LLMs often conflate these…

Computation and Language · Computer Science 2026-02-03 Dengyun Peng , Qiguang Chen , Bofei Liu , Jiannan Guan , Libo Qin , Zheng Yan , Jinhao Liu , Jianshu Zhang , Wanxiang Che

The integration of Large Language Models (LLMs) into wireless networks presents significant potential for automating system design. However, unlike conventional throughput maximization, Covert Communication (CC) requires optimizing…

Networking and Internet Architecture · Computer Science 2026-03-11 Zhaozhi Liu , Jiaxin Chen , Yuanai Xie , Yuna Jiang , Minrui Xu , Xiao Zhang , Pan Lai , Zan Zhou

Fine-tuning pre-trained language models (PLMs) has demonstrated its effectiveness on various downstream NLP tasks recently. However, in many low-resource scenarios, the conventional fine-tuning strategies cannot sufficiently capture the…

Computation and Language · Computer Science 2021-11-15 Yusheng Su , Xu Han , Yankai Lin , Zhengyan Zhang , Zhiyuan Liu , Peng Li , Jie Zhou , Maosong Sun

Length generalization, the ability to solve problems longer than those seen during training, remains a critical challenge for large language models (LLMs). Previous work modifies positional encodings (PEs) and data formats to improve length…

Computation and Language · Computer Science 2025-05-20 Yi Hu , Shijia Kang , Haotong Yang , Haotian Xu , Muhan Zhang

As software becomes increasingly complex and prone to vulnerabilities, automated vulnerability detection is critically important, yet challenging. Given the significant successes of large language models (LLMs) in various tasks, there is…

Artificial Intelligence · Computer Science 2023-12-25 Zeyu Gao , Hao Wang , Yuchen Zhou , Wenyu Zhu , Chao Zhang

Multimodal Large Language Model (MLLM) have demonstrated strong generalization capabilities across diverse distributions and tasks, largely due to extensive pre-training datasets. Fine-tuning MLLM has become a common practice to improve…

Computation and Language · Computer Science 2024-11-19 Wenke Huang , Jian Liang , Zekun Shi , Didi Zhu , Guancheng Wan , He Li , Bo Du , Dacheng Tao , Mang Ye

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to…

Computation and Language · Computer Science 2024-03-25 Shangbin Feng , Weijia Shi , Yuyang Bai , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large language models (LLMs) encode extensive world knowledge through pre-training on massive datasets, which can then be fine-tuned for the question-answering (QA) task. However, effective strategies for fine-tuning LLMs for the QA task…

Computation and Language · Computer Science 2025-01-22 Junjie Ye , Yuming Yang , Qi Zhang , Tao Gui , Xuanjing Huang , Peng Wang , Zhongchao Shi , Jianping Fan

Large language models~(LLMs) present an intriguing avenue of exploration in the domain of formal theorem proving. Nonetheless, the full utilization of these models, particularly in terms of demonstration formatting and organization, remains…

Computation and Language · Computer Science 2023-05-29 Xueliang Zhao , Wenda Li , Lingpeng Kong

In this paper we present the first investigation into the effectiveness of Large Language Models (LLMs) for Failure Mode Classification (FMC). FMC, the task of automatically labelling an observation with a corresponding failure mode code,…

Computation and Language · Computer Science 2023-09-18 Michael Stewart , Melinda Hodkiewicz , Sirui Li

Leveraging Large Language Models (LLMs) for Knowledge Graph Completion (KGC) is promising but hindered by a fundamental granularity mismatch. LLMs operate on fragmented token sequences, whereas entities are the fundamental units in…

Computation and Language · Computer Science 2026-02-27 Siyue Su , Jian Yang , Bo Li , Guanglin Niu

Large Language Models (LLMs) have seen remarkable advancements, achieving state-of-the-art results in diverse applications. Fine-tuning, an important step for adapting LLMs to specific downstream tasks, typically involves further training…

Computation and Language · Computer Science 2026-04-07 Yuchen Yang , Wenze Lin , Enhao Huang , Zhixuan Chu , Hongbin Zhou , Lan Tao , Yiming Li , Zhan Qin , Kui Ren

Generative AI, particularly large language models (LLMs), is beginning to transform the financial industry by automating tasks and helping to make sense of complex financial information. One especially promising use case is the automatic…

Statistical Finance · Quantitative Finance 2025-11-11 Zonghan Wu , Congyuan Zou , Junlin Wang , Chenhan Wang , Hangjing Yang , Yilei Shao

Large language models (LLMs) are increasingly used in decision-making contexts, but when they present answers without signaling low confidence, users may unknowingly act on erroneous outputs. Prior work shows that LLMs maintain internal…

Computation and Language · Computer Science 2025-10-23 Mark Steyvers , Catarina Belem , Padhraic Smyth

Various Deep Learning-based approaches with pre-trained language models have been proposed for automatically repairing software vulnerabilities. However, these approaches are limited to a specific programming language (C/C++). Recent…

Software Engineering · Computer Science 2025-08-06 Dong wang , Junji Yu , Honglin Shu , Michael Fu , Chakkrit Tantithamthavorn , Yasutaka Kamei , Junjie Chen

As one of the key tools in many security tasks, decompilers reconstruct human-readable source code from binaries. Yet, despite recent advances, their outputs often suffer from syntactic and semantic errors and remain difficult to read.…

Cryptography and Security · Computer Science 2025-08-19 Muqi Zou , Hongyu Cai , Hongwei Wu , Zion Leonahenahe Basque , Arslan Khan , Berkay Celik , Dave , Tian , Antonio Bianchi , Ruoyu , Wang , Dongyan Xu

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Large Vision-Language Models (LVLMs) achieve strong performance on single-image tasks, but their performance declines when multiple images are provided as input. One major reason is the cross-image information leakage, where the model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Minyoung Lee , Yeji Park , Dongjun Hwang , Yejin Kim , Seong Joon Oh , Junsuk Choe

Large Language Models (LLMs) have shown great potential in supporting automated code review due to their impressive capabilities in context understanding and reasoning. However, these capabilities are still limited compared to human-level…

Software Engineering · Computer Science 2025-09-26 Yongda Yu , Guohao Shi , Xianwei Wu , Haochuan He , XueMing Gu , Qianqian Zhao , Kui Liu , Qiushi Wang , Zhao Tian , Haifeng Shen , Guoping Rong

Multilingual Large Language Models (LLMs) struggle with cross-lingual tasks due to data imbalances between high-resource and low-resource languages, as well as monolingual bias in pre-training. Existing methods, such as bilingual…

Computation and Language · Computer Science 2026-04-14 Weihua Zheng , Chang Liu , Zhengyuan Liu , Xin Huang , Kui Wu , Muhammad Huzaifah Md Shahrin , Aiti Aw , Roy Ka-Wei Lee