English
Related papers

Related papers: Why Do Open-Source LLMs Struggle with Data Analysi…

200 papers

The development of Large Language Models (LLMs) has led to significant advancements in natural language processing and enabled numerous applications across various industries. However, many LLM-based solutions operate as open systems…

Cryptography and Security · Computer Science 2025-03-05 Marian Lambert , Thomas Schuster , Nico Döring , Robin Krüger

Large Language Models (LLMs) are transforming human decision-making by acting as cognitive collaborators. Yet, this promise comes with a paradox: while LLMs can improve accuracy, they may also erode independent reasoning, promote…

Cryptography and Security · Computer Science 2025-09-09 Irdin Pekaric , Philipp Zech , Tom Mattson

This paper presents an analysis of open-source large language models (LLMs) and their application in Retrieval-Augmented Generation (RAG) tasks, specific for enterprise-specific data sets scraped from their websites. With the increasing…

Information Retrieval · Computer Science 2024-06-18 Gautam B , Anupam Purwar

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

This paper presents a comprehensive evaluation of cost-efficient Large Language Models (LLMs) for diverse biomedical tasks spanning both text and image modalities. We evaluated a range of closed-source and open-source LLMs on tasks such as…

Computation and Language · Computer Science 2025-07-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Large language models (LLMs) have significantly advanced natural language understanding and demonstrated strong problem-solving abilities. Despite these successes, most LLMs still struggle with solving mathematical problems due to the…

Computation and Language · Computer Science 2024-06-27 Meng Fang , Xiangpeng Wan , Fei Lu , Fei Xing , Kai Zou

Large language models (LLMs) have demonstrated remarkable capabilities across a broad spectrum of tasks. They have attracted significant attention and been deployed in numerous downstream applications. Nevertheless, akin to a double-edged…

Computation and Language · Computer Science 2023-11-28 Zishan Guo , Renren Jin , Chuang Liu , Yufei Huang , Dan Shi , Supryadi , Linhao Yu , Yan Liu , Jiaxuan Li , Bojian Xiong , Deyi Xiong

Reasoning has long been viewed as an emergent property of large language models (LLMs). However, recent studies challenge this assumption, showing that small language models (SLMs) can also achieve competitive reasoning performance. This…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Shuxiang Cao , Xuan Wang

Large Language Models (LLMs) have presented impressive performance across several transformative tasks. However, it is non-trivial to efficiently utilize large-scale cluster resources to develop LLMs, often riddled with numerous challenges…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Qinghao Hu , Zhisheng Ye , Zerui Wang , Guoteng Wang , Meng Zhang , Qiaoling Chen , Peng Sun , Dahua Lin , Xiaolin Wang , Yingwei Luo , Yonggang Wen , Tianwei Zhang

Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks…

This paper proposes a pipeline for quantitatively evaluating interactive Large Language Models (LLMs) using publicly available datasets. We carry out an extensive technical evaluation of LLMs using Big-Vul covering four different common…

Software Engineering · Computer Science 2024-07-09 Xin Yin , Chao Ni , Shaohua Wang

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

Computation and Language · Computer Science 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

Large language models (LLMs) with enormous pre-training tokens and parameters emerge diverse abilities, including math reasoning, code generation, and instruction following. These abilities are further enhanced by supervised fine-tuning…

Computation and Language · Computer Science 2024-06-10 Guanting Dong , Hongyi Yuan , Keming Lu , Chengpeng Li , Mingfeng Xue , Dayiheng Liu , Wei Wang , Zheng Yuan , Chang Zhou , Jingren Zhou

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

Artificial Intelligence · Computer Science 2025-02-24 Johan Boye , Birger Moell

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Post-training of Large Language Models (LLMs) is crucial for unlocking their task generalization potential and domain-specific capabilities. However, the current LLM post-training paradigm faces significant data challenges, including the…

Computation and Language · Computer Science 2025-10-31 Junyu Luo , Bohan Wu , Xiao Luo , Zhiping Xiao , Yiqiao Jin , Rong-Cheng Tu , Nan Yin , Yifan Wang , Jingyang Yuan , Wei Ju , Ming Zhang

Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-30 Daniel Nichols , Pranav Polasam , Harshitha Menon , Aniruddha Marathe , Todd Gamblin , Abhinav Bhatele

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains…

Computation and Language · Computer Science 2025-12-29 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Seraphina Zhang , Tianfu Wang , Nicholas Jing Yuan , Xing Xie , Hui Xiong

Low-resource languages serve as invaluable repositories of human history, embodying cultural evolution and intellectual diversity. Despite their significance, these languages face critical challenges, including data scarcity and…