English
Related papers

Related papers: What Matters in Training a GPT4-Style Language Mod…

200 papers

Since the release of ChatGPT and GPT-4, large language models (LLMs) and multimodal large language models (MLLMs) have attracted widespread attention for their exceptional capabilities in understanding, reasoning, and generation,…

Computation and Language · Computer Science 2024-12-31 Hanguang Xiao , Feizhong Zhou , Xingyue Liu , Tianqi Liu , Zhipeng Li , Xin Liu , Xiaoxuan Huang

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Prompt design plays a critical role in the reasoning performance of large language models (LLMs), yet the impact of prompt specificity - how detailed or vague a prompt is - remains understudied. This paper introduces DETAIL, a framework for…

Computation and Language · Computer Science 2025-12-03 Olivia Kim

Large language models (LLMs) with instruction fine-tuning demonstrate superior generative capabilities. However, these models are resource-intensive. To alleviate this issue, we explore distilling knowledge from instruction-tuned LLMs into…

Computation and Language · Computer Science 2024-01-30 Minghao Wu , Abdul Waheed , Chiyu Zhang , Muhammad Abdul-Mageed , Alham Fikri Aji

Cybersecurity education is challenging and it is helpful for educators to understand Large Language Models' (LLMs') capabilities for supporting education. This study evaluates the effectiveness of LLMs in conducting a variety of penetration…

Cryptography and Security · Computer Science 2026-03-30 Martin Nizon-Deladoeuille , Brynjólfur Stefánsson , Helmut Neukirchen , Thomas Welsh

Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data…

Artificial Intelligence · Computer Science 2023-11-14 Shirui Pan , Yizhen Zheng , Yixin Liu

Phenotype-driven gene prioritization is a critical process in the diagnosis of rare genetic disorders for identifying and ranking potential disease-causing genes based on observed physical traits or phenotypes. While traditional approaches…

Quantitative Methods · Quantitative Biology 2024-04-04 Junyoung Kim , Jingye Yang , Kai Wang , Chunhua Weng , Cong Liu

Large language models (LLMs) are increasingly multilingual, yet open models continue to underperform relative to proprietary systems, with the gap most pronounced for African languages. Continued pre-training (CPT) offers a practical route…

Computation and Language · Computer Science 2026-05-06 Hao Yu , Tianyi Xu , Michael A. Hedderich , Wassim Hamidouche , Syed Waqas Zamir , David Ifeoluwa Adelani

Large language models (LLMs) have rapidly advanced natural language processing, driving significant breakthroughs in tasks such as text generation, machine translation, and domain-specific reasoning. The field now faces a critical dilemma…

Computation and Language · Computer Science 2025-10-15 Jiya Manchanda , Laura Boettcher , Matheus Westphalen , Jasser Jasser

Despite the remarkable capabilities of Large Language Models (LLMs) like GPT-4, producing complex, structured tabular data remains challenging. Our study assesses LLMs' proficiency in structuring tables and introduces a novel fine-tuning…

Computation and Language · Computer Science 2024-04-08 Xiangru Tang , Yiming Zong , Jason Phang , Yilun Zhao , Wangchunshu Zhou , Arman Cohan , Mark Gerstein

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning. However, the extensive model size and high training and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yizhang Jin , Jian Li , Yexin Liu , Tianjun Gu , Kai Wu , Zhengkai Jiang , Muyang He , Bo Zhao , Xin Tan , Zhenye Gan , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Recent advances in Large Language Models (LLMs) have presented new opportunities for integrating Artificial General Intelligence (AGI) into biological research and education. This study evaluated the capabilities of leading LLMs, including…

Computation and Language · Computer Science 2023-11-15 Xinyu Gong , Jason Holmes , Yiwei Li , Zhengliang Liu , Qi Gan , Zihao Wu , Jianli Zhang , Yusong Zou , Yuxi Teng , Tian Jiang , Hongtu Zhu , Wei Liu , Tianming Liu , Yajun Yan

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

Human-Computer Interaction · Computer Science 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger

Educational materials such as survey articles in specialized fields like computer science traditionally require tremendous expert inputs and are therefore expensive to create and update. Recently, Large Language Models (LLMs) have achieved…

Computation and Language · Computer Science 2024-05-24 Fan Gao , Hang Jiang , Rui Yang , Qingcheng Zeng , Jinghui Lu , Moritz Blum , Dairui Liu , Tianwei She , Yuang Jiang , Irene Li

Large Language Models (LLMs) display notable variation in multilingual behavior, yet the role of genealogical language structure in shaping this variation remains underexplored. In this paper, we investigate whether LLMs exhibit sensitivity…

Computation and Language · Computer Science 2025-10-27 Sandra Mitrović , David Kletz , Ljiljana Dolamic , Fabio Rinaldi

As large language models (LLMs) become more common in educational tools and programming environments, questions arise about how these systems should interact with users. This study investigates how different interaction styles with…

Human-Computer Interaction · Computer Science 2025-07-08 Kai Deng

Multilingual language models have gained significant attention in recent years, enabling the development of applications that meet diverse linguistic contexts. In this paper, we present a comprehensive evaluation of three popular…

Computation and Language · Computer Science 2024-02-14 Sina Bagheri Nezhad , Ameeta Agrawal

This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less…

Computation and Language · Computer Science 2024-06-28 Michael J. Parker , Caitlin Anderson , Claire Stone , YeaRim Oh

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

Computation and Language · Computer Science 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using supervised vision-language instruction data. Recent studies have shown that large language models can…

Machine Learning · Computer Science 2026-04-14 Lai Wei , Xiaozhe Li , Zihao Jiang , Weiran Huang , Lichao Sun