English
Related papers

Related papers: Beyond Gemini-3-Pro: Revisiting LLM Routing and Ag…

200 papers

In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, GPT-4o, Claude 3.5 Sonnet, Claude 3 Opus, Gemini 1.5 Pro, Llama 3, and Llama 3.1 in solving some selected undergraduate-level…

Artificial Intelligence · Computer Science 2024-08-16 Usman Syed , Ethan Light , Xingang Guo , Huan Zhang , Lianhui Qin , Yanfeng Ouyang , Bin Hu

Retrieval Augmented Generation (RAG) is emerging as a powerful technique to enhance the capabilities of Generative AI models by reducing hallucination. Thus, the increasing prominence of RAG alongside Large Language Models (LLMs) has…

Computation and Language · Computer Science 2025-11-06 Ranul Dayarathne , Uvini Ranaweera , Upeksha Ganegoda

Recent breakthroughs in generative reasoning have fundamentally reshaped how large language models (LLMs) address complex tasks, enabling them to dynamically retrieve, refine, and organize information into coherent multi-step reasoning…

Machine Learning · Computer Science 2026-01-06 Mohamed Amine Ferrag , Norbert Tihanyi , Merouane Debbah

This booklet, Unlocking the Wisdom of Multi-LLM Collaborative Intelligence, serves as an accessible introduction to the full volume The Path to Artificial General Intelligence. Through fourteen aphorisms, it distills the core principles of…

Artificial Intelligence · Computer Science 2025-04-16 Edward Y. Chang

Large language models (LLMs) have rapidly advanced natural language processing, driving significant breakthroughs in tasks such as text generation, machine translation, and domain-specific reasoning. The field now faces a critical dilemma…

Computation and Language · Computer Science 2025-10-15 Jiya Manchanda , Laura Boettcher , Matheus Westphalen , Jasser Jasser

Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured compression to…

Computation and Language · Computer Science 2026-02-06 Peijun Zhu , Ning Yang , Baoliang Tian , Jiayu Wei , Weihao Zhang , Haijun Zhang , Pin Lv

Closed large language models (LLMs) such as GPT-4 have set state-of-the-art results across a number of NLP tasks and have become central to NLP and machine learning (ML)-driven solutions. Closed LLMs' performance and wide adoption has…

Computation and Language · Computer Science 2025-03-18 Kezia Oketch , John P. Lalor , Yi Yang , Ahmed Abbasi

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Nowadays, DeepSeek, ChatGPT, and Google Gemini are the most trending and exciting Large Language Model (LLM) technologies for reasoning, multimodal capabilities, and general linguistic performance worldwide. DeepSeek employs a…

The proliferation of large language models (LLMs) has led to the adoption of Mixture-of-Experts (MoE) architectures that dynamically leverage specialized subnetworks for improved efficiency and performance. Despite their benefits, MoE…

Computation and Language · Computer Science 2024-10-28 Ruisi Cai , Yeonju Ro , Geon-Woo Kim , Peihao Wang , Babak Ehteshami Bejnordi , Aditya Akella , Zhangyang Wang

We introduce a new approach in which several advanced large language models-specifically GPT-4-0125-preview, Meta-LLAMA-3-70B-Instruct, Claude-3-Opus, and Gemini-1.5-Flash-collaborate to both produce and answer intricate, doctoral-level…

Balancing performance and efficiency is a central challenge in large language model (LLM) advancement. GPT-5 addresses this with test-time routing, dynamically assigning queries to either an efficient or a high-capacity model during…

Computation and Language · Computer Science 2025-10-23 Yiqun Zhang , Hao Li , Jianhao Chen , Hangfan Zhang , Peng Ye , Lei Bai , Shuyue Hu

Strategic model selection and reasoning settings are more effective than ensembling for optimizing automated scoring with large language models (LLMs). We examined self-consistency (intra-model majority voting) and reasoning effort for…

Computers and Society · Computer Science 2026-05-01 Scott Frohn

Understanding the limitations of Large Language Models, or LLMs, in mathematical reasoning has been the focus of several recent studies. However, the majority of these studies use the same datasets for benchmarking, which limits the…

Artificial Intelligence · Computer Science 2026-01-01 Samuel Golladay , Majid Bani-Yaghoub

Large Language Models (LLMs) are trained on massive amounts of data, enabling their application across diverse domains and tasks. Despite their remarkable performance, most LLMs are developed and evaluated primarily in English. Recently, a…

Computation and Language · Computer Science 2024-10-18 Krishno Dey , Prerona Tarannum , Md. Arid Hasan , Imran Razzak , Usman Naseem

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

The Third Generation Partnership Project (3GPP) has successfully introduced standards for global mobility. However, the volume and complexity of these standards has increased over time, thus complicating access to relevant information for…

Large language models (LLMs) are a special class of pretrained language models obtained by scaling model size, pretraining corpus and computation. LLMs, because of their large size and pretraining on large volumes of text data, exhibit…

Computation and Language · Computer Science 2023-10-20 Katikapalli Subramanyam Kalyan

This study investigates the challenges of translating low-resource languages by integrating Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG). Various model configurations were tested on Hakka translations, with BLEU…

Computation and Language · Computer Science 2025-05-19 Chen-Chi Chang , Chong-Fu Li , Chu-Hsuan Lee , Hung-Shin Lee

Large Language Models (LLMs) have demonstrated strong capabilities in natural language reasoning, yet their application to Cyber Threat Intelligence (CTI) remains limited. CTI analysis involves distilling large volumes of unstructured…

Cryptography and Security · Computer Science 2026-02-17 Md Tanvirul Alam , Dipkamal Bhusal , Salman Ahmad , Nidhi Rastogi , Peter Worth