中文
相关论文

相关论文: SOLAR 10.7B: Scaling Large Language Models with Si…

200 篇论文

We present Pangu Ultra, a Large Language Model (LLM) with 135 billion parameters and dense Transformer modules trained on Ascend Neural Processing Units (NPUs). Although the field of LLM has been witnessing unprecedented advances in pushing…

In recent years, the application of Large Language Models (LLMs) in healthcare has shown significant promise in improving the accessibility and dissemination of medical knowledge. This paper presents a detailed study of various LLMs trained…

计算与语言 · 计算机科学 2024-08-09 Haoran Yu , Chang Yu , Zihan Wang , Dongxian Zou , Hao Qin

Large language models (LLM) are advanced AI systems trained on extensive textual data, leveraging deep learning techniques to understand and generate human-like language. Today's LLMs with billions of parameters are so huge that hardly any…

分布式、并行与集群计算 · 计算机科学 2025-10-14 Sheikh Azizul Hakim , Saem Hasan

While recent advancements in commercial large language models (LM) have shown promising results in medical tasks, their closed-source nature poses significant privacy and security concerns, hindering their widespread use in the medical…

计算与语言 · 计算机科学 2024-07-02 Hyunjae Kim , Hyeon Hwang , Jiwoo Lee , Sihyeon Park , Dain Kim , Taewhoo Lee , Chanwoong Yoon , Jiwoong Sohn , Donghee Choi , Jaewoo Kang

Multilingual translation stands as a challenging task for large language models (LLMs) to handle intricate language patterns and stilted translations that arise in automated translations. In this paper, we introduce Seed-X, a family of…

Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise…

人工智能 · 计算机科学 2025-08-29 Ali AhmadiTeshnizi , Wenzhi Gao , Herman Brunborg , Shayan Talaei , Connor Lawless , Madeleine Udell

Large language models (LLMs) have greatly impacted the natural language processing (NLP) field, particularly for the English language. These models have demonstrated capabilities in understanding and generating human-like text. The success…

计算与语言 · 计算机科学 2024-07-10 Hasna Chouikhi , Manel Aloui , Cyrine Ben Hammou , Ghaith Chaabane , Haithem Kchaou , Chehir Dhaouadi

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

计算与语言 · 计算机科学 2025-06-26 Yubo Dong , Hehe Fan

Spoken Language Understanding (SLU) models are a core component of voice assistants (VA), such as Alexa, Bixby, and Google Assistant. In this paper, we introduce a pipeline designed to extend SLU systems to new languages, utilizing Large…

计算与语言 · 计算机科学 2024-04-04 Jakub Hoscilowicz , Pawel Pawlowski , Marcin Skorupa , Marcin Sowański , Artur Janicki

Large Language Models (LLMs) are increasingly adopted as evaluators, offering a scalable alternative to human annotation. However, existing supervised fine-tuning (SFT) approaches often fall short in domains that demand complex reasoning.…

计算与语言 · 计算机科学 2025-11-04 Nuo Chen , Zhiyuan Hu , Qingyun Zou , Jiaying Wu , Qian Wang , Bryan Hooi , Bingsheng He

Large language models (LLMs) have shown great potential to solve varieties of natural language processing (NLP) tasks, including mathematical reasoning. In this work, we present SkyMath, a large language model for mathematics with 13…

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on…

计算与语言 · 计算机科学 2024-04-30 Yichuan Li , Kaize Ding , Jianling Wang , Kyumin Lee

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. However, these advances have not been reflected in the translation task, especially those with moderate model sizes (i.e., 7B or 13B…

计算与语言 · 计算机科学 2024-02-07 Haoran Xu , Young Jin Kim , Amr Sharaf , Hany Hassan Awadalla

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

计算与语言 · 计算机科学 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Large Language Models (LLMs) have shown promise in highly-specialized domains, however challenges are still present in aspects of accuracy and costs. These limitations restrict the usage of existing models in domain-specific tasks. While…

计算与语言 · 计算机科学 2024-10-30 Iftach Arbel , Yehonathan Refael , Ofir Lindenbaum

A prior-informed large language model (LLM) driven multi-task learning framework is proposed for the unified description of multiple nuclear observables. By fine-tuning the pre-trained DeepSeek-R1-1.5B model with Low-Rank Adaptation (LoRA),…

核理论 · 物理学 2026-05-29 S. J. Guo , S. Y. Wang , E. H. Wang , Z. M. Niu , Y. M. Ding

Recent regulatory initiatives like the European AI Act and relevant voices in the Machine Learning (ML) community stress the need to describe datasets along several key dimensions for trustworthy AI, such as the provenance processes and…

数字图书馆 · 计算机科学 2024-05-27 Joan Giner-Miguelez , Abel Gómez , Jordi Cabot

Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions. Existing solutions…

计算与语言 · 计算机科学 2024-10-11 Yuan Sui , Jiaru Zou , Mengyu Zhou , Xinyi He , Lun Du , Shi Han , Dongmei Zhang

We introduce Dream 7B, the most powerful open diffusion large language model to date. Unlike autoregressive (AR) models that generate tokens sequentially, Dream 7B employs discrete diffusion modeling to refine sequences in parallel through…

计算与语言 · 计算机科学 2025-08-22 Jiacheng Ye , Zhihui Xie , Lin Zheng , Jiahui Gao , Zirui Wu , Xin Jiang , Zhenguo Li , Lingpeng Kong

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

机器学习 · 计算机科学 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique