中文
相关论文

相关论文: Cerbero-7B: A Leap Forward in Language-Specific LL…

200 篇论文

This paper presents the outcomes of fine-tuning Mistral 7B, a general-purpose large language model (LLM), for adaptive machine translation (MT). The fine-tuning process involves utilising a combination of zero-shot and one-shot translation…

计算与语言 · 计算机科学 2023-12-21 Yasmin Moslem , Rejwanul Haque , Andy Way

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

计算与语言 · 计算机科学 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

计算与语言 · 计算机科学 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

Adapting large language models (LLMs) to new languages typically involves continual pre-training (CT) followed by supervised fine-tuning (SFT). However, this CT-then-SFT approach struggles with limited data in the context of low-resource…

计算与语言 · 计算机科学 2025-02-10 Mingxu Tao , Chen Zhang , Quzhe Huang , Tianyao Ma , Songfang Huang , Dongyan Zhao , Yansong Feng

A model is considered well-calibrated when its probability estimate aligns with the actual likelihood of the output being correct. Calibrating language models (LMs) is crucial, as it plays a vital role in detecting and mitigating…

计算与语言 · 计算机科学 2024-03-14 Xin Liu , Muhammad Khalifa , Lu Wang

Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving. While many strategies and datasets to enhance LLMs' mathematics are…

计算与语言 · 计算机科学 2024-04-04 Yifan Xu , Xiao Liu , Xinghan Liu , Zhenyu Hou , Yueyan Li , Xiaohan Zhang , Zihan Wang , Aohan Zeng , Zhengxiao Du , Wenyi Zhao , Jie Tang , Yuxiao Dong

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

计算与语言 · 计算机科学 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

This study aims to innovatively explore adaptive applications of large language models (LLM) in urban renewal. It also aims to improve its performance and text generation quality for knowledge question-answering (QA) tasks. Based on the…

计算与语言 · 计算机科学 2023-11-28 Xi Wang , Xianyao Ling , Tom Zhang , Xuecao Li , Shaolan Wang , Zhixing Li , Liang Zhang , Peng Gong

There have been many recent advances in the fields of generative Artificial Intelligence (AI) and Large Language Models (LLM), with the Generative Pre-trained Transformer (GPT) model being a leading "chatbot." LLM-based chatbots have become…

计算与语言 · 计算机科学 2024-08-12 Gauri Anil Godghase , Rishit Agrawal , Tanush Obili , Mark Stamp

This study constructed a Japanese chat dataset for tuning large language models (LLMs), which consist of about 8.4 million records. Recently, LLMs have been developed and gaining popularity. However, high-performing LLMs are usually mainly…

计算与语言 · 计算机科学 2023-05-23 Masanori Hirano , Masahiro Suzuki , Hiroki Sakaji

With the emergence of Transformer architectures and their powerful understanding of textual data, a new horizon has opened up to predict the molecular properties based on text description. While SMILES are the most common form of…

化学物理 · 物理学 2023-10-11 Suryanarayanan Balaji , Rishikesh Magar , Yayati Jadhav , Amir Barati Farimani

Recently, large language models (LLMs) have expanded into various domains. However, there remains a need to evaluate how these models perform when prompted with commonplace queries compared to domain-specific queries, which may be useful…

计算与语言 · 计算机科学 2024-08-22 Oluyemi Enoch Amujo , Shanchieh Jay Yang

In recent years, Large Language Models (LLMs) have made significant strides towards Artificial General Intelligence. However, training these models from scratch requires substantial computational resources and vast amounts of text data. In…

计算与语言 · 计算机科学 2024-10-03 Wenzhen Zheng , Wenbo Pan , Xu Xu , Libo Qin , Li Yue , Ming Zhou

Large Language Models (LLMs), such as ChatGPT, have demonstrated the capability to generate human like, natural responses across a range of tasks, including task oriented dialogue and question answering. However, their application in real…

计算与语言 · 计算机科学 2025-05-01 Naheed Rayhan , Md. Ashrafuzzaman

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

计算与语言 · 计算机科学 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

While modern masked language models (LMs) are trained on ever larger corpora, we here explore the effects of down-scaling training to a modestly-sized but representative, well-balanced, and publicly available English text source -- the…

计算与语言 · 计算机科学 2023-05-09 David Samuel , Andrey Kutuzov , Lilja Øvrelid , Erik Velldal

Large Language Models (LLMs) have gained significant attention in the field of natural language processing (NLP) due to their wide range of applications. However, training LLMs for languages other than English poses significant challenges,…

计算与语言 · 计算机科学 2024-05-20 Yudong Li , Yuhao Feng , Wen Zhou , Zhe Zhao , Linlin Shen , Cheng Hou , Xianxu Hou

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

计算与语言 · 计算机科学 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…