English
Related papers

Related papers: Large-Scale Contextualised Language Modelling for …

200 papers

Large language models have made significant progress in the past few years. However, they are either generic {\it or} field specific, splitting the community into different groups. In this paper, we unify these large language models into a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yuanhao Gong

Large language models (LLMs) have expanded from text to speech, giving rise to Speech Large Models (SLMs) that support recognition, translation, and synthesis. A key challenge is aligning speech and text representations, which becomes…

Computation and Language · Computer Science 2025-09-25 Pei Zhang , Andong Chen , Xi Chen , Baosong Yang , Derek F. Wong , Fei Huang

Training large neural language models on large datasets is resource- and time-intensive. These requirements create a barrier to entry, where those with fewer resources cannot build competitive models. This paper presents various techniques…

Computation and Language · Computer Science 2022-08-26 Manuel R. Ciosici , Leon Derczynski

Large language models (LLMs), renowned for their powerful conversational abilities, are widely recognized as exceptional tools in the field of education, particularly in the context of automated intelligent instruction systems for language…

Computation and Language · Computer Science 2024-07-19 Kaiqi Fu , Linkai Peng , Nan Yang , Shuran Zhou

Large Language Models (LLMs) have shown remarkable capabilities across a wide variety of Natural Language Processing (NLP) tasks and have attracted attention from multiple domains, including financial services. Despite the extensive…

Computation and Language · Computer Science 2025-01-14 Jean Lee , Nicholas Stevens , Soyeon Caren Han , Minseok Song

Pretrained language models have become the standard approach for many NLP tasks due to strong performance, but they are very expensive to train. We propose a simple and efficient learning framework, TLM, that does not rely on large-scale…

Computation and Language · Computer Science 2022-07-25 Xingcheng Yao , Yanan Zheng , Xiaocong Yang , Zhilin Yang

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Artificial Intelligence · Computer Science 2024-07-19 Tianyi Bai , Hao Liang , Binwang Wan , Yanran Xu , Xi Li , Shiyu Li , Ling Yang , Bozhou Li , Yifan Wang , Bin Cui , Ping Huang , Jiulong Shan , Conghui He , Binhang Yuan , Wentao Zhang

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao

Large language models (LLMs) are essential in natural language processing (NLP) but are costly in data collection, pre-training, fine-tuning, and inference. Task-specific small language models (SLMs) offer a cheaper alternative but lack…

Computation and Language · Computer Science 2024-10-25 Shrenik Bhansali , Alwin Jin , Tyler Lizzo , Larry Heck

Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels,…

Artificial Intelligence · Computer Science 2024-03-28 Christophe Servan , Sahar Ghannay , Sophie Rosset

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

Machine Learning · Computer Science 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

This open access book provides a comprehensive overview of the state of the art in research and applications of Foundation Models and is intended for readers familiar with basic Natural Language Processing (NLP) concepts. Over the recent…

Computation and Language · Computer Science 2023-02-20 Gerhard Paaß , Sven Giesselbach

Language representation models such as BERT could effectively capture contextual semantic information from plain text, and have been proved to achieve promising results in lots of downstream NLP tasks with appropriate fine-tuning. However,…

Computation and Language · Computer Science 2020-10-07 Deming Ye , Yankai Lin , Jiaju Du , Zhenghao Liu , Peng Li , Maosong Sun , Zhiyuan Liu

Large Language Models (LLMs) have emerged as one of the most important breakthroughs in NLP for their impressive skills in language generation and other language-specific tasks. Though LLMs have been evaluated in various tasks, mostly in…

Computation and Language · Computer Science 2024-03-20 Mohsinul Kabir , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Mir Tafseer Nayeem , M Saiful Bari , Enamul Hoque

Large Language Models (LLM's) have demonstrated considerable success in various Natural Language Processing tasks, but they have yet to attain state-of-the-art performance in Neural Machine Translation (NMT). Nevertheless, their significant…

Computation and Language · Computer Science 2024-03-20 Sai Koneru , Miriam Exel , Matthias Huck , Jan Niehues

Resolving semantic ambiguity has long been recognised as a central challenge in the field of Machine Translation. Recent work on benchmarking translation performance on ambiguous sentences has exposed the limitations of conventional Neural…

Computation and Language · Computer Science 2023-10-24 Vivek Iyer , Pinzhen Chen , Alexandra Birch

Large language models (LLMs) have been shown to perform well at a variety of syntactic, discourse, and reasoning tasks. While LLMs are increasingly deployed in many forms including conversational agents that interact with humans, we lack a…

Computation and Language · Computer Science 2024-04-02 Minje Choi , Jiaxin Pei , Sagar Kumar , Chang Shu , David Jurgens

The advent of Large Language Models (LLMs) has ushered in a new era for design science in Information Systems, demanding a paradigm shift in tailoring LLMs design for business contexts. We propose and test a novel framework to customize…

Computers and Society · Computer Science 2024-05-15 Wen Wang , Zhenyue Zhao , Tianshu Sun

The field of natural language processing (NLP) has recently witnessed a transformative shift with the emergence of foundation models, particularly Large Language Models (LLMs) that have revolutionized text-based NLP. This paradigm has…

Computation and Language · Computer Science 2024-12-02 Marco Gaido , Sara Papi , Matteo Negri , Luisa Bentivogli
‹ Prev 1 8 9 10 Next ›