English
Related papers

Related papers: TelcoLM: collecting data, adapting, and benchmarki…

200 papers

Instruction-tuned Large Language Models (LLMs) can perform a wide range of tasks given natural language instructions to do so, but they are sensitive to how such instructions are phrased. This issue is especially concerning in healthcare,…

Large Language Models (LLMs) have demonstrated unprecedented prowess across various natural language processing tasks in various application domains. Recent studies show that LLMs can be leveraged to perform lexical semantic tasks, such as…

Computation and Language · Computer Science 2024-07-30 Huu Tan Mai , Cuong Xuan Chu , Heiko Paulheim

Adapting large language models (LLMs) to new and diverse knowledge is essential for their lasting effectiveness in real-world applications. This survey provides an overview of state-of-the-art methods for expanding the knowledge of LLMs,…

Computation and Language · Computer Science 2025-02-19 Mingyang Wang , Alisa Stoll , Lukas Lange , Heike Adel , Hinrich Schütze , Jannik Strötgen

This paper introduces a multifaceted methodology for fine-tuning and evaluating large language models (LLMs) for specialized monetization tasks. The goal is to balance general language proficiency with domain-specific skills. The…

Computation and Language · Computer Science 2023-10-10 Zheng Zhang , Chen Zheng , Da Tang , Ke Sun , Yukun Ma , Yingtong Bu , Xun Zhou , Liang Zhao

The increasing size and complexity of pre-trained language models have demonstrated superior performance in many applications, but they usually require large training datasets to be adequately trained. Insufficient training sets could…

Computation and Language · Computer Science 2025-02-03 Yaping Chai , Haoran Xie , Joe S. Qin

Despite their outstanding performance, large language models (LLMs) suffer notorious flaws related to their preference for simple, surface-level textual relations over full semantic complexity of the problem. This proposal investigates a…

Computation and Language · Computer Science 2022-06-20 Michal Štefánik

Pre-trained Large Language Models (LLMs) have revolutionized text processing, yet adapting Transformer-based neural networks to non-textual scientific modalities typically requires specialized architectures and extensive computational…

Instrumentation and Methods for Astrophysics · Physics 2025-08-15 Nesar Ramachandra , Yuan-Sen Ting , Zechang Sun , Azton Wells , Salman Habib

Large Language Models(LLMs) have shown exceptional abilities, yet training these models can be quite challenging. There is a strong dependence on the quality of data and finding the best instruction tuning set. Further, the inherent…

Machine Learning · Computer Science 2024-06-28 Nikhil Kothari , Ravindra Nayak , Shreyas Shetty , Amey Patil , Nikesh Garera

Large Language Models (LLMs) have shown impressive versatility as general purpose models. However, their broad applicability comes at a high-cost computational overhead, particularly in auto-regressive decoding where each step requires a…

Computation and Language · Computer Science 2025-08-04 Itay Nakash , Nitay Calderon , Eyal Ben David , Elad Hoffer , Roi Reichart

The advancement of large language models (LLMs) has led to a greater challenge of having a rigorous and systematic evaluation of complex tasks performed, especially in enterprise applications. Therefore, LLMs need to be able to benchmark…

Computation and Language · Computer Science 2024-10-18 Bing Zhang , Mikio Takeuchi , Ryo Kawahara , Shubhi Asthana , Md. Maruf Hossain , Guang-Jie Ren , Kate Soule , Yada Zhu

The introduction of large language models (LLMs) has enhanced automation in software engineering tasks, including in Model Driven Engineering (MDE). However, using general-purpose LLMs for domain modeling has its limitations. One approach…

Software Engineering · Computer Science 2025-07-22 Vladyslav Bulhakov , Giordano d'Aloisio , Claudio Di Sipio , Antinisca Di Marco , Davide Di Ruscio

We study the limitations of Large Language Models (LLMs) for the task of response generation in human-machine dialogue. Several techniques have been proposed in the literature for different dialogue types (e.g., Open-Domain). However, the…

Computation and Language · Computer Science 2024-08-06 Simone Alghisi , Massimo Rizzoli , Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

Computation and Language · Computer Science 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

Decoder-only LLMs have shown impressive performance in MT due to their ability to learn from extensive datasets and generate high-quality translations. However, LLMs often struggle with the nuances and style required for…

Computation and Language · Computer Science 2024-09-11 Inacio Vieira , Will Allred , Séamus Lankford , Sheila Castilho , Andy Way

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

The networking field is characterized by its high complexity and rapid iteration, requiring extensive expertise to accomplish network tasks, ranging from network design, configuration, diagnosis and security. The inherent complexity of…

Networking and Internet Architecture · Computer Science 2024-04-30 Chang Liu , Xiaohui Xie , Xinggong Zhang , Yong Cui

Recent years have witnessed the rapid development of large language models (LLMs) in various domains. To better serve the large number of Chinese users, many commercial vendors in China have adopted localization strategies, training and…

Computation and Language · Computer Science 2024-02-06 Zongjie Li , Wenying Qiu , Pingchuan Ma , Yichen Li , You Li , Sijia He , Baozheng Jiang , Shuai Wang , Weixi Gu

Large Language Models (LLMs) fine-tuned for specific domains exhibit strong performance; however, the underlying mechanisms by which this fine-tuning reshapes their parametric space are not well understood. Prior works primarily focus on…

Computation and Language · Computer Science 2025-10-13 Eshaan Tanwar , Deepak Nathani , William Yang Wang , Tanmoy Chakraborty

This paper explores the potential of large language models (LLMs) for task automation in the provision of technical services in the production machinery sector. By focusing on text correction, summarization, and question answering, the…

General Economics · Economics 2025-05-19 Jochen Wulf , Juerg Meierhofer

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen