中文
相关论文

相关论文: Fine-Tuning Large Language Models for Scientific T…

200 篇论文

Large Language Models (LLMs) have been widely applied in various professional fields. By fine-tuning the models using domain specific question and answer datasets, the professional domain knowledge and Q\&A abilities of these models have…

计算与语言 · 计算机科学 2024-07-17 Qimin Yang , Rongsheng Wang , Jiexin Chen , Runqi Su , Tao Tan

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

计算与语言 · 计算机科学 2025-06-12 Yuxin Jiang

Large language models (LLMs) have shown exceptional performance on a variety of natural language tasks. Yet, their capabilities for HTML understanding -- i.e., parsing the raw HTML of a webpage, with applications to automation of web-based…

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

人工智能 · 计算机科学 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

LaTeX's precision and flexibility in typesetting have made it the gold standard for the preparation of scientific documentation. Large Language Models (LLMs) present a promising opportunity for researchers to produce publication-ready…

计算与语言 · 计算机科学 2025-09-16 Sahil Kale , Vijaykant Nadadur

Recent years have witnessed the burgeoning of pretrained language models (LMs) for text-based natural language (NL) understanding tasks. Such models are typically trained on free-form NL text, hence may not be suitable for tasks like…

计算与语言 · 计算机科学 2020-05-19 Pengcheng Yin , Graham Neubig , Wen-tau Yih , Sebastian Riedel

Materials discovery and development are critical for addressing global challenges. Yet, the exponential growth in materials science literature comprising vast amounts of textual data has created significant bottlenecks in knowledge…

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

计算与语言 · 计算机科学 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

Large language models (LLMs) such as GPT-4o and Claude Sonnet 4.5 have demonstrated strong capabilities in open-ended reasoning and generative language tasks, leading to their widespread adoption across a broad range of NLP applications.…

计算与语言 · 计算机科学 2026-02-09 Alberto Andres Valdes Gonzalez

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

Nowadays, billions of people engage in communication and express their opinions on the internet daily. Unfortunately, not all of these expressions are friendly or compliant, making content moderation an indispensable task. A common approach…

机器学习 · 计算机科学 2024-03-08 Huan Ma , Changqing Zhang , Huazhu Fu , Peilin Zhao , Bingzhe Wu

With the growing amount of text in health data, there have been rapid advances in large pre-trained models that can be applied to a wide variety of biomedical tasks with minimal task-specific modifications. Emphasizing the cost of these…

This work investigates the ability of open Large Language Models (LLMs) to predict citation intent through in-context learning and fine-tuning. Unlike traditional approaches relying on domain-specific pre-trained models like SciBERT, we…

计算与语言 · 计算机科学 2025-11-17 Paris Koloveas , Serafeim Chatzopoulos , Thanasis Vergoulis , Christos Tryfonopoulos

The rapid adoption of large language models (LLMs) such as ChatGPT has blurred the line between human and AI-generated texts, raising urgent questions about academic integrity, intellectual property, and the spread of misinformation. Thus,…

计算与语言 · 计算机科学 2025-09-26 Sharanya Parimanoharan , Ruwan D. Nawarathna

In 2012, the United Nations introduced 17 Sustainable Development Goals (SDGs) aimed at creating a more sustainable and improved future by 2030. However, tracking progress toward these goals is difficult because of the extensive scale and…

Large Language Models (LLMs), such as GPT-4 and Llama 2, show remarkable proficiency in a wide range of natural language processing (NLP) tasks. Despite their effectiveness, the high costs associated with their use pose a challenge. We…

计算与语言 · 计算机科学 2024-03-26 Bálint Csanády , Lajos Muzsai , Péter Vedres , Zoltán Nádasdy , András Lukács

Deep Contextual Language Models (LMs) like ELMO, BERT, and their successors dominate the landscape of Natural Language Processing due to their ability to scale across multiple tasks rapidly by pre-training a single model, followed by…

计算与语言 · 计算机科学 2021-12-21 Shaily Bhatt , Poonam Goyal , Sandipan Dandapat , Monojit Choudhury , Sunayana Sitaram

The evolution of Neural Machine Translation (NMT) has been significantly influenced by six core challenges (Koehn and Knowles, 2017), which have acted as benchmarks for progress in this field. This study revisits these challenges, offering…

计算与语言 · 计算机科学 2024-12-16 Jianhui Pang , Fanghua Ye , Longyue Wang , Dian Yu , Derek F. Wong , Shuming Shi , Zhaopeng Tu

Pre-training large-scale neural language models on raw texts has made a significant contribution to improving transfer learning in natural language processing (NLP). With the introduction of transformer-based language models, such as…

计算与语言 · 计算机科学 2024-05-08 Shoya Wada , Toshihiro Takeda , Shiro Manabe , Shozo Konishi , Jun Kamohara , Yasushi Matsumura

Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding. Recently, these models have extended their capabilities to coding tasks,…

机器学习 · 计算机科学 2024-10-23 Nishat Raihan , Mohammed Latif Siddiq , Joanna C. S. Santos , Marcos Zampieri