English
Related papers

Related papers: Self-Specialization: Uncovering Latent Expertise w…

200 papers

Convolutional neural networks trained using manually generated labels are commonly used for semantic or instance segmentation. In precision agriculture, automated flower detection methods use supervised models and post-processing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Abubakar Siddique , Amy Tabb , Henry Medeiros

A desirable trait of an artificial agent acting in the visual world is to continually learn a sequence of language-informed tasks while striking a balance between sufficiently specializing in each task and building a generalized knowledge…

Computation and Language · Computer Science 2023-12-22 Kyra Ahrens , Lennart Bengtson , Jae Hee Lee , Stefan Wermter

Large-scale surveys are essential tools for informing social science research and policy, but running surveys is costly and time-intensive. If we could accurately simulate group-level survey results, this would therefore be very valuable to…

Computation and Language · Computer Science 2025-02-20 Yong Cao , Haijiang Liu , Arnav Arora , Isabelle Augenstein , Paul Röttger , Daniel Hershcovich

The increasing use of tools and solutions based on Large Language Models (LLMs) for various tasks in the medical domain has become a prominent trend. Their use in this highly critical and sensitive domain has thus raised important questions…

Computation and Language · Computer Science 2024-01-09 Jean-Baptiste Excoffier , Tom Roehr , Alexei Figueroa , Jens-Michalis Papaioannou , Keno Bressem , Matthieu Ortala

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

Computation and Language · Computer Science 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

Large Language Models(LLMs) have shown exceptional abilities, yet training these models can be quite challenging. There is a strong dependence on the quality of data and finding the best instruction tuning set. Further, the inherent…

Machine Learning · Computer Science 2024-06-28 Nikhil Kothari , Ravindra Nayak , Shreyas Shetty , Amey Patil , Nikesh Garera

Large language models (LLMs) show best-in-class performance across a wide range of natural language processing applications. Training these models is an extremely computationally expensive task; frontier Artificial Intelligence (AI)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-10 Alexander Interrante-Grant , Carla Varela-Rosa , Suhaas Narayan , Chris Connelly , Albert Reuther

Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical…

Computation and Language · Computer Science 2024-09-24 Jinqiang Wang , Huansheng Ning , Yi Peng , Qikai Wei , Daniel Tesfai , Wenwei Mao , Tao Zhu , Runhe Huang

Small language models fine-tuned for graph property estimation have demonstrated strong in-distribution performance, yet their generalization capabilities beyond training conditions remain poorly understood. In this work, we systematically…

Machine Learning · Computer Science 2026-04-21 Michal Podstawski

Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges…

Human-Computer Interaction · Computer Science 2024-07-31 Lin Gao , Jing Lu , Zekai Shao , Ziyue Lin , Shengbin Yue , Chiokit Ieong , Yi Sun , Rory James Zauner , Zhongyu Wei , Siming Chen

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

Information Retrieval · Computer Science 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they are expected to gain implicit knowledge. In this paper, we…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba

The advent of transformer-based architectures and large language models (LLMs) have significantly advanced the performance of natural language processing (NLP) models. Since these LLMs are trained on huge corpuses of data from the web and…

Computation and Language · Computer Science 2024-08-29 Arkadeep Baksi , Rahul Singh , Tarun Joshi

Recent advances in natural language processing (NLP) have opened up greater opportunities to enable fine-tuned large language models (LLMs) to behave as more powerful interactive agents through improved instruction-following ability.…

Machine Learning · Computer Science 2025-10-27 Jerry Huang , Peng Lu , Qiuhao Zeng

Alignment of large language models (LLMs) with human values and preferences, often achieved through fine-tuning based on human feedback, is essential for ensuring safe and responsible AI behaviors. However, the process typically requires…

Computation and Language · Computer Science 2025-02-10 Runjin Chen , Gabriel Jacob Perin , Xuxi Chen , Xilun Chen , Yan Han , Nina S. T. Hirata , Junyuan Hong , Bhavya Kailkhura

Objective and scalable measurement of teaching quality is a persistent challenge in education. While Large Language Models (LLMs) offer potential, general-purpose models have struggled to reliably apply complex, authentic classroom…

Computation and Language · Computer Science 2025-11-07 Michael Hardy

Instruction tuning is vital for aligning large language models (LLMs) with human intent, but current methods typically rely on costly human-annotated seed data or powerful external teacher models. While instruction back-translation…

Computation and Language · Computer Science 2025-08-25 Zhanming Shen , Hao Chen , Yulei Tang , Shaolin Zhu , Wentao Ye , Xiaomeng Hu , Haobo Wang , Gang Chen , Junbo Zhao

Pre-trained language models (PLMs) are widely used to derive semantic representations from item metadata in recommendation and search. In sequential recommendation, PLMs enhance ID-based embeddings through textual metadata, while in product…

Information Retrieval · Computer Science 2025-07-09 Matteo Attimonelli , Alessandro De Bellis , Claudio Pomo , Dietmar Jannach , Eugenio Di Sciascio , Tommaso Di Noia

The efficacy of large language models (LLMs) is heavily dependent on the quality of the underlying data, particularly within specialized domains. A common challenge when fine-tuning LLMs for domain-specific applications is the potential…

Computation and Language · Computer Science 2024-03-15 Jianwei Sun , Chaoyang Mei , Linlin Wei , Kaiyu Zheng , Na Liu , Ming Cui , Tianyi Li