English
Related papers

Related papers: DiSCoKit: An Open-Source Toolkit for Deploying Liv…

200 papers

Due to the advantages in the cost-efficiency and reproducibility, user simulation has become a promising solution to the user-centric evaluation of information retrieval systems. Nonetheless, accurately simulating user search behaviors has…

Information Retrieval · Computer Science 2024-10-30 Erhan Zhang , Xingzhu Wang , Peiyuan Gong , Yankai Lin , Jiaxin Mao

The integration of Large Language Models (LLMs) into mobile and software development workflows faces a persistent tension among three demands: semantic awareness, developer productivity, and data privacy. Traditional cloud-based tools offer…

Software Engineering · Computer Science 2025-12-10 Liao Hu , Qiteng Wu , Ruoyu Qi

Current-generation Large Language Models (LLMs) have stirred enormous interest in recent months, yielding great potential for accessibility and automation, while simultaneously posing significant challenges and risk of misuse. To facilitate…

Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks. However, their computational costs are prohibitively high. To address this issue, previous research has attempted to distill the knowledge of…

Computation and Language · Computer Science 2024-03-12 Chengyuan Liu , Yangyang Kang , Fubang Zhao , Kun Kuang , Zhuoren Jiang , Changlong Sun , Fei Wu

Tool-augmented Large Language Models (LLMs) have shown impressive capabilities in remote sensing (RS) applications. However, existing benchmarks assume question-answering input templates over predefined image-text data pairs. These…

Computation and Language · Computer Science 2024-05-03 Simranjit Singh , Michael Fore , Dimitrios Stamoulis

As psychometric surveys are increasingly used to assess the traits of large language models (LLMs), the need for scalable survey item generation suited for LLMs has also grown. A critical challenge here is ensuring the construct validity of…

Computation and Language · Computer Science 2026-05-26 Sungjib Lim , Woojung Song , Eun-Ju Lee , Yohan Jo

Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces, shifting the dynamics of participation in AI development. This article examines how…

Human-Computer Interaction · Computer Science 2025-10-31 Ned Cooper , Alexandra Zafiroglu

The democratization of open-source Large Language Models (LLMs) allows users to fine-tune and deploy models on local infrastructure but exposes them to a First Mile deployment landscape. Unlike black-box API consumption, the reliability of…

Software Engineering · Computer Science 2026-01-21 Guangba Yu , Zirui Wang , Yujie Huang , Renyi Zhong , Yuedong Zhong , Yilun Wang , Michael R. Lyu

Recent large language models (LLMs) advancements sparked a growing research interest in tool assisted LLMs solving real-world challenges, which calls for comprehensive evaluation of tool-use capabilities. While previous works focused on…

Computation and Language · Computer Science 2025-04-18 Jiarui Lu , Thomas Holleis , Yizhe Zhang , Bernhard Aumayer , Feng Nan , Felix Bai , Shuang Ma , Shen Ma , Mengyu Li , Guoli Yin , Zirui Wang , Ruoming Pang

This paper introduces AutoSurvey, a speedy and well-organized methodology for automating the creation of comprehensive literature surveys in rapidly evolving fields like artificial intelligence. Traditional survey paper creation faces…

Information Retrieval · Computer Science 2024-06-19 Yidong Wang , Qi Guo , Wenjin Yao , Hongbo Zhang , Xin Zhang , Zhen Wu , Meishan Zhang , Xinyu Dai , Min Zhang , Qingsong Wen , Wei Ye , Shikun Zhang , Yue Zhang

Large language models (LLMs) require well-crafted prompts for effective use. Prompt engineering, the process of designing prompts, is challenging, particularly for non-experts who are less familiar with AI technologies. While researchers…

Human-Computer Interaction · Computer Science 2024-01-29 Zijie J. Wang , Aishwarya Chakravarthy , David Munechika , Duen Horng Chau

Large language models (LLMs) are powerful artificial intelligence (AI) tools transforming how research is conducted. However, their use in research has been met with skepticism, due to concerns about hallucinations, biases and potential…

Artificial Intelligence · Computer Science 2025-07-08 Ruian Ke , Ruy M. Ribeiro

This paper introduces AnalyticsGPT, an intuitive and efficient large language model (LLM)-powered workflow for scientometric question answering. This underrepresented downstream task addresses the subcategory of meta-scientific questions…

Computation and Language · Computer Science 2026-02-11 Khang Ly , Georgios Cheirmpos , Adrian Raudaschl , Christopher James , Seyed Amin Tabatabaei

Large Language Models (LLMs) are trained on vast amounts of data, most of which is automatically scraped from the internet. This data includes encyclopedic documents that harbor a vast amount of general knowledge (e.g., Wikipedia) but also…

Machine learning (ML) has the potential to revolutionize a wide range of research areas and industries, but many ML projects never progress past the proof-of-concept stage. To address this issue, we introduce Model Share AI (AIMS), an…

Software Engineering · Computer Science 2023-09-28 Heinrich Peters , Michael Parrott

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

AI-enabled features built on LLMs and agentic workflows are difficult to test, debug, and reproduce, especially for product-focused software engineers without a machine learning background. We present the AI Toolkit plugin for JetBrains…

Software Engineering · Computer Science 2026-05-15 Yaroslav Sokolov , Yury Khudyakov , Lenar Sharipov , Andrei Gasparian , Parth Tiwary , Artem Trofimov

LLM-based Interactive Drama introduces a novel dialogue scenario in which the player immerses into a character and engages in a dramatic story by interacting with LLM agents. Despite the fact that this emerging area holds significant…

Computation and Language · Computer Science 2025-09-23 Tianyang Xu , Hongqiu Wu , Weiqi Wu , Hai Zhao

Video meeting platforms display conversations linearly through transcripts or summaries. However, ideas during a meeting do not emerge linearly. We leverage LLMs to create dialogue maps in real time to help people visually structure and…

Human-Computer Interaction · Computer Science 2025-02-04 Xinyue Chen , Nathan Yap , Xinyi Lu , Aylin Gunal , Xu Wang

The past few decades have witnessed an upsurge in data, forming the foundation for data-hungry, learning-based AI technology. Conversational agents, often referred to as AI chatbots, rely heavily on such data to train large language models…

Computation and Language · Computer Science 2024-11-19 Sumit Kumar Dam , Choong Seon Hong , Yu Qiao , Chaoning Zhang