English
Related papers

Related papers: Lexara: A User-Centered Toolkit for Evaluating Lar…

200 papers

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Conversational AI interfaces powered by large language models (LLMs) are increasingly used as coding assistants. However, questions remain about how programmers interact with LLM-based conversational agents, the challenges they encounter,…

Human-Computer Interaction · Computer Science 2025-03-24 Mehmet Akhoroz , Caglar Yildirim

The rapid advancement of Large Language Models (LLMs) and conversational assistants necessitates dynamic, scalable, and configurable conversational datasets for training and evaluation. These datasets must accommodate diverse user…

Computation and Language · Computer Science 2024-08-13 Ronak Pradeep , Daniel Lee , Ali Mousavi , Jeff Pound , Yisi Sang , Jimmy Lin , Ihab Ilyas , Saloni Potdar , Mostafa Arefiyan , Yunyao Li

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

Computation and Language · Computer Science 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

Configuration is a key technology for tailoring complex software systems, services, and products. A successful application of configurators not only depends on technical correctness, performance, and domain modeling but also on their…

As the performance of Large-scale Vision Language Models (LVLMs) improves, they are increasingly capable of responding in multiple languages, and there is an expectation that the demand for explanations generated by LVLMs will grow.…

Computation and Language · Computer Science 2025-02-17 Shintaro Ozaki , Kazuki Hayashi , Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

The rise of Large Language Models (LLMs) and generative visual analytics systems has transformed data-driven insights, yet significant challenges persist in accurately interpreting users' analytical and interaction intents. While language…

Human-Computer Interaction · Computer Science 2025-04-17 Juntong Chen , Jiang Wu , Jiajing Guo , Vikram Mohanty , Xueming Li , Jorge Piazentin Ono , Wenbin He , Liu Ren , Dongyu Liu

Large Language Models (LLMs) excel in various Natural Language Processing (NLP) tasks, yet their evaluation, particularly in languages beyond the top $20$, remains inadequate due to existing benchmarks and metrics limitations. Employing…

Computation and Language · Computer Science 2024-02-14 Rishav Hada , Varun Gumma , Adrian de Wynter , Harshita Diddee , Mohamed Ahmed , Monojit Choudhury , Kalika Bali , Sunayana Sitaram

In-Car Conversational Question Answering (ConvQA) systems significantly enhance user experience by enabling seamless voice interactions. However, assessing their accuracy and reliability remains a challenge. This paper explores the use of…

Computation and Language · Computer Science 2025-12-16 Philipp Habicht , Lev Sorokin , Abdullah Saydemir , Ken E. Friedl , Andrea Stocco

Recently, Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering situations, these models frequently struggle…

Computation and Language · Computer Science 2023-08-28 Chaoyi Wu , Weixiong Lin , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

In today's data-driven era, computational systems generate vast amounts of data that drive the digital transformation of industries, where Artificial Intelligence (AI) plays a key role. Currently, the demand for eXplainable AI (XAI) has…

Artificial Intelligence · Computer Science 2025-03-07 Georgios Makridis , Vasileios Koukos , Georgios Fatouros , Dimosthenis Kyriazis

Large language models (LLMs) are rapidly increasing in capability, but they still struggle with highly specialized programming tasks such as scientific visualization. We present an LLM assistant, ChatVis, that aids the LLM to generate…

Human-Computer Interaction · Computer Science 2025-08-01 Tom Peterka , Tanwi Mallick , Orcun Yildiz , David Lenz , Cory Quammen , Berk Geveci

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

Large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities in various tasks and attracted an increasing interest as a natural language interface across many domains. Recently, large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhihao Chen , Bin Hu , Chuang Niu , Tao Chen , Yuxin Li , Hongming Shan , Ge Wang

Combining multiple perceptual inputs and performing combinatorial reasoning in complex scenarios is a sophisticated cognitive function in humans. With advancements in multi-modal large language models, recent benchmarks tend to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chao Wang , Luning Zhang , Zheng Wang , Yang Zhou

Instruction tuning unlocks the superior capability of Large Language Models (LLM) to interact with humans. Furthermore, recent instruction-following datasets include images as visual inputs, collecting responses for image-based…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Yanzhe Zhang , Ruiyi Zhang , Jiuxiang Gu , Yufan Zhou , Nedim Lipka , Diyi Yang , Tong Sun

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Computation and Language · Computer Science 2024-06-12 Sylvio Barbon Junior , Paolo Ceravolo , Sven Groppe , Mustafa Jarrar , Samira Maghool , Florence Sèdes , Soror Sahri , Maurice Van Keulen

The rapid development and dynamic nature of large language models (LLMs) make it difficult for conventional quantitative benchmarks to accurately assess their capabilities. We propose report cards, which are human-interpretable, natural…

Machine Learning · Computer Science 2024-09-04 Blair Yang , Fuyang Cui , Keiran Paster , Jimmy Ba , Pashootan Vaezipoor , Silviu Pitis , Michael R. Zhang

The emergence of Large Language Models (LLMs) has shifted language model evaluation toward reasoning and problem-solving tasks as measures of general intelligence. Small Language Models (SLMs) -- defined here as models under 10B parameters…

Computation and Language · Computer Science 2026-01-08 Gabriel Benedict , Matthew Butler , Naved Merchant , Eetu Salama-Laine

Large Language Models (LLMs) achieve competitive results compared to human experts in medical examinations. However, it remains a challenge to apply LLMs to complex clinical decision-making, which requires a deep understanding of medical…