中文
相关论文

相关论文: Inferring Alt-text For UI Icons With Large Languag…

200 篇论文

Information graphics are pivotal in effective information dissemination and storytelling. However, creating such graphics is extremely challenging for non-professionals, since the design process requires multifaceted skills and…

人机交互 · 计算机科学 2024-01-25 Qirui Huang , Min Lu , Joel Lanir , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

Multimodal large language models (MLLMs) have emerged as pivotal tools in enhancing human-computer interaction. In this paper we focus on the application of MLLMs in the field of graphical user interface (GUI) elements structuring, where…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Yi Xu , Yesheng Zhang , Jiajia Liu , Jingdong Chen

The advent of large language models (LLMs) revolutionized natural language processing applications, and running LLMs on edge devices has become increasingly attractive for reasons including reduced latency, data localization, and…

计算与语言 · 计算机科学 2024-09-17 Jiajun Xu , Zhiyuan Li , Wei Chen , Qun Wang , Xin Gao , Qi Cai , Ziyuan Ling

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

As language models continue to scale, Large Language Models (LLMs) have exhibited emerging capabilities in In-Context Learning (ICL), enabling them to solve language tasks by prefixing a few in-context demonstrations (ICDs) as context.…

计算与语言 · 计算机科学 2024-11-01 Yingzhe Peng , Chenduo Hao , Xu Yang , Jiawei Peng , Xinting Hu , Xin Geng

In this paper, we introduce LDGen, a novel method for integrating large language models (LLMs) into existing text-to-image diffusion models while minimizing computational demands. Traditional text encoders, such as CLIP and T5, exhibit…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Pengzhi Li , Pengfei Yu , Zide Liu , Wei He , Xuhao Pan , Xudong Rao , Tao Wei , Wei Chen

The rapid development of large language models (LLMs) and large vision models (LVMs) have propelled the evolution of multi-modal AI systems, which have demonstrated the remarkable potential for industrial applications by emulating…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Di Jin , Xing Liu , Yu Liu , Jia Qing Yap , Andrea Wong , Adriana Crespo , Qi Lin , Zhiyuan Yin , Qiang Yan , Ryan Ye

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

计算与语言 · 计算机科学 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

计算与语言 · 计算机科学 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based interactions. This enrichment…

计算与语言 · 计算机科学 2024-07-08 Chang-Sheng Kao , Yun-Nung Chen

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

计算与语言 · 计算机科学 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

Text-attributed graphs have recently garnered significant attention due to their wide range of applications in web domains. Existing methodologies employ word embedding models for acquiring text representations as node features, which are…

机器学习 · 计算机科学 2024-12-11 Jianxiang Yu , Yuxiang Ren , Chenghua Gong , Jiaqi Tan , Xiang Li , Xuecang Zhang

Large Language Models have demonstrated remarkable performance across various tasks, exhibiting the capacity to swiftly acquire new skills, such as through In-Context Learning (ICL) with minimal demonstration examples. In this work, we…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Folco Bertini Baldassini , Mustafa Shukor , Matthieu Cord , Laure Soulier , Benjamin Piwowarski

The rapid advancement of mobile applications has led to a significant demand for cross-platform compatibility, particularly between the Android and iOS platforms. Traditional approaches to mobile application translation often rely on manual…

软件工程 · 计算机科学 2025-07-23 Zhili Zeng , Kimya Khakzad Shahandashti , Alvine Boaye Belle , Song Wang , Zhen Ming , Jiang

Developers and quality assurance testers often rely on manual testing to test accessibility features throughout the product lifecycle. Unfortunately, manual testing can be tedious, often has an overwhelming scope, and can be difficult to…

人机交互 · 计算机科学 2024-03-06 Maryam Taeb , Amanda Swearngin , Eldon Schoop , Ruijia Cheng , Yue Jiang , Jeffrey Nichols

Deep neural networks (DNNs) have made significant strides in tackling challenging tasks in wireless systems, especially when an accurate wireless model is not available. However, when available data is limited, traditional DNNs often yield…

信号处理 · 电气工程与系统科学 2024-09-10 Momin Abbas , Koushik Kar , Tianyi Chen

Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to…

计算与语言 · 计算机科学 2024-02-23 Seiji Gobara , Hidetaka Kamigaito , Taro Watanabe

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

信息检索 · 计算机科学 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

计算与语言 · 计算机科学 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia