中文
相关论文

相关论文: Skill-Adpative Imitation Learning for UI Test Reus…

200 篇论文

Large pre-trained sequence models, such as transformers, excel as few-shot learners capable of in-context learning (ICL). In ICL, a model is trained to adapt its operation to a new task based on limited contextual information, typically in…

信息论 · 计算机科学 2024-04-12 Matteo Zecchin , Kai Yu , Osvaldo Simeone

Digital agents require diverse, large-scale UI trajectories to generalize across real-world tasks, yet collecting such data is prohibitively expensive in both human annotation, infra and engineering perspectives. To this end, we introduce…

计算与语言 · 计算机科学 2025-10-17 Yiming Wang , Da Yin , Yuedong Cui , Ruichen Zheng , Zhiqian Li , Zongyu Lin , Di Wu , Xueqing Wu , Chenchen Ye , Yu Zhou , Kai-Wei Chang

Traditional indoor robot navigation methods provide a reliable solution when adapted to constrained scenarios, but lack flexibility or require manual re-tuning when deployed in more complex settings. In contrast, learning-based approaches…

机器人学 · 计算机科学 2025-07-08 Nigitha Selvaraj , Alex Mitrevski , Sebastian Houben

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Large Language Models (LLMs) can be adapted to extend their text capabilities to speech inputs. However, these speech-adapted LLMs consistently underperform their text-based counterparts--and even cascaded pipelines--on language…

This paper introduces a novel generalized self-imitation learning ($\textbf{GSIL}$) framework, which effectively and efficiently aligns large language models with offline demonstration data. We develop $\textbf{GSIL}$ by deriving a…

计算与语言 · 计算机科学 2024-10-15 Teng Xiao , Mingxiao Li , Yige Yuan , Huaisheng Zhu , Chao Cui , Vasant G Honavar

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

软件工程 · 计算机科学 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

We propose an instance-wise adaptive sampling framework for constructing compact and informative training datasets for supervised learning of inverse problem solutions. Typical learning-based approaches aim to learn a general-purpose…

机器学习 · 计算机科学 2026-02-20 Jiequn Han , Kui Ren , Nathan Soedjak

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

机器学习 · 计算机科学 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

Multi-task learning (MTL) has shown considerable practical benefits, particularly when using language models (LMs). While this is commonly achieved by learning $n$ tasks under a joint optimization procedure, some methods, such as…

机器学习 · 计算机科学 2024-05-20 Markus Frohmann , Carolin Holtermann , Shahed Masoudian , Anne Lauscher , Navid Rekabsaz

Multimodal large language models (MLLMs) have emerged as pivotal tools in enhancing human-computer interaction. In this paper we focus on the application of MLLMs in the field of graphical user interface (GUI) elements structuring, where…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Yi Xu , Yesheng Zhang , Jiajia Liu , Jingdong Chen

Recently, large language models (LLMs) have demonstrated excellent performance, inspiring researchers to explore their use in automating register transfer level (RTL) code generation and improving hardware design efficiency. However, the…

计算与语言 · 计算机科学 2025-04-24 Peiyang Wu , Nan Guo , Xiao Xiao , Wenming Li , Xiaochun Ye , Dongrui Fan

Robotic skills can be learned via imitation learning (IL) using user-provided demonstrations, or via reinforcement learning (RL) using large amountsof autonomously collected experience.Both methods have complementarystrengths and…

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

机器学习 · 计算机科学 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

Adaptive user interfaces (UIs) automatically change an interface to better support users' tasks. Recently, machine learning techniques have enabled the transition to more powerful and complex adaptive UIs. However, a core challenge for…

人机交互 · 计算机科学 2023-10-30 Thomas Langerak , Sammy Christen , Mert Albaba , Christoph Gebhardt , Otmar Hilliges

Large Language Models (LLMs) are widely used for downstream tasks such as tabular classification, where ensuring fairness in their outputs is critical for inclusivity, equal representation, and responsible AI deployment. This study…

计算与语言 · 计算机科学 2025-08-26 Garima Chhikara , Kripabandhu Ghosh , Abhijnan Chakraborty

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

计算与语言 · 计算机科学 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…

计算与语言 · 计算机科学 2024-03-19 Zhe Yang , Damai Dai , Peiyi Wang , Zhifang Sui

With the increasing security issues in blockchain, smart contract vulnerability detection has become a research focus. Existing vulnerability detection methods have their limitations: 1) Static analysis methods struggle with complex…

密码学与安全 · 计算机科学 2025-07-31 Lei Yu , Shiqi Cheng , Zhirong Huang , Jingyuan Zhang , Chenjie Shen , Junyi Lu , Li Yang , Fengjun Zhang , Jiajia Ma