English
Related papers

Related papers: Skill-Adpative Imitation Learning for UI Test Reus…

200 papers

Large pre-trained sequence models, such as transformers, excel as few-shot learners capable of in-context learning (ICL). In ICL, a model is trained to adapt its operation to a new task based on limited contextual information, typically in…

Information Theory · Computer Science 2024-04-12 Matteo Zecchin , Kai Yu , Osvaldo Simeone

Digital agents require diverse, large-scale UI trajectories to generalize across real-world tasks, yet collecting such data is prohibitively expensive in both human annotation, infra and engineering perspectives. To this end, we introduce…

Computation and Language · Computer Science 2025-10-17 Yiming Wang , Da Yin , Yuedong Cui , Ruichen Zheng , Zhiqian Li , Zongyu Lin , Di Wu , Xueqing Wu , Chenchen Ye , Yu Zhou , Kai-Wei Chang

Traditional indoor robot navigation methods provide a reliable solution when adapted to constrained scenarios, but lack flexibility or require manual re-tuning when deployed in more complex settings. In contrast, learning-based approaches…

Robotics · Computer Science 2025-07-08 Nigitha Selvaraj , Alex Mitrevski , Sebastian Houben

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Large Language Models (LLMs) can be adapted to extend their text capabilities to speech inputs. However, these speech-adapted LLMs consistently underperform their text-based counterparts--and even cascaded pipelines--on language…

Computation and Language · Computer Science 2026-02-24 Santiago Cuervo , Skyler Seto , Maureen de Seyssel , Richard He Bai , Zijin Gu , Tatiana Likhomanenko , Navdeep Jaitly , Zakaria Aldeneh

This paper introduces a novel generalized self-imitation learning ($\textbf{GSIL}$) framework, which effectively and efficiently aligns large language models with offline demonstration data. We develop $\textbf{GSIL}$ by deriving a…

Computation and Language · Computer Science 2024-10-15 Teng Xiao , Mingxiao Li , Yige Yuan , Huaisheng Zhu , Chao Cui , Vasant G Honavar

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

We propose an instance-wise adaptive sampling framework for constructing compact and informative training datasets for supervised learning of inverse problem solutions. Typical learning-based approaches aim to learn a general-purpose…

Machine Learning · Computer Science 2026-02-20 Jiequn Han , Kui Ren , Nathan Soedjak

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

Multi-task learning (MTL) has shown considerable practical benefits, particularly when using language models (LMs). While this is commonly achieved by learning $n$ tasks under a joint optimization procedure, some methods, such as…

Machine Learning · Computer Science 2024-05-20 Markus Frohmann , Carolin Holtermann , Shahed Masoudian , Anne Lauscher , Navid Rekabsaz

Multimodal large language models (MLLMs) have emerged as pivotal tools in enhancing human-computer interaction. In this paper we focus on the application of MLLMs in the field of graphical user interface (GUI) elements structuring, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yi Xu , Yesheng Zhang , Jiajia Liu , Jingdong Chen

Recently, large language models (LLMs) have demonstrated excellent performance, inspiring researchers to explore their use in automating register transfer level (RTL) code generation and improving hardware design efficiency. However, the…

Computation and Language · Computer Science 2025-04-24 Peiyang Wu , Nan Guo , Xiao Xiao , Wenming Li , Xiaochun Ye , Dongrui Fan

Robotic skills can be learned via imitation learning (IL) using user-provided demonstrations, or via reinforcement learning (RL) using large amountsof autonomously collected experience.Both methods have complementarystrengths and…

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

Machine Learning · Computer Science 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

Adaptive user interfaces (UIs) automatically change an interface to better support users' tasks. Recently, machine learning techniques have enabled the transition to more powerful and complex adaptive UIs. However, a core challenge for…

Human-Computer Interaction · Computer Science 2023-10-30 Thomas Langerak , Sammy Christen , Mert Albaba , Christoph Gebhardt , Otmar Hilliges

Large Language Models (LLMs) are widely used for downstream tasks such as tabular classification, where ensuring fairness in their outputs is critical for inclusivity, equal representation, and responsible AI deployment. This study…

Computation and Language · Computer Science 2025-08-26 Garima Chhikara , Kripabandhu Ghosh , Abhijnan Chakraborty

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…

Computation and Language · Computer Science 2024-03-19 Zhe Yang , Damai Dai , Peiyi Wang , Zhifang Sui

With the increasing security issues in blockchain, smart contract vulnerability detection has become a research focus. Existing vulnerability detection methods have their limitations: 1) Static analysis methods struggle with complex…

Cryptography and Security · Computer Science 2025-07-31 Lei Yu , Shiqi Cheng , Zhirong Huang , Jingyuan Zhang , Chenjie Shen , Junyi Lu , Li Yang , Fengjun Zhang , Jiajia Ma