English
Related papers

Related papers: GuideWeb: A Benchmark for Automatic In-App Guide G…

200 papers

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

The item details page (IDP) is a web page on an e-commerce website that provides information on a specific product or item listing. Just below the details of the item on this page, the buyer can usually find recommendations for other…

Information Retrieval · Computer Science 2021-08-13 Chieh Lo , Hongliang Yu , Xin Yin , Krutika Shetty , Changchen He , Kathy Hu , Justin Platz , Adam Ilardi , Sriganesh Madhvanath

As the last stage of a typical \textit{recommendation system}, \textit{collective recommendation} aims to give the final touches to the recommended items and their layout so as to optimize overall objectives such as diversity and whole-page…

Information Retrieval · Computer Science 2024-11-04 Shuai Xiao , Zaifan Jiang

Generating high-quality pseudo-labels on the cloud is crucial for cloud-edge object detection, especially in dynamic traffic monitoring where data distributions evolve. Existing methods often assume reliable cloud models, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinrun Xu , Qiuhong Zhang , Jianwen Yang , Zhanbiao Lian , Jin Yan , Zhiming Ding , Shan Jiang

Large language models (LLMs) have fueled many intelligent web agents, but most existing ones perform far from satisfying in real-world web navigation tasks due to three factors: (1) the complexity of HTML text data (2) versatility of…

Computation and Language · Computer Science 2024-10-15 Hanyu Lai , Xiao Liu , Iat Long Iong , Shuntian Yao , Yuxuan Chen , Pengbo Shen , Hao Yu , Hanchen Zhang , Xiaohan Zhang , Yuxiao Dong , Jie Tang

GUI agents are designed to automate repetitive tasks and enhance productivity. However, existing GUI agents struggle to recover once they follow an incorrect exploration path, often leading to task failure. In this work, we model GUI task…

Artificial Intelligence · Computer Science 2026-01-30 Ziyu Lu , Tengjin Weng , Yiying Yang , Yuhang Zhao , Xinxin Huang , Wenhao Jiang

Behaviour-Driven Development (BDD) has emerged in the last years as a powerful methodology to specify testable and executable user requirements through stories and scenarios. With the support of external testing frameworks, BDD stories can…

Software Engineering · Computer Science 2022-09-14 Thiago Rocha Silva , Marco Winckler

Recent studies have demonstrated the effectiveness of token-based methods for visual content generation. As a representative work, non-autoregressive Transformers (NATs) are able to synthesize images with decent quality in a small number of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Zanlin Ni , Yulin Wang , Renping Zhou , Rui Lu , Jiayi Guo , Jinyi Hu , Zhiyuan Liu , Yuan Yao , Gao Huang

With advances in generative AI, there is now potential for autonomous agents to manage daily tasks via natural language commands. However, current agents are primarily created and tested in simplified synthetic environments, leading to a…

Artificial Intelligence · Computer Science 2024-04-17 Shuyan Zhou , Frank F. Xu , Hao Zhu , Xuhui Zhou , Robert Lo , Abishek Sridhar , Xianyi Cheng , Tianyue Ou , Yonatan Bisk , Daniel Fried , Uri Alon , Graham Neubig

Tag-Pag is an application designed to simplify the categorization of web pages, a task increasingly common for researchers who scrape web pages to analyze individuals' browsing patterns or train machine learning classifiers. Unlike existing…

Information Retrieval · Computer Science 2025-02-25 Anton Pogrebnjak , Julian Schelb , Andreas Spitz , Celina Kacperski , Roberto Ulloa

Real-world enterprise data intelligence workflows encompass data engineering that turns raw sources into analytical-ready tables and data analysis that convert those tables into decision-oriented insights. We introduce DAComp, a benchmark…

Computation and Language · Computer Science 2025-12-05 Fangyu Lei , Jinxiang Meng , Yiming Huang , Junjie Zhao , Yitong Zhang , Jianwen Luo , Xin Zou , Ruiyi Yang , Wenbo Shi , Yan Gao , Shizhu He , Zuo Wang , Qian Liu , Yang Wang , Ke Wang , Jun Zhao , Kang Liu

Bundle recommendation aims to suggest a set of interconnected items to users. However, diverse interaction types and sparse interaction matrices often pose challenges for previous approaches in accurately predicting user-bundle adoptions.…

Information Retrieval · Computer Science 2024-12-25 Tuan-Nghia Bui , Huy-Son Nguyen , Cam-Van Nguyen Thi , Hoang-Quynh Le , Duc-Trong Le

Text generation from a knowledge base aims to translate knowledge triples to natural language descriptions. Most existing methods ignore the faithfulness between a generated text description and the original table, leading to generated…

Computation and Language · Computer Science 2021-03-03 Zhenyi Wang , Xiaoyang Wang , Bang An , Dong Yu , Changyou Chen

The progress of autonomous web navigation has been hindered by the dependence on billions of exploratory interactions via online reinforcement learning, and domain-specific model designs that make it difficult to leverage generalization…

Machine Learning · Computer Science 2024-02-27 Hiroki Furuta , Kuang-Huei Lee , Ofir Nachum , Yutaka Matsuo , Aleksandra Faust , Shixiang Shane Gu , Izzeddin Gur

Recommender systems typically retrieve items from an item corpus for personalized recommendations. However, such a retrieval-based recommender paradigm faces two limitations: 1) the human-generated items in the corpus might fail to satisfy…

Information Retrieval · Computer Science 2024-02-27 Wenjie Wang , Xinyu Lin , Fuli Feng , Xiangnan He , Tat-Seng Chua

Research on self-evolving language agents has accelerated, drawing increasing attention to their ability to create, adapt, and maintain tools from task requirements. However, existing benchmarks predominantly rely on predefined…

Software Engineering · Computer Science 2026-03-09 Bowei Xia , Mengkang Hu , Shijian Wang , Jiarui Jin , Wenxiang Jiao , Yuan Lu , Kexin Li , Ping Luo

Recent years have witnessed the prosperity of legal artificial intelligence with the development of technologies. In this paper, we propose a novel legal application of legal provision prediction (LPP), which aims to predict the related…

Artificial Intelligence · Computer Science 2021-08-24 Luoqiu Li , Zhen Bi , Hongbin Ye , Shumin Deng , Hui Chen , Huaixiao Tou

For people affected by blindness and low vision (BLV), safe and independent navigation remains a major challenge, impacting over 2.2 billion individuals worldwide. Although multimodal large language models (MLLMs) offer new opportunities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Junhyeok Kim , Jaewoo Park , Junhee Park , Sangeyl Lee , Jiwan Chung , Jisung Kim , Ji Hoon Joung , Youngjae Yu

While Graphical User Interface (GUI) agents have shown promising performance in automated device interaction, they primarily depend on static parametric knowledge from pre-training or instruction tuning. This reliance fundamentally limits…

Artificial Intelligence · Computer Science 2026-05-19 Jingjing Liu , Ziye Huang , Zihao Cheng , Zeming Liu , Jiahong Wu , Yuhang Guo , Kehai Chen , Yunhong Wang , Haifeng Wang