English
Related papers

Related papers: Designing with Language: Wireframing UI Design Int…

200 papers

Text animation, a foundational element in video creation, enables efficient and cost-effective communication, thriving in advertisements, journalism, and social media. However, traditional animation workflows present significant usability…

Human-Computer Interaction · Computer Science 2025-06-13 Bao Zhang , Zihan Li , Zhenglei Liu , Huanchen Wang , Yuxin Ma

People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written…

Computation and Language · Computer Science 2026-03-13 Nadav Kunievsky , James A. Evans

Information design is typically studied through the lens of Bayesian signaling, where signals shape beliefs purely based on their correlation with the true state of the world. However, behavioral economics and psychology emphasize that…

Computer Science and Game Theory · Computer Science 2026-03-05 Paul Duetting , Safwan Hossain , Tao Lin , Renato Paes Leme , Sai Srivatsa Ravindranath , Haifeng Xu , Song Zuo

In the software industry, the drive to add new features often overshadows the need to improve existing code. Large Language Models (LLMs) offer a new approach to improving codebases at an unprecedented scale through AI-assisted refactoring.…

Software Engineering · Computer Science 2024-12-23 Markus Borg

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

Artificial Intelligence · Computer Science 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

Web development involves turning UI designs into functional webpages, which can be difficult for both beginners and experienced developers due to the complexity of HTML's hierarchical structures and styles. While Large Language Models…

Software Engineering · Computer Science 2026-03-04 Shanchao Liang , Nan Jiang , Shangshu Qian , Lin Tan

Although Large Language Models (LLMs) exhibit remarkable adaptability across domains, these models often fall short in structured knowledge extraction tasks such as named entity recognition (NER). This paper explores an innovative,…

Computation and Language · Computer Science 2024-06-11 Yuzhao Heng , Chunyuan Deng , Yitong Li , Yue Yu , Yinghao Li , Rongzhi Zhang , Chao Zhang

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

One of the key tasks in machine learning for tabular data is feature engineering. Although it is vital for improving the performance of models, it demands considerable human expertise and deep domain knowledge, making it labor-intensive…

Computation and Language · Computer Science 2025-04-01 Jeonghyun Ko , Gyeongyun Park , Donghoon Lee , Kyunam Lee

Intent, typically clearly formulated and planned, functions as a cognitive framework for communication and problem-solving. This paper introduces the concept of Speaking with Intent (SWI) in large language models (LLMs), where the…

Computation and Language · Computer Science 2025-09-12 Yuwei Yin , EunJeong Hwang , Giuseppe Carenini

Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with…

Computation and Language · Computer Science 2025-01-28 Spencer Ramsey , Amina Grant , Jeffrey Lee

Large Language Models (LLMs) are revolutionizing industries by enhancing efficiency, scalability, and innovation. This paper investigates the potential of LLMs in automating Computer-Aided Design (CAD) workflows, by integrating FreeCAD with…

Human-Computer Interaction · Computer Science 2025-08-05 Sumit Kumar , Sarthak Kapoor , Harsh Vardhan , Yao Zhao

Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have explored diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yingjie Tang , Di Luo , Zixiong Wang , Xiaoli Ling , jian Yang , Beibei Wang

Multimodal large language models (MLLMs) that think with images can interactively use tools to reason about visual inputs, but current approaches often rely on a narrow set of tools with limited real-world necessity and scalability. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zirun Guo , Minjie Hong , Feng Zhang , Kai Jia , Tao Jin

Large language models (LLMs) have demonstrated rapid progress across a wide array of domains. Owing to the very large number of parameters and training data in LLMs, these models inherently encompass an expansive and comprehensive materials…

Materials Science · Physics 2024-11-20 Siyu Liu , Tongqi Wen , A. S. L. Subrahmanyam Pattamatta , David J. Srolovitz

Co-speech gesture generation enhances human-computer interaction realism through speech-synchronized gesture synthesis. However, generating semantically meaningful gestures remains a challenging problem. We propose SARGes, a novel framework…

Computation and Language · Computer Science 2025-03-27 Nan Gao , Yihua Bao , Dongdong Weng , Jiayi Zhao , Jia Li , Yan Zhou , Pengfei Wan , Di Zhang

Large Language Models (LLMs) have shown great potential in reasoning tasks through test-time scaling methods like self-consistency with majority voting. However, this approach often leads to diminishing returns in accuracy and high…

Machine Learning · Computer Science 2025-08-22 Yichao Fu , Xuewei Wang , Yuandong Tian , Jiawei Zhao

While generative modeling has become prevalent across numerous research fields, its integration into the realm of image retrieval remains largely unexplored and underjustified. In this paper, we present a novel methodology, reframing image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Yidan Zhang , Ting Zhang , Dong Chen , Yujing Wang , Qi Chen , Xing Xie , Hao Sun , Weiwei Deng , Qi Zhang , Fan Yang , Mao Yang , Qingmin Liao , Jingdong Wang , Baining Guo

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Accurate color alignment in text-to-image (T2I) generation is critical for applications such as fashion, product visualization, and interior design, yet current diffusion models struggle with nuanced and compound color terms (e.g., Tiffany…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sung-Lin Tsai , Bo-Lun Huang , Yu Ting Shen , Cheng Yu Yeo , Chiang Tseng , Bo-Kai Ruan , Wen-Sheng Lien , Hong-Han Shuai