English
Related papers

Related papers: UI-JEPA: Towards Active Perception of User Intent …

200 papers

Conversational systems are of primary interest in the AI community. Chatbots are increasingly being deployed to provide round-the-clock support and to increase customer engagement. Many of the commercial bot building frameworks follow a…

Computation and Language · Computer Science 2021-01-19 Ajay Chatterjee , Shubhashis Sengupta

Recommendation systems play a critical role in enhancing user experience and engagement in various online platforms. Traditional methods, such as Collaborative Filtering (CF) and Content-Based Filtering (CBF), rely heavily on past user…

Information Retrieval · Computer Science 2025-01-22 Xiaochuan Xu , Zeqiu Xu , Peiyang Yu , Jiani Wang

Intent detection is a crucial component of modern conversational systems, since accurately identifying user intent at the beginning of a conversation is essential for generating effective responses. Recent efforts have focused on studying…

Computation and Language · Computer Science 2025-09-09 Liang Zhang , Yuan Li , Shijie Zhang , Zheng Zhang , Xitong Li

Emotion and Intent Joint Understanding in Multimodal Conversation (MC-EIU) aims to decode the semantic information manifested in a multimodal conversational history, while inferring the emotions and intents simultaneously for the current…

Computation and Language · Computer Science 2024-07-08 Rui Liu , Haolin Zuo , Zheng Lian , Xiaofen Xing , Björn W. Schuller , Haizhou Li

Streaming services have reshaped how we discover and engage with digital entertainment. Despite these advancements, effectively understanding the wide spectrum of user search queries continues to pose a significant challenge. An accurate…

Information Retrieval · Computer Science 2024-09-16 Farnoosh Javadi , Phanideep Gampa , Alyssa Woo , Xingxing Geng , Hang Zhang , Jose Sepulveda , Belhassen Bayar , Fei Wang

Large Language Models are rapidly emerging as web-native interfaces to social platforms. On the social web, users frequently have ambiguous and dynamic goals, making complex intent understanding-rather than single-turn execution-the…

Artificial Intelligence · Computer Science 2026-01-27 Zenghua Liao , Jinzhi Liao , Xiang Zhao

Interactive systems have taken over the web and mobile space with increasing participation from users. Applications across every marketing domain can now be accessed through mobile or web where users can directly perform certain actions and…

Artificial Intelligence · Computer Science 2017-12-06 Rakshit Agrawal , Anwar Habeeb , Chih-Hsin Hsueh

Image-based Joint-Embedding Predictive Architecture (I-JEPA) offers a promising approach to visual self-supervised learning through masked feature prediction. However with the inherent visual uncertainty at masked positions, feature…

Machine Learning · Computer Science 2026-05-06 Chen Huang , Xianhang Li , Vimal Thilak , Etai Littwin , Josh Susskind

Current interactive systems with natural language interfaces lack the ability to understand a complex information-seeking request which expresses several implicit constraints at once, and there is no prior information about user preferences…

Sequential recommender models are essential components of modern industrial recommender systems. These models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most…

Information Retrieval · Computer Science 2023-03-28 Bo Chang , Alexandros Karatzoglou , Yuyan Wang , Can Xu , Ed H. Chi , Minmin Chen

Existing Graphical User Interface (GUI) reasoning tasks remain challenging, particularly in UI understanding. Current methods typically rely on direct screen-based decision-making, which lacks interpretability and overlooks a comprehensive…

Artificial Intelligence · Computer Science 2026-04-09 Songze Li , Xiaoke Guo , Tianqi Liu , Biao Yi , Zhaoyan Gong , Zhiqiang Liu , Huajun Chen , Wen Zhang

Many real-world tasks involve a mixed-initiative setup, wherein humans and AI systems collaboratively perform a task. While significant work has been conducted towards enabling humans to specify, through language, exactly how an agent…

Artificial Intelligence · Computer Science 2023-10-24 Pradyumna Tambwekar , Lakshita Dodeja , Nathan Vaska , Wei Xu , Matthew Gombolay

Joint-Embedding Predictive Architectures (JEPA) are a promising framework for self-supervised video representation learning, yet the behavior of auxiliary objectives in small-scale Video-JEPA training is not well characterized. We report a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Santosh Premi

Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus…

Computation and Language · Computer Science 2024-08-26 Songwei Li , Jie Feng , Jiawei Chi , Xinyuan Hu , Xiaomeng Zhao , Fengli Xu

We present V-JEPA 2.1, a family of self-supervised models that learn dense, high-quality visual representations for both images and videos while retaining strong global scene understanding. The approach combines four key components. First,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Lorenzo Mur-Labadia , Matthew Muckley , Amir Bar , Mido Assran , Koustuv Sinha , Mike Rabbat , Yann LeCun , Nicolas Ballas , Adrien Bardes

The increasing complexity of smart manufacturing environments demands interfaces that can translate high-level human intents into machine-executable actions. This paper presents a unified framework that integrates instruction-tuned Large…

Artificial Intelligence · Computer Science 2026-02-16 Takoua Jradi , John Violos , Dimitrios Spatharakis , Lydia Mavraidi , Ioannis Dimolitsas , Aris Leivadeas , Symeon Papavassiliou

Effective human-robot collaboration in open-world environments requires joint planning under uncertain conditions. However, existing approaches often treat humans as passive supervisors, preventing autonomous agents from becoming human-like…

Robotics · Computer Science 2026-03-10 Zeyu Fang , Yuxin Lin , Cheng Liu , Beomyeol Yu , Zeyuan Yang , Rongqian Chen , Taeyoung Lee , Mahdi Imani , Tian Lan

In task-oriented dialogue systems, intent detection is crucial for interpreting user queries and providing appropriate responses. Existing research primarily addresses simple queries with a single intent, lacking effective systems for…

Computation and Language · Computer Science 2024-10-31 Ankan Mullick , Sombit Bose , Abhilash Nandy , Gajula Sai Chaitanya , Pawan Goyal

Intent detection, a core component of natural language understanding, has considerably evolved as a crucial mechanism in safeguarding large language models (LLMs). While prior work has applied intent detection to enhance LLMs' moderation…

Computation and Language · Computer Science 2025-08-26 Jun Zhuang , Haibo Jin , Ye Zhang , Zhengjian Kang , Wenbin Zhang , Gaby G. Dagher , Haohan Wang

Modern Text-to-Image (T2I) generation increasingly relies on token-centric architectures that are trained with self-supervision, yet effectively fusing text with visual tokens remains a challenge. We propose \textbf{JEPA-T}, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Siheng Wan , Zhengtao Yao , Zhengdao Li , Junhao Dong , Yanshu Li , Yikai Li , Linshan Li , Haoyan Xu , Yijiang Li , Zhikang Dong , Huacan Wang , Jifeng Shen