English
Related papers

Related papers: Text Understanding and Generation Using Transforme…

200 papers

We consider small-data, large-scale decision problems in which a firm must make many operational decisions simultaneously (e.g., across a large product portfolio) while observing only a few, potentially noisy, data points per instance.…

Machine Learning · Computer Science 2026-02-04 Zishi Zhang , Jinhui Han , Ming Hu , Yijie Peng

Understanding vision and language representations of product content is vital for search and recommendation applications in e-commerce. As a backbone for online shopping platforms and inspired by the recent success in representation…

Machine Learning · Computer Science 2022-08-23 Wonyoung Shin , Jonghun Park , Taekang Woo , Yongwoo Cho , Kwangjin Oh , Hwanjun Song

Predicting a user's next search query from recent interaction behaviors is a critical problem in modern e-commerce systems, particularly in scenarios where user intent evolves rapidly. Large Language Models (LLMs) offer strong semantic…

Information Retrieval · Computer Science 2026-05-07 Bin Zhang , Weipeng Huang , Dimin Wang , Jialin Zhu , Yuning Jiang , Zhaode Wang , Chengfei Lv , Jian Wang , Qichao Ma , Li Chen , Junqing Wu , Yipeng Yu

Transformer, originally devised for natural language processing, has also attested significant success in computer vision. Thanks to its super expressive power, researchers are investigating ways to deploy transformers to reinforcement…

Machine Learning · Computer Science 2023-01-24 Shengchao Hu , Li Shen , Ya Zhang , Yixin Chen , Dacheng Tao

In recent years, efforts have been made to use text information for better user profiling and item characterization in recommendations. However, text information can sometimes be of low quality, hindering its effectiveness for real-world…

Artificial Intelligence · Computer Science 2024-02-15 Yingpeng Du , Ziyan Wang , Zhu Sun , Haoyan Chua , Hongzhi Liu , Zhonghai Wu , Yining Ma , Jie Zhang , Youchen Sun

Modeling long texts has been an essential technique in the field of natural language processing (NLP). With the ever-growing number of long documents, it is important to develop effective modeling methods that can process and analyze such…

Computation and Language · Computer Science 2025-06-11 Zican Dong , Tianyi Tang , Junyi Li , Wayne Xin Zhao

Transformer models have significantly advanced the field of emotion recognition. However, there are still open challenges when exploring open-ended queries for Large Language Models (LLMs). Although current models offer good results,…

Personalization of natural language generation plays a vital role in a large spectrum of tasks, such as explainable recommendation, review summarization and dialog systems. In these tasks, user and item IDs are important identifiers for…

Information Retrieval · Computer Science 2021-06-09 Lei Li , Yongfeng Zhang , Li Chen

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

The usefulness of Large Language Models (LLM) is being continuously tested in various fields. However, their intrinsic linguistic characteristic is still one of the limiting factors when applying these models to exact sciences. In this…

Artificial Intelligence · Computer Science 2024-09-24 Jonathan Paul Driemeyer Brown , Tiago Oliveira Weber

The use of pretrained embeddings has become widespread in modern e-commerce machine learning (ML) systems. In practice, however, we have encountered several key issues when using pretrained embedding in a real-world production system, many…

Machine Learning · Computer Science 2023-04-11 Da Xu , Bo Yang

Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a…

Machine Learning · Computer Science 2024-05-10 Yuhang Wu , Yingfei Wang , Chu Wang , Zeyu Zheng

Online forms are widely used to collect data from human and have a multi-billion market. Many software products provide online services for creating semi-structured forms where questions and descriptions are organized by pre-defined…

Computation and Language · Computer Science 2022-11-11 Yijia Shao , Mengyu Zhou , Yifan Zhong , Tao Wu , Hongwei Han , Shi Han , Gideon Huang , Dongmei Zhang

The Transformer architecture has become prominent in developing large causal language models. However, mechanisms to explain its capabilities are not well understood. Focused on the training process, here we establish a meta-learning view…

Machine Learning · Computer Science 2024-03-26 Xinbo Wu , Lav R. Varshney

Recent approaches in literature have exploited the multi-modal information in documents (text, layout, image) to serve specific downstream document tasks. However, they are limited by their - (i) inability to learn cross-modal…

Computation and Language · Computer Science 2022-01-06 Subhojeet Pramanik , Shashank Mujumdar , Hima Patel

Property prediction accuracy has long been a key parameter of machine learning in materials informatics. Accordingly, advanced models showing state-of-the-art performance turn into highly parameterized black boxes missing interpretability.…

Materials Science · Physics 2023-08-03 Vadim Korolev , Pavel Protsenko

Deep learning based methods have been widely used in industrial recommendation systems (RSs). Previous works adopt an Embedding&MLP paradigm: raw features are embedded into low-dimensional vectors, which are then fed on to MLP for final…

Information Retrieval · Computer Science 2019-05-17 Qiwei Chen , Huan Zhao , Wei Li , Pipei Huang , Wenwu Ou

Large-language Models (LLMs) have been extremely successful at tasks like complex dialogue understanding, reasoning and coding due to their emergent abilities. These emergent abilities have been extended with multi-modality to include…

Information Retrieval · Computer Science 2025-05-19 Li Yang , Anushya Subbiah , Hardik Patel , Judith Yue Li , Yanwei Song , Reza Mirghaderi , Vikram Aggarwal , Qifan Wang

In recent years, large language models (LLM) have emerged as powerful tools for diverse natural language processing tasks. However, their potential for recommender systems under the generative recommendation paradigm remains relatively…

Information Retrieval · Computer Science 2023-07-11 Jianchao Ji , Zelong Li , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Juntao Tan , Yongfeng Zhang

Ensuring the products displayed in e-commerce search results are relevant to users queries is crucial for improving the user experience. With their advanced semantic understanding, deep learning models have been widely used for relevance…

Information Retrieval · Computer Science 2025-05-13 Hongwei Shang , Nguyen Vo , Nitin Yadav , Tian Zhang , Ajit Puthenputhussery , Xunfan Cai , Shuyi Chen , Prijith Chandran , Changsung Kang