English
Related papers

Related papers: Hybrid Encoder: Towards Efficient and Precise Nati…

200 papers

Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space. Autoencoder-based language models are appealing in dense retrieval as they train the encoder to output high-quality…

Machine Learning · Computer Science 2021-09-17 Shuqi Lu , Di He , Chenyan Xiong , Guolin Ke , Waleed Malik , Zhicheng Dou , Paul Bennett , Tieyan Liu , Arnold Overwijk

Dividing ads ranking system into retrieval, early, and final stages is a common practice in large scale ads recommendation to balance the efficiency and accuracy. The early stage ranking often uses efficient models to generate candidates…

Information Retrieval · Computer Science 2023-07-24 Xuewei Wang , Qiang Jin , Shengyu Huang , Min Zhang , Xi Liu , Zhengli Zhao , Yukun Chen , Zhengyu Zhang , Jiyan Yang , Ellie Wen , Sagar Chordia , Wenlin Chen , Qin Huang

This paper presents GEneric iNtent Encoder (GEN Encoder) which learns a distributed representation space for user intent in search. Leveraging large scale user clicks from Bing search logs as weak supervision of user intent, GEN Encoder…

Information Retrieval · Computer Science 2019-07-26 Hongfei Zhang , Xia Song , Chenyan Xiong , Corby Rosset , Paul N. Bennett , Nick Craswell , Saurabh Tiwary

Applications increasingly leverage mixed-modality data, and must jointly search over vector data, such as embedded images, text and video, as well as structured data, such as attributes and keywords. Proposed methods for this hybrid search…

Information Retrieval · Computer Science 2024-03-11 Liana Patel , Peter Kraft , Carlos Guestrin , Matei Zaharia

Using Artificial Neural Networks (ANN) for nonlinear system identification has proven to be a promising approach, but despite of all recent research efforts, many practical and theoretical problems still remain open. Specifically, noise…

Systems and Control · Electrical Eng. & Systems 2023-07-06 Gerben I. Beintema , Maarten Schoukens , Roland Tóth

With the explosion of online news, personalized news recommendation becomes increasingly important for online news platforms to help their users find interesting information. Existing news recommendation methods achieve personalization by…

Information Retrieval · Computer Science 2020-04-02 Suyu Ge , Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang

Alternative recommender systems are critical for ecommerce companies. They guide customers to explore a massive product catalog and assist customers to find the right products among an overwhelming number of options. However, it is a…

Information Retrieval · Computer Science 2021-04-16 Mingming Guo , Nian Yan , Xiquan Cui , San He Wu , Unaiza Ahsan , Rebecca West , Khalifeh Al Jadda

Predicting the next utterance in dialogue is contingent on encoding of users' input text to generate appropriate and relevant response in data-driven approaches. Although the semantic and syntactic quality of the language generated is…

Computation and Language · Computer Science 2021-06-22 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

One of the main challenges in drug discovery is to find molecules that bind specifically and strongly to their target protein while having minimal binding to other proteins. By predicting binding affinity, it is possible to identify the…

Quantum Physics · Physics 2023-01-19 L. Domingo , M. Djukic , C. Johnson , F. Borondo

Cross-modal retrieval between visual data and natural language description remains a long-standing challenge in multimedia. While recent image-text retrieval methods offer great promise by learning deep representations aligned across…

News recommendation systems rely on automated sentiment analysis to personalise content and enhance user engagement. Conventional approaches often struggle with ambiguity, lexicon inconsistencies, and limited contextual understanding,…

Information Retrieval · Computer Science 2026-01-07 Eunice Kingenga , Mike Wa Nkongolo

Transformers have revolutionized machine learning with their simple yet effective architecture. Pre-training Transformers on massive text datasets from the Internet has led to unmatched generalization for natural language understanding…

This paper presents a hybrid machine learning method of classifying residential requests in natural language to responsible departments that provide timely responses back to residents under the vision of digital government services in smart…

Computation and Language · Computer Science 2019-12-24 T. Chen , J. Sun , H. Lin , Y. Liu

Due to the highly parallelizable architecture, Transformer is faster to train than RNN-based models and popularly used in machine translation tasks. However, at inference time, each output word requires all the hidden states of the…

Computation and Language · Computer Science 2019-09-06 Chengyi Wang , Shuangzhi Wu , Shujie Liu

Existing information retrieval systems are largely constrained by their reliance on vector inner products to assess query-document relevance, which naturally limits the expressiveness of the relevance score they can produce. We propose a…

Information Retrieval · Computer Science 2025-05-02 Julian Killingback , Hansi Zeng , Hamed Zamani

Interaction and navigation defined by natural language instructions in dynamic environments pose significant challenges for neural agents. This paper focuses on addressing two challenges: handling long sequence of subtasks, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Alexander Pashevich , Cordelia Schmid , Chen Sun

The RNN-Transducers and improved attention-based encoder-decoder models are widely applied to streaming speech recognition. Compared with these two end-to-end models, the CTC model is more efficient in training and inference. However, it…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

Implicit Neural Representations (INRs) offer exceptional fidelity for video compression by learning per-video optimized functions, but their adoption is crippled by impractically slow encoding times. Existing attempts to accelerate INR…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Vikram Rangarajan , Shishira Maiya , Max Ehrlich , Abhinav Shrivastava

Semantic communication (SemCom) is accelerating its momentum to catch up with the massive increase in users' demands in both quantity and quality, with the assistance of advanced deep learning (DL) techniques. Specifically, SemCom can…

Information Theory · Computer Science 2026-05-11 Loc X. Nguyen , Phuong-Nam Tran , Trung Thanh Pham , Avi Deb Raha , Eui-Nam Huh , Zhu Han , Choong Seon Hong