English
Related papers

Related papers: LAST at CMCL 2021 Shared Task: Predicting Gaze Dat…

200 papers

Eye movements are intricate and dynamic biosignals that contain a wealth of cognitive information about the subject. However, these are ambiguous signals and therefore require meticulous feature engineering to be used by machine learning…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Louise Gillian C. Bautista , Prospero C. Naval

Cognitively inspired Natural Language Pro-cessing uses human-derived behavioral datalike eye-tracking data, which reflect the seman-tic representations of language in the humanbrain to augment the neural nets to solve arange of tasks…

Computation and Language · Computer Science 2021-10-12 Varun Madhavan , Aditya Girish Pawate , Shraman Pal , Abhranil Chandra

Large Language Models (LLM) have brought numerous of new applications to Machine Learning (ML). In the context of tabular data (TD), recent studies show that TabLLM is a very powerful mechanism for few-shot-learning (FSL) applications, even…

Machine Learning · Computer Science 2024-11-08 Carlos Huertas

Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-regularized framework that enhances VLMs for two key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anupam Pani , Yanchao Yang

Training vision-language models on cognitively-plausible amounts of data requires rethinking how models integrate multimodal information. Within the constraints of the Vision track for the BabyLM Challenge 2025, we propose a lightweight…

Artificial Intelligence · Computer Science 2025-10-10 Bianca-Mihaela Ganescu , Suchir Salhan , Andrew Caines , Paula Buttery

The ACM RecSys Challenge 2023, organized by ShareChat, aims to predict the probability of the app being installed. This paper describes the lightweight solution to this challenge. We formulate the task as a user response prediction task.…

Machine Learning · Computer Science 2023-10-09 Hyeonwoo Kim , Wonsung Lee

Today's most accurate language models are trained on orders of magnitude more language data than human language learners receive - but with no supervision from other sensory modalities that play a crucial role in human learning. Can we make…

Computation and Language · Computer Science 2024-03-22 Chengxu Zhuang , Evelina Fedorenko , Jacob Andreas

Multi-task learning (MTL) paradigm focuses on jointly learning two or more tasks, aiming for significant improvement w.r.t model's generalizability, performance, and training/inference memory footprint. The aforementioned benefits become…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nitin Bansal , Pan Ji , Junsong Yuan , Yi Xu

Large language models (LLMs) has experienced exponential growth, they demonstrate remarkable performance across various tasks. Notwithstanding, contemporary research primarily centers on enhancing the size and quality of pretraining data,…

Programming Languages · Computer Science 2024-04-16 Mengnan Qi , Yufan Huang , Yongqiang Yao , Maoquan Wang , Bin Gu , Neel Sundaresan

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

The BabyLM Challenge is a community effort to close the data-efficiency gap between human and computational language learners. Participants compete to optimize language model training on a fixed language data budget of 100 million words or…

We present the submission of the ILLC at the University of Amsterdam to the BabyLM challenge (Warstadt et al., 2023), in the strict-small track. Our final model, ChapGTP, is a masked language model that was trained for 200 epochs, aided by…

Computation and Language · Computer Science 2023-10-18 Jaap Jumelet , Michael Hanna , Marianne de Heer Kloots , Anna Langedijk , Charlotte Pouw , Oskar van der Wal

Recently, vision model pre-training has evolved from relying on manually annotated datasets to leveraging large-scale, web-crawled image-text data. Despite these advances, there is no pre-training method that effectively exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chenyu Yang , Xizhou Zhu , Jinguo Zhu , Weijie Su , Junjie Wang , Xuan Dong , Wenhai Wang , Lewei Lu , Bin Li , Jie Zhou , Yu Qiao , Jifeng Dai

This paper describes the system proposed for the SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection. We focused our approach on the detection problem. Given the semantics of words captured by temporal word embeddings in…

Computation and Language · Computer Science 2020-05-21 Pierluigi Cassotti , Annalina Caputo , Marco Polignano , Pierpaolo Basile

In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, we collect a new…

Computation and Language · Computer Science 2020-10-16 Jonathan Malmaud , Roger Levy , Yevgeni Berzak

In this paper, we propose a Light Gradient Boosting (LightGBM) to forecast dominant wave periods in oceanic waters. First, we use the data collected from CDIP buoys and apply various data filtering methods. The data filtering methods allow…

Atmospheric and Oceanic Physics · Physics 2021-07-15 Pujan Pokhrel

In-context Learning (ICL) is the ability of Large Language Models (LLMs) to perform new tasks when conditioned on prompts comprising a few task examples. However, ICL performance can be critically sensitive to the choice of examples. To…

Computation and Language · Computer Science 2024-02-23 Shivanshu Gupta , Clemens Rosenbaum , Ethan R. Elenberg

In this article, we present our methodologies for SemEval-2021 Task-4: Reading Comprehension of Abstract Meaning. Given a fill-in-the-blank-type question and a corresponding context, the task is to predict the most suitable word from a list…

Computation and Language · Computer Science 2022-02-24 Abheesht Sharma , Harshit Pandey , Gunjan Chhablani , Yash Bhartia , Tirtharaj Dash

Eye gaze estimation has become increasingly significant in computer vision.In this paper,we systematically study the mainstream of eye gaze estimation methods,propose a novel methodology to estimate eye gaze points and eye gaze directions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yong Huang , Ben Chen , Daiming Qu

Reading is a complex process which requires proper understanding of texts in order to create coherent mental representations. However, comprehension problems may arise due to hard-to-understand sections, which can prove troublesome for…

Computation and Language · Computer Science 2021-04-15 George-Eduard Zaharia , Dumitru-Clementin Cercel , Mihai Dascalu