English
Related papers

Related papers: SAGE: Sequence-level Adaptive Gradient Evolution f…

200 papers

Model-based reinforcement learning algorithms are typically more sample efficient than their model-free counterparts, especially in sparse reward problems. Unfortunately, many interesting domains are too complex to specify the complete…

Machine Learning · Computer Science 2022-03-11 Andrew Chester , Michael Dann , Fabio Zambetta , John Thangarajah

Data augmentation is a key element for training accurate models by reducing overfitting and improving generalization. For image classification, the most popular data augmentation techniques range from simple photometric and geometrical…

Machine Learning · Computer Science 2022-11-02 Avery Ma , Nikita Dvornik , Ran Zhang , Leila Pishdad , Konstantinos G. Derpanis , Afsaneh Fazly

We introduce Synthetic Alignment data Generation for Safety Evaluation and Red Teaming (SAGE-RT or SAGE) a novel pipeline for generating synthetic alignment and red-teaming data. Existing methods fall short in creating nuanced and diverse…

Artificial Intelligence · Computer Science 2024-08-23 Anurakt Kumar , Divyanshu Kumar , Jatan Loya , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Large language model (LLM) based recommendation agents personalize what they know through evolving per-user semantic memory, yet how they reason remains a universal, static system prompt shared identically across all users. This asymmetry…

Information Retrieval · Computer Science 2026-04-22 Zhen Tao , Riwei Lai , Chenyun Yu , Weixin Chen , Li Chen , Beibei Kong , Lei Cheng , Chengxiang Zhuo , Zang Li , Qingqiang Sun

While deep learning approaches have shown remarkable performance in many imaging tasks, most of these methods rely on availability of large quantities of data. Medical image data, however, is scarce and fragmented. Generative Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2022-06-07 Padmaja Jonnalagedda , Brent Weinberg , Jason Allen , Taejin L. Min , Shiv Bhanu , Bir Bhanu

As large language models (LLMs) achieve strong performance on traditional benchmarks, there is an urgent need for more challenging evaluation frameworks that probe deeper aspects of semantic understanding. We introduce SAGE (Semantic…

Artificial Intelligence · Computer Science 2025-09-26 Samarth Goel , Reagan J. Lee , Kannan Ramchandran

The vision of an inclusive World Wide Web is impeded by a severe linguistic divide, particularly for communities in low-resource regions of Southeast Asia. While large language models (LLMs) offer a potential solution for translation, their…

Computation and Language · Computer Science 2026-03-23 Zhixiang Lu , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Imran Razzak , Jionglong Su , Zhengyong Jiang

Training modern neural networks on large datasets is computationally and energy intensive. We present SAGE, a streaming data-subset selection method that maintains a compact Frequent Directions (FD) sketch of gradient geometry in $O(\ell…

Machine Learning · Computer Science 2025-10-10 Ashish Jha , Salman Ahmadi-Asl

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

Self-evolution methods enhance code generation through iterative "generate-verify-refine" cycles, yet existing approaches suffer from low exploration efficiency, failing to discover solutions with superior complexity within limited budgets.…

Computation and Language · Computer Science 2026-02-13 Tu Hu , Ronghao Chen , Shuo Zhang , Jianghao Yin , Mou Xiao Feng , Jingping Liu , Shaolei Zhang , Wenqi Jiang , Yuqi Fang , Sen Hu , Huacan Wang , Yi Xu

Generative recommendation treats next-item prediction as autoregressive item-identifier generation. Specifically, items are encoded as semantic identifiers (SIDs), which are short coarse-to-fine token sequences whose early tokens capture…

Artificial Intelligence · Computer Science 2026-05-19 Zaiyi Zheng , Guanghui Min , Yaochen Zhu , Liang Wu , Liangjie Hong , Chen Chen , Jundong Li

Generative recommendation models sequence generation to produce items end-to-end, but training from behavioral logs often provides weak supervision on underlying user intent. Although Large Language Models (LLMs) offer rich semantic priors…

Information Retrieval · Computer Science 2026-02-26 Jie Jiang , Hongbo Tang , Wenjie Wu , Yangru Huang , Zhenmao Li , Qian Li , Changping Wang , Jun Zhang , Huan Yu

Deep search agents, which aim to answer complex questions requiring reasoning across multiple documents, can significantly speed up the information-seeking process. Collecting human annotations for this application is prohibitively…

Artificial Intelligence · Computer Science 2026-01-27 Fangyuan Xu , Rujun Han , Yanfei Chen , Zifeng Wang , I-Hung Hsu , Jun Yan , Vishy Tirumalashetty , Eunsol Choi , Tomas Pfister , Chen-Yu Lee

Reinforcement learning is essential for neural architecture search and hyperparameter optimization, but the conventional approaches impede widespread use due to prohibitive time and computational costs. Inspired by DeepSeek-V3 multi-token…

Machine Learning · Computer Science 2025-06-19 Zheng Li , Jerry Cheng , Huanying Helen Gu

Unsupervised Domain Adaptation (UDA) aims to bridge the gap between a source domain, where labelled data are available, and a target domain only represented with unlabelled data. If domain invariant representations have dramatically…

Machine Learning · Computer Science 2020-12-04 Victor Bouvier , Philippe Very , Clément Chastagnol , Myriam Tami , Céline Hudelot

In this paper, we propose a self-supervised visual representation learning approach which involves both generative and discriminative proxies, where we focus on the former part by requiring the target network to recover the original image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yunjie Tian , Lingxi Xie , Xiaopeng Zhang , Jiemin Fang , Haohang Xu , Wei Huang , Jianbin Jiao , Qi Tian , Qixiang Ye

Recent advancements in large language model alignment leverage token-level supervisions to perform fine-grained preference optimization. However, existing token-level alignment methods either optimize on all available tokens, which can be…

Computation and Language · Computer Science 2025-11-07 Kailai Yang , Zhiwei Liu , Qianqian Xie , Jimin Huang , Erxue Min , Sophia Ananiadou

Sequential recommender systems have demonstrated strong capabilities in modeling users' dynamic preferences and capturing item transition patterns. However, real-world user behaviors are often noisy due to factors such as human errors,…

Information Retrieval · Computer Science 2026-04-13 Kaike Zhang , Qi Cao , Fei Sun , Xinran Liu , Huawei Shen , Xueqi Cheng

Music streaming fraud, where bad actors artificially inflate stream counts to manipulate chart rankings and royalty payments, poses a significant threat to streaming services and legitimate content creators. Traditional fraud detection…

Machine Learning · Computer Science 2026-05-20 Sudheer Tubati , Amit Goyal

Reinforcement learning (RL) plays an increasingly important role in enhancing the reasoning capabilities of large language models (LLMs), yet stable and performant policy optimization remains challenging. Token-level importance ratios often…

Machine Learning · Computer Science 2025-12-02 Chang Gao , Chujie Zheng , Xiong-Hui Chen , Kai Dang , Shixuan Liu , Bowen Yu , An Yang , Shuai Bai , Jingren Zhou , Junyang Lin