English
Related papers

Related papers: Optimization Methods for Designing Sequences with …

200 papers

Internal language model (ILM) subtraction has been widely applied to improve the performance of the RNN-Transducer with external language model (LM) fusion for speech recognition. In this work, we show that sequence discriminative training…

Sound · Computer Science 2024-04-16 Zijian Yang , Wei Zhou , Ralf Schlüter , Hermann Ney

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

We propose LangProp, a framework for iteratively optimizing code generated by large language models (LLMs), in both supervised and reinforcement learning settings. While LLMs can generate sensible coding solutions zero-shot, they are often…

Software Engineering · Computer Science 2024-05-06 Shu Ishida , Gianluca Corrado , George Fedoseev , Hudson Yeo , Lloyd Russell , Jamie Shotton , João F. Henriques , Anthony Hu

Accurate mobile device localization is critical for emerging 5G/6G applications such as autonomous vehicles and augmented reality. In this paper, we propose a unified localization method that integrates model-based and machine learning…

Signal Processing · Electrical Eng. & Systems 2025-09-09 Yuhao Zhang , Guangjin Pan , Musa Furkan Keskin , Ossi Kaltiokallio , Mikko Valkama , Henk Wymeersch

Automated Machine Learning (AutoML) offers a promising approach to streamline the training of machine learning models. However, existing AutoML frameworks are often limited to unimodal scenarios and require extensive manual configuration.…

Machine Learning · Computer Science 2024-08-02 Daqin Luo , Chengjian Feng , Yuxuan Nong , Yiqing Shen

Household robots have been a longstanding research topic, but they still lack human-like intelligence, particularly in manipulating open-set objects and navigating large environments efficiently and accurately. To push this boundary, we…

Robotics · Computer Science 2025-07-22 Ruochu Yang , Yu Zhou , Fumin Zhang , Mengxue Hou

In-context learning (ICL), a property demonstrated by transformer-based sequence models, refers to the automatic inference of an input-output mapping based on examples of the mapping provided as context. ICL requires no explicit learning,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zihang Song , Osvaldo Simeone , Bipin Rajendran

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

Accurate uncertainty quantification is crucial for the safe deployment of machine learning models, and prior research has demonstrated improvements in the calibration of modern language models (LMs). We study in-context learning (ICL), a…

Computation and Language · Computer Science 2024-03-29 Hanlin Zhang , Yi-Fan Zhang , Yaodong Yu , Dhruv Madeka , Dean Foster , Eric Xing , Himabindu Lakkaraju , Sham Kakade

This paper optimizes the pilot assignment and pilot transmit powers to mitigate pilot contamination in Massive MIMO (multiple-input multiple-output) systems. While prior works have treated pilot assignment as a combinatorial problem, we…

Information Theory · Computer Science 2017-03-07 Trinh Van Chien , Emil Björnson , Erik G. Larsson

In this paper, the performance of adaptive turbo equalization for nonlinearity compensation (NLC) is investigated. A turbo equalization scheme is proposed where a recursive least-squares (RLS) algorithm is used as an adaptive channel…

Signal Processing · Electrical Eng. & Systems 2021-09-07 Edson Porto da Silva , Metodi Plamenov Yankov

Low complexity joint estimation of synchronization impairments and channel in a single-user MIMO-OFDM system is presented in this letter. Based on a system model that takes into account the effects of synchronization impairments such as…

Information Theory · Computer Science 2013-04-30 Renu Jose , Sooraj K. Ambat , K. V. S. Hari

Label Distribution Learning (LDL) is a novel machine learning paradigm that assigns label distribution to each instance. Many LDL methods proposed to leverage label correlation in the learning process to solve the exponential-sized output…

Machine Learning · Computer Science 2023-08-04 Zhiqiang Kou jing wang yuheng jia xin geng

In order to obtain a compact line segment-based map representation for localization and planning of mobile robots, it is necessary to merge redundant line segments which physically represent the same part of the environment in different…

Robotics · Computer Science 2020-06-23 Jian Wen , Xuebo Zhang , Haiming Gao , Jing Yuan , Yongchun Fang

In orthogonal frequency division multiplexing with index modulation (OFDM-IM), the active subcarriers can convey information bits by modulated symbols as well as their indices. OFDM-IM has attracted a great deal of attention from…

Information Theory · Computer Science 2020-01-07 Kee-Hoon Kim

In this paper, a novel modulation scheme called set partition modulation (SPM) is proposed. In this scheme, set partitioning and ordered subsets in the set partitions are used to form codewords. We define different SPM variants and depict a…

Signal Processing · Electrical Eng. & Systems 2019-10-25 Ferhat Yarkin , Justin P. Coon

In this paper, we consider a joint unicast and multi-group multicast cell-free distributed massive multiple-input multiple-output (MIMO) system, while accounting for co-pilot assignment strategy based channel estimation, pilot contamination…

Information Theory · Computer Science 2022-03-10 Jiamin Li , Qijun Pan , Zhenggang Wu , Pengcheng Zhu , Dongming Wang , Xiaohu You

In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs' outputs as labels is effective in…

Computation and Language · Computer Science 2024-04-04 Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Using in-context learning (ICL) for data generation, techniques such as Self-Instruct (Wang et al., 2023) or the follow-up Alpaca (Taori et al., 2023) can train strong conversational agents with only a small amount of human supervision. One…

Fine-tuning Large Language Models (LLMs) has proven effective for a variety of downstream tasks. However, as LLMs grow in size, the memory demands for backpropagation become increasingly prohibitive. Zeroth-order (ZO) optimization methods…

Machine Learning · Computer Science 2025-07-25 Ziming Yu , Pan Zhou , Sike Wang , Jia Li , Mi Tian , Hua Huang