中文
相关论文

相关论文: Two-Stage Feature Generation with Transformer and …

200 篇论文

Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given…

人工智能 · 计算机科学 2017-09-22 Udayan Khurana , Horst Samulowitz , Deepak Turaga

Simulating the human mobility and generating large-scale trajectories are of great use in many real-world applications, such as urban planning, epidemic spreading analysis, and geographic privacy protect. Although many previous works have…

机器学习 · 计算机科学 2023-01-19 Wenjun Jiang , Wayne Xin Zhao , Jingyuan Wang , Jiawei Jiang

In this paper, we propose a transformer-based architecture, called two-stage transformer neural network (TSTNN) for end-to-end speech denoising in the time domain. The proposed model is composed of an encoder, a two-stage transformer module…

音频与语音处理 · 电气工程与系统科学 2021-03-19 Kai Wang , Bengbeng He , Wei-Ping Zhu

Representation (feature) space is an environment where data points are vectorized, distances are computed, patterns are characterized, and geometric structures are embedded. Extracting a good representation space is critical to address the…

机器学习 · 计算机科学 2022-05-31 Dongjie Wang , Yanjie Fu , Kunpeng Liu , Xiaolin Li , Yan Solihin

Graph-structured scene descriptions can be efficiently used in generative models to control the composition of the generated image. Previous approaches are based on the combination of graph convolutional networks and adversarial methods for…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Renato Sortino , Simone Palazzo , Concetto Spampinato

Image forgery localization aims to identify forged regions by capturing subtle traces from high-quality discriminative features. In this paper, we propose a Transformer-style network with two feature extraction branches for image forgery…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Yaqi Liu , Binbin Lv , Xin Jin , Xiaoyu Chen , Xiaokun Zhang

Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Huijie Zhang , Yifu Lu , Ismail Alkhouri , Saiprasad Ravishankar , Dogyoon Song , Qing Qu

The Two-Stage Learning-to-Defer (L2D) framework has been extensively studied for classification and, more recently, regression tasks. However, many real-world applications require solving both tasks jointly in a multi-task setting. We…

机器学习 · 统计学 2025-08-15 Yannis Montreuil , Shu Heng Yeo , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Federated learning (FL) is a viable technique to train a shared machine learning model without sharing data. Hierarchical FL (HFL) system has yet to be studied regrading its multiple levels of energy, computation, communication, and client…

机器学习 · 计算机科学 2024-06-24 Xiaojing Chen , Zhenyuan Li , Wei Ni , Xin Wang , Shunqing Zhang , Yanzan Sun , Shugong Xu , Qingqi Pei

Conventional works generally employ a two-phase model in which a generator selects the most important pieces, followed by a predictor that makes predictions based on the selected pieces. However, such a two-phase model may incur the…

机器学习 · 计算机科学 2022-09-21 Wei Liu , Haozhao Wang , Jun Wang , Ruixuan Li , Chao Yue , Yuankai Zhang

Random Fourier features (RFFs) provide a promising way for kernel learning in a spectral case. Current RFFs-based kernel learning methods usually work in a two-stage way. In the first-stage process, learning the optimal feature map is often…

机器学习 · 计算机科学 2024-01-17 Kun Fang , Fanghui Liu , Xiaolin Huang , Jie Yang

Feature transformation for AI is an essential task to boost the effectiveness and interpretability of machine learning (ML). Feature transformation aims to transform original data to identify an optimal feature space that enhances the…

机器学习 · 计算机科学 2023-01-03 Meng Xiao , Dongjie Wang , Min Wu , Ziyue Qiao , Pengfei Wang , Kunpeng Liu , Yuanchun Zhou , Yanjie Fu

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

机器学习 · 计算机科学 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often,…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Salaheldin Mohamed

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

计算机视觉与模式识别 · 计算机科学 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

Feature transformation aims to extract a good representation (feature) space by mathematically transforming existing features. It is crucial to address the curse of dimensionality, enhance model generalization, overcome data sparsity, and…

机器学习 · 计算机科学 2022-12-26 Meng Xiao , Dongjie Wang , Min Wu , Kunpeng Liu , Hui Xiong , Yuanchun Zhou , Yanjie Fu

Image fusion is a technique to integrate information from multiple source images with complementary information to improve the richness of a single image. Due to insufficient task-specific training data and corresponding ground truth, most…

计算机视觉与模式识别 · 计算机科学 2022-01-20 Linhao Qu , Shaolei Liu , Manning Wang , Shiman Li , Siqi Yin , Qin Qiao , Zhijian Song

As neural networks are increasingly being applied to real-world applications, mechanisms to address distributional shift and sequential task learning without forgetting are critical. Methods incorporating network expansion have shown…

机器学习 · 计算机科学 2021-03-26 Vinay Kumar Verma , Kevin J Liang , Nikhil Mehta , Piyush Rai , Lawrence Carin

We introduce ECHO, a transformer-operator framework for generating million-point PDE trajectories. While existing neural operators (NOs) have shown promise for solving partial differential equations, they remain limited in practice due to…

机器学习 · 计算机科学 2025-12-05 Armand Kassaï Koupaï , Lise Le Boudec , Patrick Gallinari

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

信息检索 · 计算机科学 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong