English
Related papers

Related papers: Start Small, Think Big: On Hyperparameter Optimiza…

200 papers

Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance…

Machine Learning · Computer Science 2022-11-16 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Sebastian Rojas Gonzalez

Capturing associations for knowledge graphs (KGs) through entity alignment, entity type inference and other related tasks benefits NLP applications with comprehensive knowledge representations. Recent related methods built on Euclidean…

Computation and Language · Computer Science 2020-10-06 Zequn Sun , Muhao Chen , Wei Hu , Chengming Wang , Jian Dai , Wei Zhang

The primary aim of Knowledge Graph embeddings (KGE) is to learn low-dimensional representations of entities and relations for predicting missing facts. While rotation-based methods like RotatE and QuatE perform well in KGE, they face two…

Computation and Language · Computer Science 2024-10-03 Yihua Zhu , Hidetoshi Shimodaira

Subsampling is effective in Knowledge Graph Embedding (KGE) for reducing overfitting caused by the sparsity in Knowledge Graph (KG) datasets. However, current subsampling approaches consider only frequencies of queries that consist of…

Computation and Language · Computer Science 2024-04-15 Xincan Feng , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

This paper presents a novel approach to network management by integrating intent-based networking (IBN) with knowledge graphs (KGs), creating a more intuitive and efficient pipeline for service orchestration. By mapping high-level business…

Networking and Internet Architecture · Computer Science 2024-05-14 Kashif Mehmood , Katina Kralevska , David Palma

The goal of representation learning of knowledge graph is to encode both entities and relations into a low-dimensional embedding spaces. Many recent works have demonstrated the benefits of knowledge graph embedding on knowledge graph…

Artificial Intelligence · Computer Science 2019-10-11 Wenqiang Liu , Hongyun Cai , Xu Cheng , Sifa Xie , Yipeng Yu , Hanyu Zhang

Recent work on hyperparameters optimization (HPO) has shown the possibility of training certain hyperparameters together with regular parameters. However, these online HPO algorithms still require running evaluation on a set of validation…

Machine Learning · Computer Science 2021-01-19 Jingkang Wang , Mengye Ren , Ilija Bogunovic , Yuwen Xiong , Raquel Urtasun

Graph representation of structured data can facilitate the extraction of stereoscopic features, and it has demonstrated excellent ability when working with deep learning systems, the so-called Graph Neural Networks (GNNs). Choosing a…

Machine Learning · Computer Science 2021-01-27 Yingfang Yuan , Wenjun Wang , George M. Coghill , Wei Pang

The design of good heuristics or approximation algorithms for NP-hard combinatorial optimization problems often requires significant specialized knowledge and trial-and-error. Can we automate this challenging, tedious process, and learn the…

Machine Learning · Computer Science 2018-02-23 Hanjun Dai , Elias B. Khalil , Yuyu Zhang , Bistra Dilkina , Le Song

Knowledge graph embedding (KGE) models learn the representation of entities and relations in knowledge graphs. Distance-based methods show promising performance on link prediction task, which predicts the result by the distance between two…

Computation and Language · Computer Science 2022-12-26 Baoxin Wang , Qingye Meng , Ziyue Wang , Honghong Zhao , Dayong Wu , Wanxiang Che , Shijin Wang , Zhigang Chen , Cong Liu

Knowledge Graphs (KGs) are ubiquitous structures for information storagein several real-world applications such as web search, e-commerce, social networks, and biology. Querying KGs remains a foundational and challenging problem due to…

Machine Learning · Computer Science 2021-05-14 Nurendra Choudhary , Nikhil Rao , Sumeet Katariya , Karthik Subbian , Chandan K. Reddy

Protein language models have emerged as powerful tools for sequence generation, offering substantial advantages in functional optimization and denovo design. However, these models also present significant risks of generating harmful protein…

Artificial Intelligence · Computer Science 2025-07-16 Yuhao Wang , Keyan Ding , Kehua Feng , Zeyuan Wang , Ming Qin , Xiaotong Li , Qiang Zhang , Huajun Chen

Graphs have been widely used to represent complex data in many applications. Efficient and effective analysis of graphs is important for graph-based applications. However, most graph analysis tasks are combinatorial optimization (CO)…

Machine Learning · Computer Science 2021-04-23 Yun Peng , Byron Choi , Jianliang Xu

Deep recommender systems rely heavily on large embedding tables to handle high-cardinality categorical features such as user/item identifiers, and face significant memory constraints at scale. To tackle this challenge, hashing techniques…

Information Retrieval · Computer Science 2025-02-11 Xinyi Wu , Donald Loveland , Runjin Chen , Yozen Liu , Xin Chen , Leonardo Neves , Ali Jadbabaie , Clark Mingxuan Ju , Neil Shah , Tong Zhao

Link Prediction on Hyper-relational Knowledge Graphs (HKG) is a worthwhile endeavor. HKG consists of hyper-relational facts (H-Facts), composed of a main triple and several auxiliary attribute-value qualifiers, which can effectively…

Artificial Intelligence · Computer Science 2023-10-17 Haoran Luo , Haihong E , Yuhao Yang , Yikai Guo , Mingzhi Sun , Tianyu Yao , Zichen Tang , Kaiyang Wan , Meina Song , Wei Lin

The performance of any Machine Learning (ML) algorithm is impacted by the choice of its hyperparameters. As training and evaluating a ML algorithm is usually expensive, the hyperparameter optimization (HPO) method needs to be…

Machine Learning · Computer Science 2022-09-12 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Gonzalo Nápoles

Knowledge graph completion (KGC) has attracted considerable attention in recent years because it is critical to improving the quality of knowledge graphs. Researchers have continuously explored various models. However, most previous efforts…

Machine Learning · Computer Science 2025-05-30 Linyu Li , Zhi Jin , Yuanpeng He , Dongming Jin , Haoran Duan , Zhengwei Tao , Xuan Zhang , Jiandong Li

Combinatorial Optimisation problems arise in several application domains and are often formulated in terms of graphs. Many of these problems are NP-hard, but exact solutions are not always needed. Several heuristics have been developed to…

Machine Learning · Computer Science 2022-05-23 David Ireland , Giovanni Montana

It is common for real-world applications to analyze big graphs using distributed graph processing systems. Popular in-memory systems require an enormous amount of resources to handle big graphs. While several out-of-core approaches have…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-08 Peng Sun , Yonggang Wen , Ta Nguyen Binh Duong , Xiaokui Xiao

Model-based Reinforcement Learning (MBRL) is a promising framework for learning control in a data-efficient manner. MBRL algorithms can be fairly complex due to the separate dynamics modeling and the subsequent planning algorithm, and as a…

Machine Learning · Computer Science 2021-03-01 Baohe Zhang , Raghu Rajan , Luis Pineda , Nathan Lambert , André Biedenkapp , Kurtland Chua , Frank Hutter , Roberto Calandra