English
Related papers

Related papers: Start Small, Think Big: On Hyperparameter Optimiza…

200 papers

In recent years, graph neural networks (GNNs) have gained increasing attention, as they possess the excellent capability of processing graph-related problems. In practice, hyperparameter optimisation (HPO) is critical for GNNs to achieve…

Machine Learning · Computer Science 2021-04-29 Yingfang Yuan , Wenjun Wang , Wei Pang

Graph neural networks (GNNs) have emerged as the state of the art for a variety of graph-related tasks and have been widely used in Heterogeneous Graphs (HetGs), where meta-paths help encode specific semantics between various node types.…

Machine Learning · Computer Science 2025-02-25 Xuqi Mao , Zhenying He , X. Sean Wang

The increasing demand for democratizing machine learning algorithms calls for hyperparameter optimization (HPO) solutions at low cost. Many machine learning algorithms have hyperparameters which can cause a large variation in the training…

Machine Learning · Computer Science 2020-12-24 Qingyun Wu , Chi Wang , Silu Huang

Knowledge graphs (KGs) have proven to be effective for high-quality recommendation, where the connectivities between users and items provide rich and complementary information to user-item interactions. Most existing methods, however, are…

Information Retrieval · Computer Science 2021-09-16 Xiao Sha , Zhu Sun , Jie Zhang

Knowledge graph (KG) plays an increasingly important role to improve the recommendation performance and interpretability. A recent technical trend is to design end-to-end models based on information propagation schemes. However, existing…

Information Retrieval · Computer Science 2022-04-12 Yuntao Du , Xinjun Zhu , Lu Chen , Baihua Zheng , Yunjun Gao

Graph data structures are widely used to store relational information between several entities. With data being generated worldwide on a large scale, we see a significant growth in the generation of knowledge graphs. Thing in the future is…

Artificial Intelligence · Computer Science 2023-10-24 Rohith Teja Mittakola , Thomas Hassan

Embedding entities and relations of a knowledge graph in a low-dimensional space has shown impressive performance in predicting missing links between entities. Although progresses have been achieved, existing methods are heuristically…

Computation and Language · Computer Science 2021-01-26 Danushka Bollegala , Huda Hakami , Yuichi Yoshida , Ken-ichi Kawarabayashi

Learning the embeddings of knowledge graphs (KG) is vital in artificial intelligence, and can benefit various downstream applications, such as recommendation and question answering. In recent years, many research efforts have been proposed…

Artificial Intelligence · Computer Science 2022-10-25 Zhiping Luo , Wentao Xu , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

Graph-based methods are known to be successful in many machine learning and pattern classification tasks. These methods consider semi-structured data as graphs where nodes correspond to primitives (parts, interest points, segments, etc.)…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Anjan Dutta , Hichem Sahbi

Knowledge Graph Embedding (KGE) models are used to learn continuous representations of entities and relations. A key task in the literature is predicting missing links between entities. However, Knowledge Graphs are not just sets of links…

Artificial Intelligence · Computer Science 2023-08-28 Thiviyan Thanapalasingam , Emile van Krieken , Peter Bloem , Paul Groth

Knowledge Graph Embedding methods aim at representing entities and relations in a knowledge base as points or vectors in a continuous vector space. Several approaches using embeddings have shown promising results on tasks such as link…

Computation and Language · Computer Science 2018-11-12 Tommaso Soru , Stefano Ruberto , Diego Moussallem , André Valdestilhas , Alexander Bigerl , Edgard Marx , Diego Esteves

One of the most critical issues in machine learning is the selection of appropriate hyper parameters for training models. Machine learning models may be able to reach the best training performance and may increase the ability to generalize…

Machine Learning · Computer Science 2023-02-23 Caner Erden , Halil Ibrahim Demir , Abdullah Hulusi Kökçam

Knowledge Graph (KG) is a flexible structure that is able to describe the complex relationship between data entities. Currently, most KG embedding models are trained based on negative sampling, i.e., the model aims to maximize some…

Artificial Intelligence · Computer Science 2021-06-17 Zelong Li , Jianchao Ji , Zuohui Fu , Yingqiang Ge , Shuyuan Xu , Chong Chen , Yongfeng Zhang

Different from traditional knowledge graphs (KGs) where facts are represented as entity-relation-entity triplets, hyper-relational KGs (HKGs) allow triplets to be associated with additional relation-entity pairs (a.k.a qualifiers) to convey…

Machine Learning · Computer Science 2021-04-19 Donghan Yu , Yiming Yang

Hyperparameter optimization (HPO) is crucial for fine-tuning machine learning models but can be computationally expensive. To reduce costs, Multi-fidelity HPO (MF-HPO) leverages intermediate accuracy levels in the learning process and…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Isabelle Guyon , Yixuan Sun , Prasanna Balaprakash

In a previous work we introduced, in the context of gravitational wave science, an initial study on an automated domain-decomposition approach for reduced basis through hp-greedy refinement. The approach constructs local reduced bases of…

General Relativity and Quantum Cosmology · Physics 2023-10-24 Franco Cerino , Andrés Diaz-Pace , Emmanuel Tassone , Manuel Tiglio , Atuel Villegas

The performance of fine-tuning pre-trained language models largely depends on the hyperparameter configuration. In this paper, we investigate the performance of modern hyperparameter optimization methods (HPO) on fine-tuning pre-trained…

Computation and Language · Computer Science 2021-06-18 Xueqing Liu , Chi Wang

Knowledge graph embedding (KGE) has caught significant interest for its effectiveness in knowledge graph completion (KGC), specifically link prediction (LP), with recent KGE models cracking the LP benchmarks. Despite the rapidly growing…

Machine Learning · Computer Science 2024-05-16 Shurong Wang , Yufei Zhang , Xuliang Huang , Hongwei Wang

Multi-hop knowledge graph (KG) reasoning is an effective and explainable method for predicting the target entity via reasoning paths in query answering (QA) task. Most previous methods assume that every relation in KGs has enough training…

Artificial Intelligence · Computer Science 2019-09-02 Xin Lv , Yuxian Gu , Xu Han , Lei Hou , Juanzi Li , Zhiyuan Liu

Hyperparameter optimization (HPO) is a critical component of machine learning pipelines, significantly affecting model robustness, stability, and generalization. However, HPO is often a time-consuming and computationally intensive task.…

Machine Learning · Computer Science 2025-03-10 Ruinan Wang , Ian Nabney , Mohammad Golbabaee