Tuning knowledge graph embeddings in clustering with LISE1
Abstract
Knowledge Graph Embeddings are increasingly used in biomedical informatics to support similarity assessment, clustering, and knowledge discovery. Despite strong performance in link prediction, recent studies show that numerical proximity in embedding spaces does not always reflect meaningful semantic similarity. LISE (Logic-based Interactive Similarity Explainer) was introduced to expose shared semantic properties among clustered RDF resources and incorporate user feedback when evaluating cluster coherence. This work extends the previous system to LISE1 by integrating Large Language Models for natural-language explanation and investigating whether user-derived relevance signals can actively influence embedding generation, improving the semantic adequacy of similarity-based clustering. The human satisfaction with LISE1 refinement process has been evaluated in a sample of real users. We replaced LISE’s template-based verbalization component with a Gemini 2.5 Flash module capable of generating human-readable, path-level explanations of logical Common Subsumers. This resolves previous LISE limitations related to granularity and anaphora resolution, enabling reliable sentence-level user evaluations. To assess whether user preferences can guide the embedding process, we simulated feedback on 1,280 DrugBank-derived triples and evaluated two custom pyRDF2Vec sampling strategies: Predicate Relevance Weight and Predicate-Object Relevance Weight. Relevance weights were learned via a random forest regressor trained on simulated user scores. Predicate-level weighting increased the presence of user-preferred predicates in the most cohesive clusters, with all predicates showing positive or neutral deviation under learned weights. By contrast, predicate-object weighting exhibited limited sensitivity, with most pairs showing unchanged frequency regardless of weight assignment. Average deviation metrics confirm that predicate-level adjustments redirect clustering more effectively toward semantically meaningful biomedical information. User studies involving 23 participants further showed greater satisfaction with clusters refined using predicate-level weighting strategies and reveal a general improvement in users’ scores after embedding refinement. User-informed predicate weighting can successfully influence embedding-based clustering, improving alignment with semantically relevant biomedical properties. Predicate-object adjustments provide minimal benefit.
// Source
Authors: Verdiana Schena, Simona Colucci, Francesco M. Donini, Floriano Scioscia, Eugenio Di Sciascio
Institutions: Università degli Studi della Tuscia, Polytechnic University of Bari