Semanlink - Deep Learning ; Knowledge Graphs AND Survey / Review

[2306.08302] Unifying Large Language Models and Knowledge Graphs: A Roadmap

Tags:

2023-06-18 About

Graph ML in 2023: The State of Affairs | by Michael Galkin | Towards Data Science

Tags:

2023-01-03 About

[2101.12294] Combining pre-trained language models and structured knowledge

Tags:

2022-03-25 About

The knowledge graph as the default data model for learning on heterogeneous knowledge (2017)

Tags:

2019-08-22 About

Knowledge Graph Embedding: A Survey of Approaches and Applications - IEEE (2017)

Tags:

- "facts only" based embeddings
    - Translational Distance Models, distance-based scoring functions
       - TransE and co: entities and relations as points in vector space
           - TransH: relation-specific hyperplanes.
       - Gaussian Embeddings: entities and relations as random variables
    - Semantic matching models, similarity-based scoring functions
        - RESCAL (entities as a vector, relation as a matrix) and familiy
            - DistMult (relation as diagonal matrix)
            - Holographic Embeddings (HolE)
            - etc.
        - Matching with Neural Networks
            - SME, etc
- incorporating other info: entity types, relation paths,
textual descriptions, as well as logical rules
    - entity types
        - semantically smooth embedding
(SSE):  entities of the same type to stay close
to each other in the embedding space
        - type-embodied knowledge representation
learning (TKRL), which can handle hierarchical
entity categories and multiple category labels
- Applications in downstream tasks

2019-05-27 About