Semanlink - TheWebConf

A Single Vector Is Not Enough: Taxonomy Expansion via Box Embeddings | Proceedings of the ACM Web Conference 2023

Tags:

2023-05-02 About

[2010.03496] Inductive Entity Representations from Text via Link Prediction

Tags:

BLP "BERT for Link Prediction". Central idea: **training an entity encoder with a
link prediction objective** (using the textual descriptions of entities when computing entity representations - hence not failing with entities unknown in training)

> a method for **learning representations
of entities**, that uses a **pre-trained Transformer** based
architecture as an entity encoder, and
**link prediction training on a knowledge graph
with textual entity descriptions**.

> using entity descriptions,
an entity encoder is trained for link prediction in
a knowledge graph. The encoder can then be used
without fine-tuning to obtain features for entity classification
and information retrieval

Cites [Xie et al](doc:2020/10/representation_learning_of_know) and [Kepler](doc:2020/11/1911_06136_kepler_a_unified_). They claim that their
objective targeted exclusively for link prediction (and not an objective that combines language modeling
and link prediction as Kepler)
performs better than Kepler's more complex one.

2020-11-03 About

[2001.09522] TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Network

Tags:

how to add a set of new concepts to an existing taxonomy.

[Tweet](https://twitter.com/mickeyjs6/status/1253772146142216194?s=20) [GitHub](https://github.com/mickeystroller/TaxoExpan)

> we study the taxonomy expansion task: given an
existing taxonomy and a set of new emerging concepts, we aim
to automatically expand the taxonomy to incorporate these new
concepts (without changing the existing relations in the given taxonomy).

> To the best of our knowledge, this is the first study on **how to
expand an existing directed acyclic graph (as we model a taxonomy
as a DAG) using self-supervised learning**.

Self-supervised framework, the existing taxonomy being used as training data: it learns a model to predict whether a query concept is the direct hyponym of an anchor concept.

> 2 techniques:
>
> 1. a **position-enhanced graph neural network that encodes the local structure of an anchor concept** in the existing taxonomy,
> 2. a noise-robust training objective that enables the learned model to be insensitive to the label noise in the self-supervision data.

Regarding 1: uses [GNN](/tag/graph_neural_networks.html) to model the "ego network" of concepts (potential “siblings”
and “grand parents” of the query concept).

> Regular
GNNs fail to distinguish nodes with different relative positions to
the query (i.e., some nodes are grand parents of the query while
the others are siblings of the query). To address this limitation, we
present a simple but effective enhancement to inject such position
information into GNNs using position embedding. We show that
such embedding can be easily integrated with existing GNN architectures
(e.g., [GCN](/tag/graph_convolutional_networks) and GAT) and significantly boosts the
prediction performance

Regarding point 2: uses InfoNCE loss, cf. [Contrastive Predictive Coding](/doc/?uri=https%3A%2F%2Farxiv.org%2Fabs%2F1807.03748)

> Instead of predicting
whether each individual ⟨query concept, anchor concept⟩ pair
is positive or not, we first group all pairs sharing the same query
concept into a single training instance and learn a model to select
the positive pair among other negative ones from the group.

(Hum, ça me rappelle quelque chose)

> assume each concept (in existing taxonomy + set of new concepts) has an initial embedding
vector learned from some text associated with this concept.

To keep things tractable, only attempts to find a single parent node of each new concept.

2020-04-25 About

Combining knowledge graphs, quickly and accurately (2020)

Tags:

2020-03-19 About

Matching Resumes to Jobs via Deep Siamese Network | Companion Proceedings of the The Web Conference 2018

Tags:

2020-02-10 About

Semantic Text Matching for Long-Form Documents (2019)

Tags:

2020-01-23 About

Knowledge Graph Technology and Applications 2019 - Simia

Tags:

2019-05-23 About

International Workshop on Deep Learning for Graphs and Structured Data Embedding

Tags:

2019-04-30 About

Microsoft Academic

Tags:

2019-02-25 About

Improving Word Embedding Compositionality using Lexicographic Definitions

Tags:

2018-05-10 About

That Makes Sense: Joint Sense Retrofitting from Contextual and Ontological Information

Tags:

post-processing method for generating low-dimensional sense embedding. Emploies the ontological and contextual information simultaneously.

(Poster at the Web Conf) [Github](https://github.com/y95847frank/Joint-Retrofitting)

Calcule des "sense embeddings", en partant de word embeddings pré-calculés (par ex avec word2vec), et de données de type lexicographiques (ex wordnet), en contraignant, pour un sens, la distance entre sense et word embedding.

Abstract:

> While recent word embedding models demonstrate their abilities to capture syntactic and semantic information, the demand for sense level embedding is getting higher. In this study, we propose a novel joint sense embedding learning model that retrofits the word representation into sense representation from contextual and ontological information. The experiments show the effectiveness and robustness of our model that outperforms previous approaches in four public available benchmark datasets.

> Given a trained word embedding and a lexical ontology that contains sense level relationships (e.g., synonym, hypernym, etc.), our model generates new sense vectors via constraining the distance between the sense vector and its word form vector, its sense neighbors and its contextual neighbors

[Influenced by](/doc/?uri=https%3A%2F%2Farxiv.org%2Fabs%2F1411.4166) (which post-processes and modifies word vectors to incorporate knowledge from semantic lexicons, while this creates new sense vectors)

2018-05-10 About

Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learning

Tags:

2018-05-10 About

TUTORIAL: Graph-based Text Representations (SLIDES)

Tags:

2018-05-10 About

TUTORIAL: Graph-based Text Representations: Boosting Text Mining, NLP and Information Retrieval with Graphs

Tags:

2018-05-10 About

TUTORIAL: Representation Learning on Networks - TheWebConf 2018

Tags:

Network representation learning (NRL): Approaches that automatically learn to encode network structure into low-dimensional embeddings, using techniques based on deep learning and nonlinear dimensionality reduction

**Goal of representation learning for networks: efficient task-independant feature learning for ML in networks.** But it's hard. DL toolbox are designed for single sequences or grids (for instance CNN for images, RNN or word2vec are fixed size), but networks are far more complex!

from the abstract:

> In this tutorial, we will cover key advancements in NRL over the last decade, with an emphasis on fundamental advancements made in the last two years. We will discuss classic matrix factorization-based methods (e.g., Laplacian eigenmaps), random-walk based algorithms (e.g., DeepWalk and node2vec), as well as very recent advancements in graph convolutional networks (GCNs). We will cover methods to embed individual nodes (see [node embeddings](/tag/node_embeddings)) as well as approaches to embed entire (sub)graphs, and in doing so, we will present a unified framework for NRL.

2018-05-05 About

Smart-MD: Neural Paragraph Retrieval of Medical Topics

Tags:

2018-04-28 About

L’inventeur du Web exhorte à réguler l’intelligence artificielle

Tags:

2018-04-28 About

HighLife: Higher-arity Fact Harvesting

Tags:

2018-04-28 About

« Le Web a développé des résistances antibiotiques à la démocratie »

Tags:

2018-04-26 About

GraphChain – A Distributed Database with Explicit Semantics and Chained RDF Graphs

Tags:

2018-04-25 About

GraphChain

Tags:

2018-04-25 About

PROCEEDINGS – The Web Conference in Lyon

Tags:

TheWebConf 2018

2018-04-23 About

Improving the Compositionality of Word Embeddings (2017)

Tags:

(MS thesis, a [paper at TheWebConf 2018](/doc/?uri=https%3A%2F%2Fdoi.org%2F10.1145%2F3178876.3186007))

> This thesis explores a method to find better encodings of meaning a computer can work with. We specifically want to combine encodings of word meanings in such a way that a good encoding of their joint meaning is created. The act of combining multiple representations of meaning into a new representation of meaning is called semantic composition.

Analysis of four word embeddings (Word2Vec, GloVe, fastText and Paragram)  in terms of their semantic compositionality. A method to tune these embeddings towards better compositionality, using a simple neural network architecture with definitions and lemmas from WordNet.

> Since dictionary definitions are semantically similar to their associated lemmas, they are the ideal candidate for our tuning method, as well as evaluating for compositionality. Our architecture allows for the embeddings to be composed using simple arithmetic operations, which makes these embeddings specifically suitable for production applications such as web search and data mining. We also explore more elaborate and involved compositional models, such as recurrent composition and convolutional composition.

2018-02-13 About

RESEARCH TRACK: Web Content Analysis, Semantics and Knowledge

Tags:

[CFP](https://www2018.thewebconf.org/call-for-papers/research-tracks-cfp/web-content-analysis/)

> In previous years, ‘content analysis’ and ‘semantic and knowledge’ were in separate track. This year, we combined these tracks to emphasize the close relationship between these topics; **the use of content to curate knowledge and the use of knowledge to guide content analysis and intelligent usage**.

Some of the accepted papers:
### [Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN](https://doi.org/10.1145/3178876.3186005)

[Hierarchical Text Classification](/tag/nlp_hierarchical_text_classification): Text classification to a hierarchical taxonomy of topics, using graph representation of text, and CNN over this graph

Renvoie à ce qui a été vu dans le tutorial "Graph-based Text Representations"

from the abstract:

> a graph-CNN based deep learning model to first convert texts to graph-of-words, and then use graph convolution operations to convolve the word graph. Graph-of-words representation of texts has the advantage of capturing non-consecutive and long-distance semantics. CNN models have the advantage of learning different level of semantics. To further leverage the hierarchy of labels, we regularize the deep architecture with the dependency among labels

Conversion of text to graph: potentially given a single document

### [Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learning](https://doi.org/10.1145/3178876.3186024 )

Extraction de relations de corpus de textes de façon semi-supervisée, dans un contexte où on a peu de données labellisées décrivant les relations.

Par exemple, des données labellisées indique que le texte "Beijing, capital of China" correspond à la relation entre entités : ("Beijing", "Capital Of", "China), et on voudrait pouvoir extraire les entités et relations pertinentes à partir de texte tel que "Paris, France's capital,..."

Le papier décrit une méthode qui combine deux modules, l'un basé sur l'extraction automatique de patterns (par ex "[Head], Capital Of [Tail]") et l'autre sur la "sémantique distributionnelle" (du type "word embeddings"). Ces deux modules collaborent, le premier permettant de créer des instances de relations augmentant la base de connaissance sur lequel entrainer le second, et le second aidant le premier à déterminer des patterns informatifs ("co-entrainement")

### [Scalable Instance Reconstruction in Knowledge Bases via Relatedness Affiliated Embedding](https://doi.org/10.1145/3178876.3186017)

Knowledge base completion problem: usually, it is formulated as a link prediction problem, but not here. A novel knowledge embedding model ("Joint Modelling and Learning of Relatedness and Embedding")

### [Improving Word Embedding Compositionality using Lexicographic Definitions](https://doi.org/10.1145/3178876.3186007)

comment obtenir les meilleures représentations de texte à partir de représentations de mots (word embeddings) ? L'auteur utilise des ressources lexicographiques (wordnet) pour ses tests : l'embedding obtenu pour la définition d'un mot est-il proche de celui du mot ?

Le papier s'appuie sur une [thèse du même auteur](https://esc.fnwi.uva.nl/thesis/centraal/files/f1554608041.pdf), claire et bien écrite.

### [CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Information](https://doi.org/10.1145/3178876.3186030)

Amélioration de l'extraction de triplets (nom phrase, property, nom phrase) à partir de texte en calculant des embeddings pour les "nom phrases" (~entités)

### [Short-Text Topic Modeling via Non-negative Matrix Factorization Enriched with Local Word-Context Correlations](https://doi.org/10.1145/3178876.3186009)

Topic modeling for short texts, leveraging the word-context semantic correlations in the training

### [Towards Annotating Relational Data on the Web with Language Models](https://doi.org/10.1145/3178876.3186029)

### A paper by [David Blei](/tag/david_blei): (Dynamic Embeddings for Language Evolution)

2018-01-27 About

TUTORIAL: Representation Learning on Networks - TheWebConf 2018

Tags:

2018-01-27 About

WORKSHOP: BigNet @ WWW 2018 Workshop on Learning Representations for Big Networks

Tags:

2018-01-27 About

Deriving an Emergent Relational Schema from RDF Data

Tags:

2015-05-22 About

Topic modeling with network regularization

Tags:

2014-04-23 About

Using SKOS vocabularies for improving Web Search

Tags:

2013-05-30 About

Describing Customizable Products on the Web of Data (LDOW 2013)

Tags:

2013-05-28 About

Bloco do Sargento Pimenta

Tags:

2013-05-21 About

Rethinking the Web as a Personal Archive

Tags:

2013-05-21 About

Tutorial: Linked Data Query Processing

Tags:

2013-05-18 About

Live topic generation from event streams

Tags:

2013-05-17 About

Rio Scenarium

Tags:

2013-05-15 About

“We need people to translate the whole Web”: Luis Von Ahn | WWW 2013 – Rio de Janeiro, Brazil

Tags:

2013-05-15 About

Building a Web of Needs, Florian Kleedorfer

Tags:

2013-05-14 About

An introduction to semantic web and linked data

Tags:

2013-05-14 About

Describing Customizable Products on the Web of Data, LDOW 2013

Tags:

2013-04-25 About

Linked Data on the Web (LDOW2013) - Workshop at WWW2013, Rio de Janeiro, Brazil

Tags:

LDOW2013

2013-03-02 About

Notes from the WWW 2012 conference

Tags:

2012-04-30 About

From Linked Data to Linked Entities: a Migration Path - Giovanni Bartolomeo, Stefano Salsano

Tags:

2012-04-20 About

Linked Data on the Web Workshop at WWW 2012 - semanticweb.com

Tags:

2012-04-20 About

LINDEN: Linking Named Entities with Knowledge Base via Semantic Knowledge

Tags:

2012-04-19 About

Counting beyond a Yottabyte, or how SPARQL 1.1 Property Paths will prevent adoption of the standard | Semantic Web Dog Food

Tags:

2012-04-19 About

Tracks & Accepted papers | www2012

Tags:

WWW 2012

2012-04-18 About

Factorizing Yago: scalable machine learning for the sw

Tags:

2012-04-18 About

Semantic CMS and Wikis as Platforms for Linked Learning

Tags:

2012-04-17 About

Talis Aspire

Tags:

2012-04-17 About

Linked Data on the Web Workshop, Lyon « Ivan’s private site

Tags:

2012-04-17 About

A Spectrometry of Linked Data

Tags:

Entity mining is still a troublesome open problem. In past years many approaches allowed to automate the generation of equivalence links between references using schema matching or various heuristics based on the recognition of similar property values. In contrast, few of them considered the analysis of the network of equivalence links (“equivalence network”) as an indication of the likelihood and strength of the equivalence.

Could a URI reference (URIRef) be thought as exactly “attached” to its referent? Could it make sense to talk about entity “identifiers” or would it be better to talk about more ambiguous “references”, i.e., placeholders for any model that satisfies the formal semantics of the Semantic Web (Hayes)? Booth observes that the aforementioned question, which in the past has been often regarded as fundamental in the debate about identity on the Web, is relatively unimportant. As long as an entity, identified by whatsoever URIRef, is associated to at least one description containing machine understandable information, this information can be automatically processed and used by applications.

2012-04-16 About

Interacting with the Web of Data through a Web of Inter-connected Lenses

Tags:

2012-04-16 About

Querying the Web of Interlinked Datasets using VOID Descriptions

Tags:

2012-04-16 About

Using read/write Linked Data for Application Integration – Towards a Linked Data Basic Profile

Tags:

2012-04-16 About

NERD meets NIF: Lifting NLP Extraction Results to the Linked Data Cloud

Tags:

2012-04-16 About

Synote: Weaving Media Fragments and Linked Data

Tags:

2012-04-16 About

Linked Data on the Web (LDOW2012) - Workshop at WWW2012, Lyon, France

Tags:

LDOW2012

2012-04-16 About

Automated interlinking of speech radio archives

Tags:

2012-04-14 About

Emerging Web Technologies, Facing the Future of Education — EducTice

Tags:

2012-04-11 About

Emerging Web Technologies, Facing the Future of Education — EducTice

Tags:

2011-12-22 About

Linked Learning 2012

Tags:

2011-12-17 About

Proceedings of the WWW2008 Workshop on Linked Data on the Web

Tags:

LDOW2008

2010-09-16 About

Interactively using Semantic Web knowledge: Creating scalable abstractions with FacetOntology

Tags:

2009-03-05 About

What is Linked Data? » AI3:::Adaptive Information

Tags:

2008-06-24 About

Keynotes at WWW 2008 - Geeking with Greg

Tags:

WWW 2008

2008-06-22 About

WWW 2008 keynotes - Erik Selberg » Blog Archive » Themes from Beijing

Tags:

WWW 2008

2008-06-22 About

Sir Tim Berners-Lee addresses WWW2008 in Beijing

Tags:

2008-06-22 About

A Prototype Knowledge Base for the Life Sciences

Tags:

2008-06-12 About

Commercialising the Semantic Web (panel at www 2008)

Tags:

2008-05-17 About

More News: Update from WWW2008

Tags:

WWW 2008

2008-05-16 About

Linking Enterprise Data (slides)

Tags:

2008-05-08 About

Linking Enterprise Data

Tags:

2008-05-08 About

Flickr: Items tagged with ldow2008

Tags:

LDOW2008

2008-05-06 About

VirtualChaos - Nadeem’s blog » WWW2008: Day 2 - LDOW2008 Workshop

Tags:

LDOW2008

2008-05-04 About

Linked Data Trip Report - Part 1 (WWW2008)

Tags:

2008-05-04 About

swig-2008-04-22

Tags:

fps AND LDOW2008

2008-05-04 About

Linked Data and Information Architecture

Tags:

2008-05-04 About

BoaB interactive - Web design, graphic design, multimedia, Content Management System (CMS)

Tags:

2008-05-04 About

SitePoint Blogs » WWW2008 Beijing: Day 1 - Linked Data on the Web (LDOW 2008) Workshop

Tags:

2008-05-04 About

Semantic MediaWiki - Semantic-mediawiki.org

Tags:

2008-04-25 About

I Really _Don't_ Know: LDOW2008

Tags:

LDOW2008

2008-04-24 About

Attending WWW2008 : Alexandre Passant

Tags:

2008-04-24 About

Linked Data on the Web, WWW2008 | The Semantic Web | ZDNet.com

Tags:

2008-04-24 About

Apex Data & Knowledge Management Lab

Tags:

2008-04-23 About

COMM: Core Ontology on Multimedia

Tags:

2008-04-23 About

Structured Objects in OWL: Representation and Reasoning. In Proc. of the 17th Int. World Wide Web Conference (WWW 2008), Beijing

Tags:

Very good presentation at WWW 2008. Nominated for the best paper award<br/>
Abstract: Applications of semantic technologies often require the representation of and reasoning with structured objects—that is, objects composed of parts connected in complex ways. Although OWL is a general and powerful language, its class descriptions and axioms cannot be used to describe arbitrarily connected structures. An OWL representation of structured objects can thus be underconstrained, which reduces the inferences that can be drawn and causes performance problems in reasoning. To address these problems, we extend OWL with description graphs, which allow for the description of structured objects in a simple and precise way. To represent conditional aspects of the domain, we also allow for SWRL-like rules over description graphs. Based on an observation about the nature of structured objects, we ensure decidability of our formalism. We also present a hypertableau-based decision procedure, which we implemented in the HermiT reasoner. To evaluate its performance, we have extracted description graphs from the GALEN and FMA ontologies, classified them successfully, and even detected a modeling error in GALEN.

2008-04-23 About

Ben Adida - RDFa, slides du workshop à WWW2008

Tags: