Context-Guided Self-supervised Relation Embeddings



Hakami, Huda and Bollegala, Danushka ORCID: 0000-0003-4476-7003
(2020) Context-Guided Self-supervised Relation Embeddings. In: International Conference of the Pacific Association for Computational Linguistics, 2019-10-11 - 2019-10-13, Hanoi, Vietnam.

[img] Text
Hakami_PACLING_2019 (1).pdf - Accepted Version

Download (213kB) | Preview

Abstract

A semantic relation between two given words a and b can be represented using two complementary sources of information: (a) the semantic representations of a and b (expressed as word embeddings) and, (b) the contextual information obtained from the co-occurrence contexts of the two words (expressed in the form of lexico-syntactic patterns). Pattern-based approach suffers from sparsity while methods rely only on word embeddings for the related pairs lack of relational information. Prior works on relation embeddings have pre-dominantly focused on either one type of those two resources exclusively, except for a notable few exceptions. In this paper, we proposed a self-supervised context-guided Relation Embedding method (CGRE) using the two sources of information. We evaluate the learnt method to create relation representations for word-pairs that do not co-occur. Experimental results on SemEval-2012 task2 dataset show that the proposed operator outperforms other methods in representing relations for unobserved word-pairs.

Item Type: Conference or Workshop Item (Unspecified)
Depositing User: Symplectic Admin
Date Deposited: 07 Sep 2020 07:19
Last Modified: 27 Dec 2021 19:10
DOI: 10.1007/978-981-15-6168-9_6
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3099007