Masahiro, Kaneko and Bollegala, D 
ORCID: 0000-0003-4476-7003
(2019)
Gender-preserving Debiasing for Pre-trained Word Embeddings
In: Annual Meeting of the Association for Computational Linguistics, 2019-7-28 - 2019-8-2, Florence, Italy.
Abstract
Word embeddings learnt from massive text collections have demonstrated significant levels of discriminative biases such as gender, racial or ethnic biases, which in turn bias the down-stream NLP applications that use those word embeddings. Taking gender-bias as a working example, we propose a debiasing method that preserves non-discriminative gender-related information, while removing stereotypical discriminative gender biases from pre-trained word embeddings. Specifically, we consider four types of information: feminine, masculine, gender-neutral and stereotypical, which represent the relationship between gender vs. bias, and propose a debiasing method that (a) preserves the gender-related information in feminine and masculine words, (b) preserves the neutrality in gender-neutral words, and (c) removes the biases from stereotypical words. Experimental results on several previously proposed benchmark datasets show that our proposed method can debias pre-trained word embeddings better than existing SoTA methods proposed for debiasing word embeddings while preserving gender-related but non-discriminative information.
| Item Type: | Conference Item (Unspecified) |
|---|---|
| Additional Information: | Accepted as a long paper to the 57th Annual Conference of the Association for Computational Linguistics (ACL-2019) |
| Uncontrolled Keywords: | cs.CL, cs.CL, cs.LG |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 02 Sep 2019 08:29 |
| Last Modified: | 16 Jun 2026 15:27 |
| Open Access URL: | https://www.aclweb.org/anthology/P19-1160/ |
| Related Websites: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3053018 |
| Disclaimer: | The University of Liverpool is not responsible for content contained on other websites from links within repository metadata. Please contact us if you notice anything that appears incorrect or inappropriate. |
Altmetric
Altmetric