Improvement of intervention information detection for automated clinical literature screening during systematic review



Tsubota, Tadashi, Bollegala, Danushka ORCID: 0000-0003-4476-7003, Zhao, Yang, Jin, Yingzi and Kozu, Tomotake
(2022) Improvement of intervention information detection for automated clinical literature screening during systematic review. JOURNAL OF BIOMEDICAL INFORMATICS, 134. 104185-.

Access the full-text of this item by clicking on the Open Access link.

Abstract

Systematic literature review (SLR) is a crucial method for clinicians and policymakers to make their decisions in a flood of new clinical studies. Because manual literature screening in SLR is a highly laborious task, its automation by natural language processing (NLP) has been welcomed. Although intervention is a key information for literature screening, NLP models for its detection in previous works have not shown adequate performance. In this work, we first design an algorithm for automated construction of high-quality intervention labels by utilizing information retrieved from a clinical trial database. We then design another algorithm for improving model's recall and F1 score by imposing adaptive weights on training instances in the loss function. The intervention detection model trained on the weighted datasets is tested with the Evidence-Based Medicine NLP (EBM-NLP) corpus, and shows 9.7% and 4.0% improvements respectively in recall and F1 score compared to the previous state-of-the-art model on the corpus. The proposed algorithms can boost automation of literature screening during SLR in the clinical domain.

Item Type: Article
Uncontrolled Keywords: Clinical literature screening, Systematic review, Natural language processing, Intervention information detection
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 09 Sep 2022 08:54
Last Modified: 18 Jan 2023 20:45
DOI: 10.1016/j.jbi.2022.104185
Open Access URL: https://doi.org/10.1016/j.jbi.2022.104185
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3163990