Explainable AI Tools for Legal Reasoning about Cases: A Study on The European Court of Human Rights

Collenette, Joe, Atkinson, Katie ORCID: 0000-0002-5683-4106 and Bench-Capon, Trevor (2023) Explainable AI Tools for Legal Reasoning about Cases: A Study on The European Court of Human Rights. Artificial Intelligence, 317. p. 103861.

Access the full-text of this item by clicking on the Open Access link.

Abstract

In this paper we report on a significant research project undertaken to design, implement and evaluate explainable decision-support tools for deciding legal cases. We provide a model of a legal domain, Article 6 of the European Convention on Human Rights, constructed using a methodology from the field of computational models of argument. We describe how the formal model has been developed, extended and transformed into practical tools, which were then used in evaluation exercises to determine the effectiveness and usability of the tools. The underpinning AI techniques used yield a level of explanation that is firmly grounded in legal reasoning and is also digestible by the target end users, as demonstrated through our evaluation activities. The results of our experimental evaluation show that on the first pass, our tool achieved an accuracy rate of 97% in matching the actual decisions of the cases and the user studies conducted gave highly encouraging results with respect to usability. As such, our project demonstrates how trustworthy AI tools can be built for a real world legal domain where critical needs of the end users are accounted for.

Item Type:	Article
Divisions:	Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User:	Symplectic Admin
Date Deposited:	30 Jan 2023 11:48
Last Modified:	03 Feb 2023 23:50
DOI:	10.1016/j.artint.2023.103861
Open Access URL:	https://doi.org/10.1016/j.artint.2023.103861
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3167954