Human Performance on the AI Legal Case Verdict Classification Task



Mumford, Jack ORCID: 0000-0003-2467-5785, Atkinson, Katie ORCID: 0000-0002-5683-4106 and Bench-Capon, Trevor ORCID: 0000-0003-3975-4398
(2023) Human Performance on the AI Legal Case Verdict Classification Task. In: 36th International Conference on Legal Knowledge and Information Systems, 2023-12-18 - 2023-12-20, Maastricht.

[img] Text
JURIX_2023___Human_AI.pdf - Author Accepted Manuscript

Download (89kB) | Preview

Abstract

<jats:p>We report a study undertaken to analyse human performance on the verdict classification task. Several approaches have addressed this task with outcomes compared against the outcomes from actual legal cases. Results vary and we investigate how classification is done by humans. A key finding is that fact descriptions alone are insufficient for accurate classification, independent of legal background.</jats:p>

Item Type: Conference or Workshop Item (Unspecified)
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 08 Dec 2023 16:45
Last Modified: 15 Mar 2024 04:14
DOI: 10.3233/faia230988
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3177223