Responsible LLM Deployment for High-Stake Decisions by Decentralized Technologies and Human-AI Interactions

Sachan, S ORCID: 0000-0003-0136-0553, Miller, T and Nguyen, MP (2025) Responsible LLM Deployment for High-Stake Decisions by Decentralized Technologies and Human-AI Interactions In: 2025 IEEE 5th International Conference on Human-Machine Systems (ICHMS), 2025-5-26 - 2025-5-28, Abu Dhabi, UAE.

Text IEEE_ICHMS_Accepted_version.pdf - Author Accepted Manuscript Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

High-stakes domains are exploring the transformative potential of Large Language Models (LLMs) for complex decision-making tasks. However, LLM deployment in real-world settings presents challenges in data security, evaluation of its capabilities outside controlled environments, and accountability attribution in the event of adversarial decisions. This paper proposes a framework for responsible deployment of LLM-based decision-support systems through active human involvement. It integrates interactive collaboration between human experts and developers through multiple iterations at the pre-deployment stage to assess the uncertain samples and judge the stability of the explanation provided by post-hoc XAI techniques. Local LLM deployment within organizations and decentralized technologies, such as Blockchain and IPFS, are proposed to create immutable records of LLM activities for automated auditing to enhance security and trace back accountability. It was tested on Bert-largeuncased, Mistral, and LLaMA 2 & 3 models to assess the capability to support responsible financial decisions on business lending.

Item Type:	Conference Item (Unspecified)
Uncontrolled Keywords:	46 Information and Computing Sciences, 4604 Cybersecurity and Privacy
Divisions:	Faculty of Humanities & Social Sciences Faculty of Humanities & Social Sciences > School of Management Faculty of Humanities & Social Sciences > Faculty of Humanities & Social Sci (All T&R Staff) Faculty of Humanities & Social Sciences > School of Management > Finance and Accounting Faculty of Humanities & Social Sciences > School of Management > School of Management (T&R Staff)
Depositing User:	Symplectic Admin
Date Deposited:	18 Mar 2026 08:13
Last Modified:	23 May 2026 09:52
DOI:	10.1109/ICHMS65439.2025.11154208
Related Websites:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3197571
Disclaimer:	The University of Liverpool is not responsible for content contained on other websites from links within repository metadata. Please contact us if you notice anything that appears incorrect or inappropriate.