The Effect of Automated Error Message Feedback on Undergraduate Physics Students Learning Python: Reducing Anxiety and Building Confidence



Charles, Tessa ORCID: 0000-0001-8710-5021 and Gwilliam, Carl ORCID: 0000-0002-9401-5304
(2023) The Effect of Automated Error Message Feedback on Undergraduate Physics Students Learning Python: Reducing Anxiety and Building Confidence. Journal for STEM Education Research, 6 (2). pp. 326-357.

Access the full-text of this item by clicking on the Open Access link.

Abstract

<jats:title>Abstract</jats:title><jats:p>STEM fields, such as physics, increasingly rely on complex programs to analyse large datasets, thus teaching students the required programming skills is an important component of all STEM curricula. Since undergraduate students often have no prior coding experience, they are reliant on error messages as the primary diagnostic tool to identify and correct coding mistakes. However, such messages are notoriously cryptic and often undecipherable for novice programmers, presenting a significant learning hurdle that leads to frustration, discouragement, and ultimately a loss of confidence. Addressing this, we developed a tool to enhance error messages for the popular <jats:sc>Python</jats:sc> language, translating them into plain English to empower students to resolve the underlying error independently. We used a mixed methods approach to study the tool’s effect on first-year physics students undertaking an introductory programming course. We find a broadly similar distribution of the most common error types to previous studies in other contexts. Our results show a statistically significant reduction in negative student emotions, such as frustration and anxiety, with the mean self-reported intensity of these emotions reducing by (73 ± 12)<jats:italic>%</jats:italic> and (55 ± 18)%, respectively. This led to a corresponding decrease in discouragement and an increase in student confidence. We conclude that enhanced error messages provide an effective way to alleviate negative student emotions and promote confidence. However, further longer-term investigations are necessary to confirm if this translates into improved learning outcomes. To our knowledge, this is the first physics-specific investigation of the effect of <jats:sc>Python</jats:sc> error message enhancement on student learning.</jats:p>

Item Type: Article
Divisions: Faculty of Science and Engineering > School of Physical Sciences
Depositing User: Symplectic Admin
Date Deposited: 28 Apr 2023 08:29
Last Modified: 01 Sep 2023 07:58
DOI: 10.1007/s41979-022-00084-4
Open Access URL: https://link.springer.com/content/pdf/10.1007/s419...
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3170029