TY - JOUR PY - 2023// TI - Testing the reliability of accident analysis methods: a comparison of AcciMap, STAMP-CAST and AcciNet JO - Ergonomics A1 - Hulme, Adam A1 - Stanton, Neville A. A1 - Walker, Guy H. A1 - Waterson, Patrick A1 - Salmon, Paul M. SP - ePub EP - ePub VL - ePub IS - ePub N2 - Accident analysis methods are used to model the multifactorial cause of adverse incidents.

METHODS such as AcciMap, STAMP-CAST and recently AcciNet, are systemic approaches that support the identification of safety interventions across sociotechnical system levels. Despite their growing popularity, little is known about how reliable systems-based methods are when used to describe, model and classify contributory factors and relationships. Here, we conducted an intra-rater and inter-rater reliability assessment of AcciMap, STAMP-CAST and AcciNet using the Signal Detection Theory (SDT) paradigm. A total of 180 hours' worth of analyses across 360 comparisons were performed by 30 expert analysts.

FINDINGS revealed that all three methods produced a weak to moderate positive correlation coefficient, however the inter-rater reliability of STAMP-CAST was significantly higher compared to AcciMap and AcciNet. No statistically significant or practically meaningful differences were found between methods in the overall intra-rater reliability analyses. Implications and future research directions are discussed.

Language: en

LA - en SN - 0014-0139 UR - http://dx.doi.org/10.1080/00140139.2023.2240048 ID - ref1 ER -