TY - JOUR
PY - 2023//
TI - Testing the reliability of accident analysis methods: a comparison of AcciMap, STAMP-CAST and AcciNet
JO - Ergonomics
A1 - Hulme, Adam
A1 - Stanton, Neville A.
A1 - Walker, Guy H.
A1 - Waterson, Patrick
A1 - Salmon, Paul M.
SP - ePub
EP - ePub
VL - ePub
IS - ePub
N2 - Accident analysis methods are used to model the multifactorial cause of adverse incidents.
METHODS such as AcciMap, STAMP-CAST and recently AcciNet, are systemic approaches that support the identification of safety interventions across sociotechnical system levels. Despite their growing popularity, little is known about how reliable systems-based methods are when used to describe, model and classify contributory factors and relationships. Here, we conducted an intra-rater and inter-rater reliability assessment of AcciMap, STAMP-CAST and AcciNet using the Signal Detection Theory (SDT) paradigm. A total of 180 hours' worth of analyses across 360 comparisons were performed by 30 expert analysts.
FINDINGS revealed that all three methods produced a weak to moderate positive correlation coefficient, however the inter-rater reliability of STAMP-CAST was significantly higher compared to AcciMap and AcciNet. No statistically significant or practically meaningful differences were found between methods in the overall intra-rater reliability analyses. Implications and future research directions are discussed.
Language: en
LA - en SN - 0014-0139 UR - http://dx.doi.org/10.1080/00140139.2023.2240048 ID - ref1 ER -