Repository logo
 
Publication

The influence of experience and training in a group of novice observers: a jackknife alternative free-response receiver operating characteristic analysis

2014-07Journal article Restricted access
Simple item page
dc.contributor.authorBuissink, C.
dc.contributor.authorThompson, John D.
dc.contributor.authorVoet, M.
dc.contributor.authorSanderud, Audun
dc.contributor.authorKamping, L. V.
dc.contributor.authorSavary, L.
dc.contributor.authorMughal, M.
dc.contributor.authorRocha, C. S.
dc.contributor.authorHart, G. E.
dc.contributor.authorParreiral, R.
dc.contributor.authorMartin, G.
dc.contributor.authorHogg, Peter
dc.date.accessioned2014-08-08T10:15:36Z
dc.date.available2014-08-08T10:15:36Z
dc.date.issued2014-07
dc.description.abstractPurpose - The study evaluates the pre- and post-training lesion localisation ability of a group of novice observers. Parallels are drawn with the performance of inexperienced radiographers taking part in preliminary clinical evaluation (PCE) and ‘red-dot’ systems, operating within radiography practice. Materials and methods - Thirty-four novice observers searched 92 images for simulated lesions. Pre-training and post-training evaluations were completed following the free-response the receiver operating characteristic (FROC) method. Training consisted of observer performance methodology, the characteristics of the simulated lesions and information on lesion frequency. Jackknife alternative FROC (JAFROC) and highest rating inferred ROC analyses were performed to evaluate performance difference on lesion-based and case-based decisions. The significance level of the test was set at 0.05 to control the probability of Type I error. Results - JAFROC analysis (F(3,33) = 26.34, p < 0.0001) and highest-rating inferred ROC analysis (F(3,33) = 10.65, p = 0.0026) revealed a statistically significant difference in lesion detection performance. The JAFROC figure-of-merit was 0.563 (95% CI 0.512,0.614) pre-training and 0.677 (95% CI 0.639,0.715) post-training. Highest rating inferred ROC figure-of-merit was 0.728 (95% CI 0.701,0.755) pre-training and 0.772 (95% CI 0.750,0.793) post-training. Conclusions - This study has demonstrated that novice observer performance can improve significantly. This study design may have relevance in the assessment of inexperienced radiographers taking part in PCE or commenting scheme for trauma.por
dc.identifier.citationBuissink C, Thompson JD, Voet M, Sanderud A, Rocha CS, Parreiral R, et al. The influence of experience and training in a group of novice observers: a jackknife alternative free-response receiver operating characteristic analysis. Radiography. 2014;20(4):300-5.por
dc.identifier.doi10.1016/j.radi.2014.06.016
dc.identifier.urihttp://hdl.handle.net/10400.21/3749
dc.language.isoengpor
dc.peerreviewedyespor
dc.publisherElsevierpor
dc.relation.publisherversionhttp://www.sciencedirect.com/science/article/pii/S107881741400100X#por
dc.subjectRadiologypor
dc.subjectNovice observerpor
dc.subjectROCpor
dc.subjectFROCpor
dc.subjectJAFROCpor
dc.titleThe influence of experience and training in a group of novice observers: a jackknife alternative free-response receiver operating characteristic analysispor
dc.typejournal article
dspace.entity.typePublication
oaire.citation.endPage6por
oaire.citation.startPage1por
oaire.citation.titleRadiographypor
rcaap.rightsrestrictedAccesspor
rcaap.typearticlepor

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
The influence of experience and training in a group of novice observers.pdf
Size:
450.5 KB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

ESTeSL - Artigos