Intra- and interobserver reliability of gray scale/dynamic range evaluation of ultrasonography using a standardized phantom.
- Author:
Song LEE
1
;
Joon Il CHOI
;
Michael Yong PARK
;
Dong Myung YEO
;
Jae Young BYUN
;
Seung Eun JUNG
;
Sung Eun RHA
;
Soon Nam OH
;
Young Joon LEE
Author Information
1. Department of Radiology, Seoul St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul, Korea. dumkycji@gmail.com
- Publication Type:Original Article
- Keywords:
Ultrasonography;
Imaging phantoms;
Health care quality assurance;
Reproducibility of results
- MeSH:
Education;
Phantoms, Imaging;
Quality Assurance, Health Care;
Reproducibility of Results;
Ultrasonography*
- From:
Ultrasonography
2014;33(2):91-97
- CountryRepublic of Korea
- Language:English
-
Abstract:
PURPOSE: To evaluate intra- and interobserver reliability of the gray scale/dynamic range of the phantom image evaluation of ultrasonography using a standardized phantom, and to assess the effect of interactive education on the reliability. METHODS: Three radiologists (a resident, and two board-certified radiologists with 2 and 7 years of experience in evaluating ultrasound phantom images) performed the gray scale/dynamic range test for an ultrasound machine using a standardized phantom. They scored the number of visible cylindrical structures of varying degrees of brightness and made a 'pass or fail' decision. First, they scored 49 phantom images twice from a 2010 survey with limited knowledge of phantom images. After this, the radiologists underwent two hours of interactive education for the phantom images and scored another 91 phantom images from a 2011 survey twice. Intra- and interobserver reliability before and after the interactive education session were analyzed using K analyses. RESULTS: Before education, the K-value for intraobserver reliability for the radiologist with 7 years of experience, 2 years of experience, and the resident was 0.386, 0.469, and 0.465, respectively. After education, the K-values were improved (0.823, 0.611, and 0.711, respectively). For interobserver reliability, the K-value was also better after the education for the 3 participants (0.067, 0.002, and 0.547 before education; 0.635, 0.667, and 0.616 after education, respectively). CONCLUSION: The intra- and interobserver reliability of the gray scale/dynamic range was fair to substantial. Interactive education can improve reliability. For more reliable results, double-checking of phantom images by multiple reviewers is recommended.
