BACKGROUND: Recent findings on emergency department (ED) patient experience surveys and concerns for the low response rates challenge the quality and reliability of the survey reports. We assessed the consistency of an ED patient experience survey report and identified the effects of patient demographics on ED patient experiences. METHODS: We conducted a prospective, cross-sectional study at a university-based ED from July to December 2017. We obtained ED patient experience scores from an institutional version (IS) survey and the Press Ganey Associates-distributed survey (PGA). We compared top box scores from the two reports using frequency analysis and performed multivariable logistic regressions to identify associations between IS patient demographics and scores. RESULTS: We obtained 289 PGA and 234 IS responses. The IS reported significant, higher top box scores in doctor-specific patient questions compared to PGA (all four P-values < 0.01). Female, Christian and White patients were more likely to give top box scores (OR 3.07, OR 2.22 and OR 2.41, P-value < 0.05, respectively). CONCLUSION We found significant differences in ED patient experience scores between the IS and PGA surveys. We recommend that healthcare providers consider patient demographic variables when interpreting ED experience score reports. Multiple survey techniques and distribution methods may be adopted to best capture ED patient experiences.