Background: In Korea, the population is rapidly aging, and the types of households for the elderly are also diversifying. The self-rated health of the elderly is a valuable health indicator that can comprehensively represent the overall quality of life along with physical, mental, and functional health. On the other hand, studies on the association between household type and self-rated health of the elderly are still insufficient. Thus, this study analyzed the association between household type and self-rated health by gender in Korean older adults. Methods: Using data from the analysis of the National Survey of Older Koreans 2017, 10,299 elderly people aged 65 and over were targeted. For the accuracy of the analysis data, 9,910 people were selected as the study sample by excluding proxy responses, those diagnosed with dementia, and non-response. And technical analysis, univariate analysis using the Rao-Scott chi-square test, and logical regression analysis involving survey characteristics were conducted by gender. Results: According to the adjusted model with all variables, in both men and women, the odds ratio of self-rated health ‘bad’ in ‘couple (with ill spouse)’ was significantly higher than ‘couple (with spouse)’. It was 2.54 (95% confidence interval [CI], 2.05–3.15) for men and 2.11 (95% CI, 1.70–2.62) for women. In addition, the odds ratio of self-rated health ‘bad’ in ‘living with adult children’ was 1.43 (95% CI, 1.09–1.87) for men and 1.42 (95% CI, 1.15–1.75) for women, which was more significant in women than men. Conclusion This study states that there is an association between gender, household type, and self-rated health of the elderly, and the health of a spouse and cohabitation with children have a significant effect on self-rated health. As a result, in order to improve the health status of the elderly, health promotion and health care policies involving the characteristics of the elderly’s gender and household type are needed.