Objectives: The purpose of this study was to identify any difference in user experience between tablet- and augmented reality (AR) glasses-based tele-exercise programs in elderly women. Methods: Participants in the AR group (n = 14) connected Nreal glasses with smartphones to display a pre-recorded exercise program, while each member of the tablet group (n = 13) participated in the same exercise program using an all-in-one personal computer. The program included sitting or standing on a chair, bare-handed calisthenics, and muscle strengthening using an elastic band. The exercise movements were presented first for the upper and then the lower extremities, and the total exercise time was 40 minutes (5 minutes of warm-up exercises, 30 minutes of main exercises, and 5 minutes of cool-down exercises). To evaluate the user experience, a questionnaire consisting of a 7-point Likert scale was used as a measurement tool. In addition, the Wilcoxon rank-sum test was used to assess differences between the two groups. Results: Of the six user experience scales, attractiveness (p = 0.114), stimulation (p = 0.534), and novelty (p = 0.916) did not differ significantly between the groups. However, efficiency (p = 0.006), perspicuity (p = 0.008), and dependability (p = 0.049) did vary significantly between groups. Conclusions When developing an AR glasses-based exercise program for the elderly, the efficiency, clarity, and stability of the program must be considered to meet the participants’ needs.