Background: The main objective of treating fragility hip fractures is to maximize the patients’ ability to return to their basic activities of daily living (ADL) levels. This study explored prognostic factors associated with the ability to recover pre-fracture ADL levels at 1 year after fragility hip fractures. Methods: We retrospectively recruited patients admitted with fragility hip fractures between July 2016 and September 2018. Details of the following were extracted from electronic medical records: age, sex, body mass index; pre-fracture Charlson Comorbidity Index (CCI), Barthel index, and EuroQol-Visual Analog Scale (EQ-VAS) scores; pre-fracture ambulatory status; and fracture type and treatment. The primary endpoint was the ability to return to the pre-fracture ADL status at 1 year. Multivariable logistic regression analysis assessed the prognostic ability of predictors. Results: Of 405 patients, 284 (70.1%) managed to return to their pre-fracture ADL status. Multivariable logistic regression analysis demonstrated that the predictor with the most apparent effect size was pre-fracture EQ-VAS scores ≥ 65 (multivariable odds ratio [mOR], 12.90; p = 0.03). Other influential predictors were CCI scores < 5 (mOR, 1.96; p = 0.01) and surgical treatment for the hip fracture. Conclusions Three prognostic factors can predict a hip fracture patient’s ability to return to the pre-fracture ambulatory status at 1 year. They are the patient’s CCI score, operative treatment for the hip fracture, and the pre-fracture EQ-VAS score. This information could be used to develop a clinical prediction model based on the prognostic factors.