Alexithymia is characterized by impairments in the processing of emotions. Although the disruptions in the white matter (WM) integrity in Major depressive disorder (MDD) has frequently been reported, the underlying relationship with alexithymia remains unclear. In the present study, we investigated WM tracts with Tracts Constrained by UnderLying Anatomy approach to discover potential associations between alexithymia and WM integrity to identify the neural basis of impaired emotional self-awareness in MDD. 101 patients with MDD and 99 healthy sex- and age-matched individuals underwent diffusion-weighted imaging. All participants were assessed with the 20-item Toronto Alexithymia Scale (TAS). TAS scores were significantly higher in MDD patients than in controls. Patients with MDD exhibited significantly lower FA values in the left inferior longitudinal fasciculus and it also showed negative associations with TAS. These results contribute to the neurobiological evidence on the association between MDD and alexithymia. Additionally, they suggest that reduced white matter integrity in the regions constitutes a principal pathophysiology underlying impaired emotional recognition and description in MDD.