In this study, we investigated where the sex differences of object-location binding memory performance were influenced by the cognitive load. We used the fractal objects version of the ‘What was where?’ task to measure object memory, location memory and objection-location binding memory. Cognitive load was controlled by task difficulty presented two sessions: one session randomly displayed three or four fractal objects (Session 34) and the other session four or five objects (Session 45). The results showed that females outperformed males on object-location binding memory. Interestingly, even when the four object trials were compared between Session 34 and Session 45, in which we believed that the level of difficulty was similar while cognitive load varied, the swap error of males was significantly increased in Session 45 compared to females. In conclusion, there may be sex differences in object-location binding memory and the males could be more sensitive about the cognitive load than females.