Use of immune checkpoint inhibitors (ICIs) in hepatocellular carcinoma (HCC) has been partially successful. However, most HCC patients do not respond to immunotherapy. HCC has been shown to induce several immune suppressor mechanisms in patients. These suppressor mechanisms include involvement of myeloid-derived suppressor cells, regulatory T-cells, functionally impaired dendritic cells (DCs), neutrophils, monocytes, and tumor associated macrophages. The accumulation of immunosuppressive cells may lead to an immunosuppressive tumor microenvironment as well as the dense fibrotic stroma which may contribute to immune tolerance. Our laboratory has been investigating different cellular mechanisms of immune suppression in HCC patients. In vitro as well as in vivo studies have demonstrated that abrogation of the suppressor cells enhances or unmasks tumor-specific antitumor immune responses. Two or three effective systemic therapies including ICIs and/or molecular targeted therapies and the addition of innovative combination therapies targeting immune suppressor cells may lead to increased immune recognition with a greater tumor response. We reviewed the literature for the latest research on immune suppressor cells in HCC, and here we provide a comprehensive summary of the recent studies in this field.