FACT (facilitate chromatin transcription) is involved in heterochromatic silencing, but its mechanisms and function remain unclear. We reveal that the Spt16 recruitment mechanism operates in two distinct ways in heterochromatin. First, Pob3 mediates Spt16 recruitment onto the heterochromatin through its Spt16 dimerization and tandem PH domains. Without Pob3, Spt16 recruitment is partially reduced, exhibiting a silencing defect and impaired H2A/H2B organization. Second, heterochromatin protein 1 (HP1)/Swi6 mediates Spt16 recruitment onto the heterochromatin by physical interaction of the Swi6 chromo-shadow domain (CSD) and Spt16 peptidase-like domains. Several CSD mutants are tested for Spt16 binding activity, and the charged loop connecting β1 and β2 is critical for Spt16 binding and heterochromatic silencing. Loss of these pathways causes a severe defect in H3K9 methylation and HP1/Swi6 localization in the pericentromeric region, exhibiting transcriptional silencing defects and disordered heterochromatin. Our findings suggest that FACT and HP1/Swi6 work intimately to regulate heterochromatin organization.