Small RNAs trigger the formation of epialleles that are silenced across generations. Consequently, RNA-directed epimutagenesis is associated with persistent gene repression. Here, we demonstrate that small interfering RNA-induced epimutations in fission yeast are still inherited even when the silenced gene is reactivated, and descendants can reinstate the silencing phenotype that only occurred in their ancestors. This process is mediated by the deposition of a phenotypically neutral molecular mark composed of tri-methylated histone H3 lysine 9 (H3K9me3). Its stable propagation is coupled to RNAi and requires maximal binding affinity of the Clr4/Suvar39 chromodomain to H3K9me3. In wild-type cells, this mark has no visible impact on transcription but causes gene silencing if RNA polymerase-associated factor 1 complex (Paf1C) activity is impaired. In sum, our results reveal a distinct form of epigenetic memory in which cells acquire heritable, transcriptionally active epialleles that confer gene silencing upon modulation of Paf1C.