The dynamic association of chromosomes with the nuclear envelope (NE) is essential for chromosome maintenance. Schizosaccharomyces pombe inner nuclear membrane protein Bqt4 plays a critical role in connecting telomeres to the NE, mainly through a direct interaction with the telomeric protein Rap1. Bqt4 also interacts with Lem2 for pericentric heterochromatin maintenance. How Bqt4 coordinates the interactions with different proteins to exert their functions is unclear. Here, we report the crystal structures of the N-terminal domain of Bqt4 in complexes with Bqt4-binding motifs from Rap1, Lem2, and Sad1. The structural, biochemical and cellular analyses reveal that the N-terminal domain of Bqt4 is a protein-interaction module that recognizes a consensus motif and plays essential roles in telomere-NE association and meiosis progression. Phosphorylation of Bqt4-interacting proteins may act as a switch to regulate these interactions during cell cycles. Our studies provide structural insights into the identification and regulation of Bqt4-mediated interactions.