The Mediator complex plays an essential role in the regulation of eukaryotic transcription. The Saccharomyces cerevisiae core Mediator comprises 21 subunits, which are organized into Head, Middle and Tail modules. Previously, the Head module was assigned to a distinct dense domain at the base, and the Middle and Tail modules were identified to form a tight structure above the Head module, which apparently contradicted findings from many biochemical and functional studies. Here, we compared the structures of the core Mediator and its subcomplexes, especially the first 3D structure of the Head + Middle modules, which permitted an unambiguous assignment of the three modules. Furthermore, nanogold labeling pinpointing four Mediator subunits from different modules conclusively validated the modular assignment, in which the Head and Middle modules fold back on one another and form the upper portion of the core Mediator, while the Tail module forms a distinct dense domain at the base. The new modular model of the core Mediator has reconciled the previous inconsistencies between the structurally and functionally defined Mediator modules. Collectively, these analyses completely redefine the modular organization of the core Mediator, which allow us to integrate the structural and functional information into a coherent mechanism for the Mediator's modularity and regulation in transcription initiation. 