Most worrying were the Seljuk Turks, who came out of the east in the 11th century to wrest large parts of Asia Minor from Constantinople's control.
Most worrying were the Christian Crusaders, who took control of Constantinople's land and converted the people.