 The line "nor dare I question with my jealous thought" implies that he has considered that jealously will raise doubts in his head and might drive his love to madness.That this could end up driving the poet to insanity is suggested in this line, "but, like a sad slave, stay and think of nought.