He passed but of their sight, straight toward the new hole in the sky.
The others were making a beeline towards the hole in the sky, but he took a meandering route, as if reluctant to go there. 
The others weren't making a beeline towards the hole in the sky, but he took a meandering route, as if reluctant to go there.