I would say the correct answer is "..and leaves the world to darkness, and to me."
This line depicts the image of loneliness which comes at night, when the day is already gone. Thomas Gray successfully managed to capture this relationship using this line, and the other lines do not show the same connection as this one does.
