I agree completely. The riddles are great and having to find the places instead of them being marked on the map is too, but having to rely on a random factor you have no control over is idiotic. I was expecting dumbed down GW2 jumping puzzles but I didn't even get that.
Concept is nice, execution is awful.