both times I've been stuck have been in natural holes that moving me straight up would have just dumped me right back into the hole.

Maybe it could TP you to a close by random location that is not occupied?