Yes, But I don't think it should be a move. Maybe something like a temp thing where the leader and only the leader can pick it up and put it in the bag for 30 minutes or something. Giving the tribe time to terraform or what ever,. After the time limit is up the totem pops back into place on the X Y mark.
As to moving the totem to a new loc, I'm for that, But with hard limit's. This can only be done once every month at the lest. Giving the tribe a way to move if needed but keeping it where tribes just can't up and move when ever they feel like it.