If you hold right click and try to look up... you will move the skybox as well.