Due to the extra speed of the swing, if the swing were in a north/south direction, the extra gyroscopic effect of the earth's rotation could cause you to either fall forward or backward, depending on which way you were facing.