I love 20 gauge ASELs, but I wouldn't even think of removing the sling swivels. What are you going to do when you want the swivels? Tell us more about the gun.