Hi Bruce,
You could always ream out the hole, glue in a piece of dowel, and then drill the dowel to fit the swivel stud.
I'm with you, sling swivels on a shotgun are extremely handy when you have to walk aways to get to your duck blind (or wherever).

Take care,
J.R.