If they were just pressed in and not glued you can use an appropriate sized socket as a 'puller' by placing it over the insert with the open end facing down and then placing a washer over the square drive hole and using a longer machine screw to 'pull' the brass insert straight up out of the stock.

You would still need to take Jack's advice about a using a hardwood dowel afterwards.