I often have this occur. A leather shooting glove is one solution that works for me. I haven't tried the rubber bumper, but will do so.

JERRY