If it were a new gun, and mine, I'd send it back for attention after hunting seasons close. I've got a Ithaca SKB 200E that has the exact same issue. It hasn't had over 250 rounds through it since new, and has always been like that. I intend to take it to Jim Kelley for smoothing out next time I go that way. It irritates the heck out of me. Mine will cost me a few bits to have sorted out ............. yours shouldn't.

SRH

May God bless America and those who defend her.