The safety detente (or little silver colored plunger thingy) and the safety button are the only two parts of the safety system. The safety is nothing but a trigger block. If you push the detente up out of the way, you can just slide the button on through and out to clean.

If it is a replacement safety button, the notches on the button may not be lining up properly. There are at least a couple of variations in the Model 37s. The new barrels won't fit the older ones, and the new safety button won't work in the older guns either. That may be your problem...Geo