It can stay on when doing your sanding and finishing. That is really the preferred way to do it.

If you plan on doing an acetone soak on the wood, that should
Not harm the plate, but will certainly loosen up the glue holding it on.

Heat may be something else to try for removing it. But enough heat will also caise the horn to bend. Just like a plastic buttplate will.

B.Dudley