Does not the serial number on the action take precedence over any other ?

According to firearms registration here in Australia it does.

The trigger guard & barrels can be swapped but not the action as it is the basis of the gun.

O.M