Oh yeah,

ANYTHING manufactured prior to 1898 (inclusive) is not a firearm and is not subject to any federal regulations of any sort.

Some states DO regulate antique firearms, though. New Jersey is one example.