When travelling out of the UK with a firearm purchased here, you do need an export permit unless you have the gun on a UK shotgun Certificate or Visitors shotgun permit. Do not turn up at the airport without one or the gun is likely to be seized.