A chalk solution can work nicely, it dries and draws the oil out of the wood and into the chalk, which can then be carded off.

Don't worry about the old finish, you can clean off all the old dirt and re-oil it.