I think it can be seen that another dowel in that stock does not appear to be walnut and was successful. If wood expansion and contraction might become a worry, I'd consider turning the dowels so that the grain ran in the same direction as the stock.