If the dowels are slightly protruding use a dremel to slightly dish the dowls in so they don't stick out. You will still have plenty of wood for the screws to grab into.