Please, please, please use something that can be soaked off. I am not familiar with 'Elmer's Glue' but can confirm that all the animal glues that I have used can be soaked off with warm-hot water and a little patience.
My biggest nightmare when presented with a case to reline, re-label or adjust is PVA (white glue). It might work fine for a fix but is NOT reversible and is a real pain to remove from anything you want to reuse.
I have been bad-mouthed for giving this advice before and would appreciate not getting it again!