I'm with OWD on this one. It's a bit like 'How much clunking should I accept from my engine before I decide to change the oil'. If it sounds like it needs sorting out - do it before it gets worse. You will have to do it anyway.