My suggestion: unless you're experiencing capsule performance issues (drops, crackles, etc) you should just leave them alone because most of that stuff won't harm a capsule.
I recently asked Bill Bradley about cleaning a pair of my mics because the diaphragms looked dirty and had some surface gunk and this was more or less his response.