Be sure to do your best gravely T.Waits imitation when working down in the hole.
I've used the cut off Q-tip paper stick which works. But usually I just dunk the mini plug in alcohol, wipe it clean, dunk again so it's dripping and use that to clean the jack by pluging it in and out repeatedly, twisting it around, and repeating that a few times until the noise is gone.