Yes, time away from it and returning later with a fresh ear, unsoiled by recent bad associations is always a good idea.
..they don't make noises during the music.
Ha! I don't believe it!!
The banshee cry of the plastic cough-drop wrapper, the incessant program rustler, the woman with all the jangly jewelry that keeps messing with her hair, the purse rummager, the hard-breathing wheezer-geezer, the loud and out-of-rhythm foot tapper, the loud whisperers, the premature always-early and over-eager clapper, the end-of-each-movement clappers (maybe even every long rest), the outright snoring old man.. I know them all to well. They are ubiquitous, attending every "quiet audience" event, everywhere, everytime. If fortunate, they aren't seated immediately next to you or your mics, but they are there somewhere in the audience, guaranteed.