I've been working extensively on my master recordings recently (mostly with iZotope RX10), trying my best to get rid of anything that I consider flaws in the recording, including removing things that were actually heard by the audience, such as annoying talkers, whistlers, and screamers.
In a few cases I have also removed sounds that came from the stage and/or PA, mostly annoying feedback which clearly wasn't intentional.
All of these do somewhat detract from the recording as a document of a particular show, but I feel it is definitely worth it to improve the listening experience.
However, I am sure that some people might think what I have done is too much, and I would like to know others' opinions about things that might come up in my editing.
I'm currently working on a recording I made where the audience was mostly very quiet, and the sound was very good (but quiet), so there's not a lot that needs to be done apart from reducing the volume of the applause between songs and doing my best to reduce the sounds of some audible coughs, as my gf and I were both fighting a cold at the time.
However, during some of the songs, there are quite a few instances of fret squeak when the acoustic guitar player changes chords. I'm torn about whether or not to remove this. I could likely do it pretty cleanly, and I'm fairly certain this noise was not something the artist deliberately wanted to be heard at the concert, but it still feels more revisionist than most other editing I have done. Removing it would definitely make the recording more listenable to me, and I'm sure to most others as well, but it is completely changing something which was heard by every member of the audience at the show.
I would love to hear people's thoughts about removing the fret squeak, as well as more general thoughts about changing things in post-processing.