John, I think there may really be something to what your friend told you. When the talent moves off-axis, the boom operator has to react very quickly; with experience, I think one's reaction could become almost automatic.
Whereas if you need to be paying full attention at all times, using your conscious mind in order to detect a problem, your responses will be far slower, and more dependent on how much sleep you got the night before.
--best regards