As I understand it, Powering voltage affects headroom. With more headroom the noise floor is lower, hence quieter.
This is why most people use 9 Volt battery boxes with the WM61a instead of the Plug In Power present on many recorders, (often 2-3 volts.)