In short: no.
When post-mixing, it should not matter so much either once you align the sources. If, however, you align them perfectly and the .wav is above the zero line for one source and below it for the other (like mirror images), then flip the phase on one of the sources.
it would be pretty audible if its out of phase correct?
Yes. It is generally more apparent in the low end where phase cancellation/comb filtering tends to stand out more. Most often, it is an obvious lack of bass/low end that is the tip off. When post-mixing, though, it is easier to identify graphically whether the two sources are out of phase.
Mixing the sources is more about time alignment. However, if your microphone preamp happens to be reversed phase due to a design oversight (as was the case with some Lunatecs for a while), you may find that the best time alignment results in an inverse phase relationship between the two sources. Flip one and you'll get better results in that case. I don't claim to be able to hear absolute phase, but when combining with other channels, consistent phase can become important.
- Jason
Similarly, there is an exception vis-a-vis SBD feeds I recently came across: some SBDs have pin 3 hot outputs on their XLR outs (generally a portion of older consoles from the 80s and earlier). Since our recorders/pre-amps conform to the now standard pin 2 hot set-up, a SBD source from a console with pin 3 hot XLR outputs
will be inherently out of phase with any AUD source when captured on a recorder configured to expect a pin 2 hot line feed over the XLR inputs.