I just upped the number of buffers.... It really can't hurt to do either or both. More buffers just mean that you're increasing the latency, and who cares about latency since none of us are processing and/or monitoring the sound in the field thru our recording devices.
AFAIK, monitoring thru a Pre/ADC is not subject to this... after all, you've got your headphones plugged in ahead of the lappie.