I understand that in theory temperature could cause an inconsistent drift but I've never had that happen to me; at least not to an extent that it was noticable.
If I did come across this problem, I'd probably chop one of the files up into sections (even into each separate song, if needed) and align and time-stretch them individually.
Having said that, if I did come across a drift that was quite so inconsistent, I think I would be suspecting an underlying problem in one of the recording devices.
I've mixed audio from a D8 with that from a cheap Sony camcorder and a prosumer Canon one, Microtrack and those two same cameras, D8 and Iriver 320, Microtrack and Iriver 320, R09 and Iriver 120, and R09 and M10 - consistent drift (to my ears, anyway) every time. Not saying that it doesn't happen though - maybe I've just been lucky.