Ok different thinks to point out:
is you can get a zoom h2 (that what looks like an electric shaver ) some people can really make nice recordings with tweaking the settings of the internal mics, but you need a bit of basic knowledge there.
But the zoom h1 is really rubbish, even can´t competate with my backup gear Yamaha Pocketrak W24
If you can´t afford much money the cheapest way to go:
Tascam DR07 (old model) used around 60 Dollars , Eneloop Batterys + charger so running time doesn´t really matter - around 25 Dollars, church Audio Ca9100 Preamp + 9 V Battery (with luck you get an used one for around 30 Dollars) or cheaper ugly bb, + Ca 14 Mics from Yard Sale here and you are set!
For recording with 24 Bit / 48 kHz an good Class 2 SD Card from Transcend or Kingston is good. have also in use class 2 cards and no problems (2 Kingston, 4 Transcend)