In my experience, the mics and how they are being used is at least 90% of the important recording quality, so budget for these first.
The preamplifier is second in importance and most low cost flash decks are lacking quiet internal preamplifier that while adequate for louder pop/rock venue recording, fall short of adequate for acoustic music with most smaller sized microphones suitable for low profile recording.
The choice in deck model is mostly logistics for having cost to fit budget, small size suitable for low profile operation, and easy powering for lasting 3-4 hours before needing battery change, or recharging. Deck bonus features like internal microphones, phantom powering ability, 24bit/96K recording ability, and easily changed out batteries for longer recording times are less important deck features in most cases.
If I were choosing a recording system to fit your range of interest (as if you were a prospective customer looking for a recording solution), the following seems a solid configuration fitting your requirement and maybe also within budget.
Sonic Studios:
DSM-6S/M headworn mic with miniXLR output plug
Specifications and options:
www.sonicstudios.com/dsm.htm#chartPA-3SX mic preamplifier with miniXLR input jack
Powers DSM mic, and provides 3 gains at low noise/low distortion
www.sonicstudios.com/access.htm#3sxEdirol/Roland
R-09 SDHC flash deck
review at:
www.sonicstudios.com/r-09revw.htmTranscend
8 GIG SDHC flash memory card
http://www.newegg.com/Product/Product.asp?Item=N82E16820208088Recordings done with type of chosen mic are often helpful in making choices.
Two pages of 100's of samples using at least this type of mic, and some with exact same suggested preamp/deck at:
www.sonicstudios.com/mp3.htm and
www.sonicstudios.com/mp3_2slp.htm If budget doesn't cover the cost, then suggest cost cutting 1st on deck (maybe by a used MD, DAT, or?), then if still short, consider dropping the preamplifier for later, leaving your mic and mic-powering choice as most important component to adequately keep within affordable budget.
Affording at least your best choice of mic model will help getting started with good sounding results at least for the more amplified pop/rock music interests. Adding the preamplifier aids in getting better results with less amplified acoustic music where having adequate high gain, low noise/distortion preamplifier performance is most audible.