The recorder you choose depends on a couple things, off the top of my head, 1. Price, 2. Battery Life, 3. Portability, 4. Ease of Use. I, personally, use (and love) the Sony PCM-M10. When I first jumped in the game, the kind souls around here pointed me in that direction, and I couldn't be happier. The M10 is pretty cheap (in price), but well made. It has super long battery life (on internal AA batteries) and is super small/portable and is super easy to use.
http://www.bhphotovideo.com/c/product/638090-REG/Sony_PCM_M10_BLACK_PCM_M10_Portable_Audio_Recorder.htmlSomething like the M10 only has a stereo-mini line-in, so you'll need a pre-amp/battery box to power your mics. (Another piece of hardware.) The M10's are rarely in the Yard Sale, as they are pretty rock solid and the "go to" recorder for a lot of folks around here. When they are, they usually go fast.
Another recommendation/option is something like the Tascam DR-100 MK II. That little dog has stereo line-in plus a pair of XLR inputs with 48V phantom power. So, in theory, you could plug your mics directly into that device without the need for a pre-amp. I don't know anything about that device, but would be concerned about battery life while it provides phantom power. A brand new one just went for $260 in the Yard Sale.
http://taperssection.com/index.php?topic=159673.0My best recommendation, head out to the Live Music Archive on archive.org and listen, listen, listen. You're obviously a music fan, so doing some "research," i.e.: listening to a bunch of killer shit, is hardly a painful task. As Terry indicated, in almost every case, you'll see the lineage of the recording. Typically Mics > Pre-amp > Recorder. Then just Google around.
Hope this helps.... and welcome aboard!