So slight continuation of the highjack, I basically started with the same logic as the OP recently. I did read up a bit and fashioned the question
slightly more informed than the OP but it was basically the same question. From a newcomer who has no background in electronics or taping, a lot of the simple answers can be overwhelming if you're just looking to get into the hobby for purely recreational purposes (I don't know the difference between balanced/unbalanced or line-in/mic-in as just a start to my niavete. Granted, I don't ask because if I really wanted to know google is always right there in my browser, but its hard to know where to start when you're just starting).
But, back to the OP, like acidjack said:
you need mics (obviously), a recorder to save the sound coming into the mics, and then most likely a way to provide enough power to the mics to handle the "amount" of sound reaching them (as in a pre-amp or battery box). On top of that you need a way to place the mics where you want them (a clamp/stand, a way to put the mics on said stand, cables to connect all the pieces in the chain, and a place to put all this expensive stuff during the recording process).
I've got the CA-14 set up and will happily advertise to a newcomer.
http://taperssection.com/index.php?topic=141135.0. If you choose the 14s and 9100 pre combo all you need is a recorder and you're good to go. As acidjack mentioned the Sony M-10 is a very popular recorder right now, doesn't seem like you can go wrong with that. Though an Edirol R-09, R-09HR, iRiver H1xx series, Zoom Hx series also seem to be popular inexpensive recorders out there now.
as for stands I just got this:
http://www.bhphotovideo.com/c/product/253067-REG/Impact_LS10AB_Air_Cushioned_Light_Stand.htmlits much less intense than I thought it'd be. Almost "flimsy" but seeing as I'm putting CA-14s on there its exactly what I was looking for.