A $50 mic with a $450 recorder? A Church-Audio mic into a used $70 Sharp minidisc recorder would sound far better.
Invest in a Church Audio mic. There will be a huge difference in quality.
All the cheap Sony mics have poor bass response. I started out with the somewhat more expensive ECMMS-907 and was astounded by the huge increase in the quality of my recordings when I stepped up to Sound Professionals mics.