It does play back MP3s, but according to SD it only plays back files encoded at the same rates that it supports in the record mode.
Not so good for me in this case but at least I know what is going on. In the future, I'l just recode to waves if I need them.