If you play 24/48 files through your computer (e.g., through foobar), or if you play them back via your 24 bit recorder, you will get 24/48 quality. So yes, the short answer is yes, you will get the "full quality". (Or at least, it seems likely. I guess any given recorder might only have a 16 bit DAC onboard and would truncate your files, but that seems unlikely.)
That said, a 24/48 file that undergoes a high quality dither routine to bring it down to 16bits and is re-sampled to 44.1k may sound better depending on your playback chain than the 24/48 original. Maybe even downgrade that statement to a proper dither routine, and not even a high quality one.
If you dither and resample the 24/48 to 16/44.1 and then burn onto a CDR, a decent CD player hooked up to your stereo system may likely sound better than 24/48 coming out of a 1/8" analog output from your computer. And probably much more likely will sound better than 24/48 coming out of your (esp handheld) 24bit recorder, since playback on these devices isn't really a priority at all, so it likely sounds pretty bad on many recorders. And all that goes much moreso if you have an outboard DAC getting fed a digital signal from your CD player.
So all said, getting the best playback experience matters much more about what the playback system is, rather than if it is playing back 24/48.
Setting up things to playback at 24/48 is fine, but pay a lot more attention to how it is playing back. Lots of threads about that in the playback section of ts.com. There a plenty of USB DACs you could incorporate (eg., Audioengine D1 and the Dragonfly, to mention 2 of dozens), or you could go with something like the Squeezebox or other methods of wireless music streaming. And I'd say if you don't have the money to set up a playback system that incorporates 24/48, I'd focus much more on a system set up for 16bit playback (eg., a CD or DVD player with decent reviews on sound) and translate your 24/48 material to 16/44.1 burned to a CDR rather than just blindly playing 24/48 on what might be a crappy playback chain.