Yep. Along with some elbow grease.
Not a fan of rubberized coatings, as they all seem to do this at some point. Some take more work than others to remove, but in my experience most of them can be completely removed leaving a clean blemish-free hard smooth plastic surface. Each time I've done this I'm left with the thought, "this should have been the original finish to start with", and suspect an industrial design conspiracy of planned obsolescence. Be careful around labels and white painted markings, which are typically not on the rubberized bits but often adjacent to them, so as not to remove or smudge them.