Even at the oldest standard, USB 1.0 can transfer data at a rate of 1.5 MBit/sec (which is 187.5 MB/sec). So, at this rate the transfer of 4 GB of data should take approximately 21.3 seconds.
Your math is wrong - 1.5Megabit/sec = 187.5
kilobytes per second.
4GB = 4,000,000,000 bytes. (roughly)
4,000,000,000 bytes / 187,500 bytes per sec = 21,333 seconds = 355 minutes = 5.9 hours (that sounds about right for my JB3 at this speed)
For USB2:
480Mbit/sec = 60MBytes/sec
4,000,000,000 bytes / 60,000,000 bytes per sec = 66.6 seconds = 1.11 minutes. (but most IDE hard drives can't write that fast, so it'll be quite a bit slower)