The reason is simple -- if you're using the site closest to you in a busy hour, chances are there are many other people from your area trying to download it from the same site. However, if you pick a site that's hours ahead or behind you, there may not be as many people awake or in their busy hours of the day as in your time zone.
Please note that it is still may not be a good idea to use overseas sites.