The iTunes, Lion and Lion Recovery downloads (totalling over 950mb) whizzed through in less than 6 minutes.
The iOS5 update (668mb) took a lot longer, clearly the servers are creaking a bit. But done now, phone backed up and updated and now currently restoring from backup... waiting patiently...