A few things we've done to hasten the load out...
Keep overall weight in mind. The heavier (and bulkier) it is, the longer it will take you to move it. Also, I agree with the use of rack cases. If you can, consolidate components into cases that can be patched together and moved easily. Fewer pieces means less load time as well.
I concur with the mention of staying focused while loading out. Be polite but keep moving. Val is right on the money about not handing things more than once.
One complaint I have heard about bands over the years ~ they take forever to get loaded out. Yup, there's some dawdling around involved there but it shouldn't take nearly an hour for a 4-piece band to get out of the venue.
Bill's mention of PITA hall managers reminds me of a rental fire hall back home. The first (and last) time I did a show there, the manager stood by the back door glowering at everyone and looking at his watch after the last dance. To keep the peace, I disconnected and rolled everything out the door and staged it in the parking lot. It couldn't have taken me 10 minutes that night. When the last piece was moved, I heard the door slam shut behind me.
The client and her friends walked around behind the building where I was loading the truck. Man, were they hot. Evidently the manager had thrown them out, too. It didn't take long for that venue to get blackballed... no one wanted to rent it.
On the occasion when we're pressed for time (and who hasn't been at one time or another) we'll hustle to get loaded out of the venue proper first. Even if it means using a corner of the hotel lobby as a staging area, you're still outta the way so's the wait staff can get set up for the next party in the queue. Then you'll have ample time to load it out to the truck.
Shirl and I manage the loads together. Anything she can do ~ disconnect speaker cabs, pull the covers over the cabs, fold up and stow stands, wrap and stow cables ~ saves a heck of a lot of time. I'll start by setting the tops on the floor and closing up the cases. Anything that's heavy, I'll set on the floor out of the way. By the time I've got the truck around back to load, she's got all the little stuff done and ready to move out.
From the end of the last song to the time we climb in the truck for the drive home, our best time has been around 20 minutes. Our contract specifies 45 minutes.