The server (and your site) should be able to handle WAY more than 4 connections at once. I think your problem is like everybody elses (including me) and that's server resource abuse. Hopefully djbob is weeding out these people every day.
btw, I went to your site several times right before I made this post and never got an error or had any problem loading your page what so ever.