I'm not sure about the above issue, but I'm betting its a software issue.

Personally, I'd look at Mumble for massive audio conversations; I'm not sure if its quite ready yet, but its an excellent tool otherwise.