Let me be more specific:
Here's the Firefox 3 Colors dialog:


Here's what the Google News looks like with system colors enabled:


And that's a big player. My line is this: the problem is in the web sites, not in the browsers. If you set all your colors, your site will be readable despite any settings.