Not really any downside to it. It will take a bit more time to update all feeds, but the difference would be measured in fraction of seconds, so hardly noticeable. The app itself would not be affected in loading time. The look of it is most affected, with a bunch of not-so-nice-looking empty items in the feed list :-).