Well I found an easy way to load stuff in using POI loader as well as some sites to get them (like POI-Factory). POI Loader can also see all the existing POI though it doesn't have a method for quickly identifying duplicates.

Still don't know how to get google to let me download other categories of POI though.

Though is there anyway to get color differences? Right now all my POI are purple.. so it's hard to distinguish say a resturant from a hotel.