You do not need internet connection to see where you are provided that:
1) You are outside on a preferrably clear sky
2) You have the country map (or maps) already loaded into your device, obviously whichever country you are in, you already have the map loaded for that country.