What do you mean when you say "GPS continously tracks you" ? from where(app/screen) do you figure this out ?

Go to Settings->Internet Connenctions and click on "Connect automatically" and change it to "Always Ask". This way next time if any app tries to connect to GPS, it would show a message saying so and so is trying to connect to internet, continue?