You choose what people you share your location with, generally those who also share with you. It's fun to see where your friends are. You also can let google record your location history and look back at where you were last November 11th at 3pm, for example.

And if you don't want anyone to know, turn the app off or just disable sharing.

Some trust in Google's good faith is of course necessary