You can see where all files of a package are installed by typing in xterm Unlike Windows with linux all files of a package are usually not in a single folder. System wide configuration files of apps go in /etc, binaries (like the exe files in windows) go to /usr/bin, libraries (like dll files in windows) go to /usr/lib, and images to /usr/share. Per user settings go to /home/<username>/.<name-of-application>. Per-user settings usually take precedence over system wide settings.

I suggest you read up a little on basic commandline stuff like moving files, changing file permissions, the linux directory structure, and starting and stopping services. I've been using linux for half a year now and I know how weird it seems at first.