Did you use fAPN to create the access point? If yes, there is a button in there to delete it as well.

Otherwise, gconf instructions are mentioned in this bug, at the bottom.

But regarding your problem with the wrong access point, see this thread and this bug. Maybe it helps.