I had the same problem you described. But Claws Mail with Gmail's "Configuring other mail clients" settings works for me.
I am still playing with it though, so I don't know how good it is.
The setup is a pain; I had to enter the account info, edit the account info again to add the SSL and Advanced setup info, then "rebuild the folder tree".
Edit: Claws shows all the gmail folders as opposed to Ossomail.