I was working on something similar before your project (using Qt), and cannot remember any slowdowns...
I stopped developing it when I saw your project.
This evening I'll recheck my code and see if it is still working...