This is what caught my eye on the Carnegie-Mellon site (http://cmusphinx.sourceforge.net/html/cmusphinx.php):
"Note however that Sphinx is not a final product. Those with a certain level of expertise can achieve great results with the versions of Sphinx available here, but a naive user will certainly need further help. In other words, the software available here is not meant for users with no experience in speech, but for expert users."

Aren't we in over our heads here?

(BTW, the phrase "users with no experience in speech" is kinda funny)