I have started adding quality criteria at http://wiki.maemo.org/Extras-testing#Quality_criteria based on various previous discussions. Have a look and comment, please.
Unacceptable security risks.
But how a tester can detect that? I guess the answer is that those testers should check that there are not known security bugs filed in bmo, or perhaps even security reports against dependent packages upstream.
Evident licensing or copyright violation.
Another question that comes to mind is the content: would maemo.org distribute apps dealing with pornography, racism...?