Run in xterm
xmodmap -pke | grep A.a
And see that the penultimate word is hebrew_shin. If not the configuration is wrong. Perhaps you selected a language other that English?
If it does, how do you switch to Hebrew? You should use Shift+FN+Right arrow.