Were you in the folder when you ran the command?

If not:

sza=$(ls -R | grep m4p); rm $sza

to delete them all recursively. Works every time for me.

EDIT: I spoke too soon. It appears that ls won't display the full path when recursive is switched on.