Yes, Claws-Mail needs to be running for it to be able to collect mail.

You can use the 'Run command...' option on the Receiving page of the Prerferences to run a command when new mail arrives. For example you could use /usr/bin/play-sound