You'd need to make it a filesystem that is usable in both windows and linux, and can support files bigger than 4GB.

Unfortunately, no filesystem exists that meets those requirements, and everything else needs a large pile of hacks. I suggest downconverting, since I don't see how the N900 will even be able to play a 720p h.264 file.