Cap, many of the things you list are exactly what GStreamer does.

PS. My personal yet-to-be custom cam project is cam2book, where you could take quick snaps of a publication and end up with a cbr or pdf file which would then be easy to view <plug>for example with pyqtoreader</plug>, and also easy to share since it is a single file.