It probably repeats every second or so because that's the keyframe interval. A keyframe (also called a I-frame) is similar to a standalone JPEG image, it doesn't depend on other frames.

So, you're seeing crisp and clear keyframes followed by progressively blurrier predicted frames, until you get to a new keyframe, and then it starts again. Boosting the quality of the predicted frames is probably what needs to be done.