That second is the way it's supposed to be.. a big black screen with an X is the Xephyr X window.. for some reason or another your xfce4-session is not launching.

In the Debian terminal type in xfce and press tab twice.. see if you have an xfce4-session available.

(have you already run apt-get install xfce4??)