RTSP stream constantly dropping and very latent

I have a Pan with 4.41 and latest VLC. My RTSP stream drops very often. Simply reconnecting to the stream fixes it, but it’s annoying that it happens so often (or at all!)!

Also, my stream is at least 5 seconds behind my Wyzecam view. Any fix for these issues?