I found a solution, I understand how it works, but why it's necessary eludes me. It also removed all buffering and any audio problems I was having. Everything is very fast now.
https://www.reddit.com/r/Chromecast/comments/24gugk/some_videostream_tweaks_for_people_experiencing/
I only found this after windows 10 stopped me connecting to my mobile device.