@Lommelun Many thanks to you.
The key is Chromecast supports only Video encoding H264 high Level4.1, as Lommelun pointed out.
After transcoding the L4.0 video into L4.1 with HandBrake, my video now plays smoothly with very low CPU usage.