FWIW, if you're casting to the Chromecast from the YouTube app on mobile, I think it does sync the fact that there's an ad playing, and has a button to skip it on the mobile device.
Of course, this is entirely dependent on keeping your device awake for that, so it's still rather inconvenient at best.