See Android TV Remote - App Links/Deep Linking - Guide for a guide how to find out supported URLs for an app.
I have only tested opening a specific YouTube video on SmartTubeNext and it works for me. I don’t see why it wouldn’t work on the regular YouTube app as well.