I’m on the same boat
- sometimes frustrating, sometimes rewarding. But seriously, you should consider a Harmony Hub if you want real control over your media things. This is my Lovelace card that shows the current activity:

Now I can also add volume control below it, this is the next challenge ;-).
Was based on this post: Harmony Activities, Volume Slider, and Lovelace