I am unsure about the capabilities.
I just got a new TV that can play from upnp. Is it possible to control playback and such with yatse?
I installed the upnp plugin but not sure how to add my TV as a host
You don’t add it as an host as it’s a player 
Just press the cast button then select your TV here to have the media play there.
See
