Currently you have the option to select all the music players or just one. It become problematic when you have multiple music players, but you're interested in only some of them.
For example, I switch between Spotify and Google Play Music a lot. But every time I watch a video on YouTube, it gets displayed as the default player. It would be great to have an option to disable YouTube being detected as a music player.
I suggest having a whitelist (or blacklist) of preferred music players, instead of the current "all or one" approach.