Landscape "hitboxes" overlapping and generally being not the shape they should be

On my custom-made music widget I have two separate overlap groups. Both have a music widget in there, but one is only visible in portrait mode, while the other is only for landscape mode. (I know it's not the best way of handling portrait/landscape, but it's the easiest.)

The bug: When I'm in landscape, and only in landscape does this happen, if I tap the "play/pause" button, it registers the touch as a tap on the "skip to next track" button, because its hitbox overlaps the "play/pause" button. You can see this in this video:

Here is a video of me going over the settings of the widget: