I have a RichTextLabel which overlaps a TextureButton. The button has a different texture for when its pressed, however I can not press the button with the text overlapping it.

Is there a way to disable focus/selection of the text so that the button still works behind it? I need the text to not be part of the graphic so I cant just add it to the texture.
I'm still learning how to use godot, so maybe there's something obvious I'm overlooking.