Game objects can be hit or miss, if it helps you can set your cursor to click on "exact coordinates" and set the coordinates on the object, that way it will know what to click on, seems easier to use the interact with game object action for sure though, it doesn't cause issues so much with...