From what I have heard, yes, you need to have runemate open in the background. I also make sure that I open the RS client via runemate, just to be sure - but I am not sure if it makes a difference.
Regarding how it actually works, I am not certain. I did message Arbiter but I suppose he has...