I've been fooling around with a girl that my best friends brother is infatuated with...?

No your not wrong. He is just gonna have to get over the fact that you like her and (im uming she likes you too). But it is also her fault too though. Sometimes girls have a way of leading guys on and they don't even know it.