Tarot has not affected my relationships, so far, which is actually the opposite I presumed.
I seem to come across as very Queen of Swordsy in everyday life and my friends were surprised to hear I'm into anything esoteric such as tarot, when I came out of the closet by founding a tarot blog last Christmas. I feared their reactions beforehand but it has ranged from mild interest and curiosity to almost outright dismissal (no questions asked, let's talk about everything else like we used to). My parents are strictly religious and haven't commented at all, just like I don't comment their faith I find very limiting. We have sort of a peace treaty there
I can't remember how my husband found out (I read before we met) but I haven't been hiding nor flaunting tarot. He's generally supportive with pretty much everything I do but sometimes he lets slip he finds tarot rather silly - he's a scientist and thinks it's nonsense or hoax. I explain my viewpoint, he explains his, and off we go with our lives: he has his hobbies, I have mine, and we don't judge even if we don't fully understand the appeal.
I exchange readings with one friend, who reads; and others have not been that interested. One other friend has openly stated she thinks tarot is nonsense but no one else has tried to judge or treat me as a circus freak.
To wrap up: I think if others would mistreat me due to tarot, I'd reassess why we're friends. I agree that if these people only invite you to do readings, maybe start charging or spread your business cards if you read professionally? It's more like a business ally meeting than a friendship circle to me. Unless you really really want to make friends with them, in which case you probably have to be more active and try to meet these people one on one to get to know them - and give a chance to know you - better?