Um...you must have had a very happy home with loving relations. I used to DREAD going home to visit my parents (before I got married and had my own home). I knew whatever I told them I was up to, they'd tell me, with totally honestly, how disappointed they were in me. 3/Swords each and EVERY time. Once it was so bad that, when I was alone again, I curled up into a literal fetal position of mental and emotional agony that lasted for hours. A truth I knew I'd hear from them, dreaded hearing it, and sure enough, got stabbed with it right through the heart when I got up the courage to go home and face them.
That's why the 3/Swords is there at home. Because the people who are in the home are the ones who can hurt you the worse. They're the ones who know all your buttons, and secrets, and background. They can say that one thing which will go right to your heart and leave you bleeding for a very long time.
If you've not had this happen to you in someplace that sometime in your life you called home, with people who were supposed to make that place your home...if going home has always been right for you, never wrong...then you've been very, very lucky.