Our culture at the moment values "feminine" characteristics, and we understand now the difference between biological sex and socially-learned gender - just by looking at the differences between gender roles in different societies, without going so far as to say ALL gender differences are learned. Some of them certainly are, otherwise they wouldn't change or differ between societies.
In addition, we're all a bit more sceptical when we hear the traditionally "masculine" voice of authority since we've seen historically where it can lead us if we follow unquestioningly. So I guess you're not alone.
The hesitation you may feel can have biographical roots. If you were a rebellious feminist teen and are now a self confident woman, Emperor and Hierophant appear to you as opponents, not parts of yourself. But we all have ALL archetypes of the tarot within ourselves, including those who look most alien to us.
This seems to lead us towards Jung's theory, according to which women have an animus, men have an anima. But I have some grave doubts about these concepts, with all respect to Carl Gustav. Maybe Animus and Anima are not so different after all, and Jung simply accepted stereotypes we don't hold dear any more? Men can be tender and intuitive, and I don't have to call that their Anima, and women can be strong and assertive, and that's not their Animus. We all have the potential (and often the strong wish) to transcend the categories of gender and leave them behind us.
So where in your life is the voice of the Emperor, the Chariot, the Hierophant, and why do you struggle with it? Ask them, ask yourself, listen to the voices of memories, of inner judgements, of negative or positive comments in your head.
I find the struggle with my inner Emperor has brought me more substantial learning than the easy identification with Empress and Temperance. The Star is easy to love, but how can I love my inner Tower? my destructive and self destructive tendencies, my anger, my aggression?
Each archetype is a challenge, the beautiful and harmonious ones and the difficult ones.
We all have the voice of the inner father, even if our biological father left us (like mine did), even if it is only the fantasy image of a good, caring, protective father that collides painfully with the actual image of a cold, cruel and bitter father (again, my childhood story). We can learn a lot from the tarot in finding the nuances of each card.
For me, the Emperor has been maybe the most personal struggle AND acceptance. (My biological father and my husband are both Aries - this Emperor plays a bigger role in my life than I would wish sometimes ;-))
I see it like that. When we wander along the procession of trumps and it hurts somewhere, that's where we have to dig. The Emperor hurt when I saw it, I dug, and I'm still digging.
This inner dialogue with the cards is IMO the greatest gain of the tarot, not the answers in readings. The major arcana are inner archetypes that often are associated with people, but they're not these people. The Emperor is NOT my father, he represents what my inner father means to me and how I relate to him. The card represents the wishes and dreams about the ideal father, the actual father image, and the cultural voice of the father, including the patriarchat. Light AND shadow sides.
The better you know these male archetypes with all the baggage of cultural and biographical associations, the better you'll be able to relate to them in readings.