It's not just about treatment by society & difference in physical strength and spacial/linguistic abilities, though these, of course, might count: but everyone knows individuals who buck the trend. There are many female architects and male linguists! Since Simone de Beauvoir at least, we've known that education plays a major role in making men & women feel they are more different than they are.
But there is one way in which all men are different from all women: and that is in our sexual characteristics. We might have different views of sex due to education from one man to another, and one woman to another, and different levels of libido, but - to put it crudely - the mechanics remain the same. And regardless of morals, country, degree of female liberation or oppression, etc., the way women experience sex is never going to be the same as men. That means that in an important area of human experience, men and women are destined forever to be structurally different - this, in turn, leads to difference in perception of sex and, inevitably, sex-based relationships & even relations that are not based on a sexual relation (e.g. with friends of the other sex; or of one's own sex if one is gay). We know enough about biological determinism to know that it plays a role in our behaviour, regardless of education (even though education can override or emphasise it in part). There's a fierce battle going on at the moment between those who believe there is no brain difference at birth, and those who believe there is. No matter - much of our brains are trained by our education. Some part of it isn't - that controlling our libido, our sexual drive & the reproductive instinct (even when it is not used for reproduction).
Now, many tarot readings concern relationships & sex, so that difference in perception & experience of that central human experience is going to yield different ways of seeing the same cards - of interpreting what is, on the surface, the same experience. I believe this is the core difference. To that we can add all the educational differences, the way men & women are treated in this or that society, etc. Psychicbody mentioned fear - and I think in most countries his opinion is borne out: recently in Switzerland a study showed that 6% of men were afraid to walk home at night, against 20% of women, even though young men are nearly 10 times more likely to be attacked.
It would be interesting to ask male & female tarot readers to do the following exercise: describe your own sexual experience, using tarot cards rather than words; then, describe a whole relationship experience (including, but not limited to, sex).