This is literally what people are talking about when they say AI will be used to mainstream widely held bigotry. LLMs are trained on frequency and probability -> straight relationships are more well represented in the dataset -> straight pronouns and terms become the "correct" normal.
This is a form of backdoor bigotry from both normative facts (there are more straight than gay relationships) and well represented bigoted beliefs (men are superior to women).
Combine this with the mass of people inclined to believe (and being encouraged to believe) that if AI says and does something it must be correct
I have a male character who is a healer. Every goddamn time I have an AI LLM on in a word processor, I will know because that fucking thing always tries to make Aza a woman.
It's a nice way to know there's hidden AI but also... fucking gender essentialist bullshit. There is no reason for it to think he is a woman other than the fact that he has healing magic. None.
AI is not the solution to any problem you have with your own writing. It never will be.
