This is literally what people are talking about when they say AI will be used to mainstream widely held bigotry. LLMs are trained on frequency and probability -> straight relationships are more well represented in the dataset -> straight pronouns and terms become the "correct" normal.
This is a form of backdoor bigotry from both normative facts (there are more straight than gay relationships) and well represented bigoted beliefs (men are superior to women).
Combine this with the mass of people inclined to believe (and being encouraged to believe) that if AI says and does something it must be correct
This wouldn't be a problem if there was a, "This is wrong and here's why," option to help train the things, but noooooooo, the designers are so sure they got it right in one go that it can't POSSIBILY be wrong, now can it?
There is, and you can tell it that it's wrong, but this is something that never should have been a suggested correction in the first place. I often have to tell the "suggestions" that they are wrong, and I am as rude as possible while doing so.
