Ah, gotcha, but then I disagree. If the choice is build what works for 95% of users vs for the remaining 5% then doing the latter is a luxury few can afford.
This isn't defeatist, I do think that we can fix this, just not by hoping sites will take a leap of faith en masse.