You're just looking at one side of it, though. Sites can't choose what browsers their users use. The fact that Chrome has so many users is a significant problem for the health of the Web.
And note that by your reasoning, iOS users have the option to use Android!