The problem is not the logic of setting. The problem is that when location is on, Google collects it seemingly a minimum of 14 times per hour, which it never discloses, unlike Android does for others.
They never include Google in their threat model, it's bad.