Google tracks you everywhere you go if you have it installed on your phone. You can see where you've been by looking at your Google timeline. You can go back many years to see where you were at any particular time. I hope you haven't been anywhere you shouldn't, and don't leave your phone lying around for your wife to search.
You can disable Google tracking.
It is right what you say though - that is how Google tracking is by default, but it is easily stopped.
Of course, the tracking that you can't stop is the tracking by law that the telecoms providers MUST keep.
The content of all your texts and a record of all the numbers you called and when (though not the content of telephone calls). They must also record by law all the web addresses of sites you visited, and all of the triangulation data of the masts your phone was connected to when it was on, whether you used it or not. You can't delete any of that and the requirement to keep that data goes back ten years.
George Orwell who was concerned about the reach of the state, could never have imagined quite how far it would go.
'Ah, but it is only those who have something to hide who should be concerned', say the deluded.
Not true. Your phone microphone and location can be taken control of by the state. You may well have a microphone permanently connected to the Internet in your sitting room.... It might go by the name of Alexa. Your modern car reports in to base where it is every now and then and it records where it has been down to an accuracy of a few feet. You are constantly videoed and observed on CCTV in high resolution. Cameras at the road side report in to police the location of vehicles of interest and even if they do not report YOU, their records can be reviewed so if you become of interest today they can see where you have been even years ago.
In China - where they do these things properly, everyone's face and image is constantly scanned as they walk about the street and I am not just talking a dumb image here that people might later search for, I am talking about your face being scanned like an ANPR camera scans a number plate, so a huge database exists locating everyone's face and naming them and linking that information to all else that the state knows about them.
Governments will never back off from this kind of intrusion, because it gives them immense power over people.
Now - - if you like conspiracy theories, this one is real. It is also one we should be concerned about and it gets more sophisticated and more intrusive every year.