this is the exact reason I removed all of my phone numbers from Google account. No Matt what recovery options you choose, if Google has a phone number connected to account, it will always offer to senf an sms to let you regain access. Downside: Google everytime bothers me with notification on MyAccount page that my phone number is missing. But worth it.

In an attempt to bring security to the masses, they've exposed the high value targets.