Just another reason to ditch Google all together. I've been using Fastmail (paid, happily so) with my own domain for about 4 years now, and have been gradually changing all my online accounts that were using my gmail.com address to my own domain. Reduces Google's surveillance abilities (to some extent) and I don't have this problem at all.

Also, I use a desktop email client (Spark on MacOS) with IMAP/SMTP. Massive improvement over any webmail client, especially GMail.