Being sad/concerned that your culture is going away is not the same as racism against people.

If they were planning an attack on a group of people based on their race it would qualify, but that’s far from this.

You can be against immigration (to protect your culture, the gains of your country) without being against individual of any race.