Feldspars are still silicates, but not straight SiO - so ok, that could matter.
And I guess the worry is that some kids might well play in their sand box almost every day for several years, and when you add in how close to the sand they are … maybe? I haven’t exactly studied it either, but it doesn’t seem like an entirely empty worry.
