It’s true that not using Facebook (which I, partly against better judgement, still do) is not enough.
You may have friends on Facebook, maybe a spouse that’s listed as “married”, maybe sometimes you appear in a picture - and as @GulliverFoyle said, there’s a you-shaped hole which actually adds up to a nice shadow profile.
