You're right about all those risk categories, but that doesn't mean someone with few friends isn't qualified for a security clearance.

Friends who know you and know your whereabouts over the last few years are a resource for investigators. They will ask questions of them, but that's to be expected.

If you've already held a security clearance, then you know something about this. Why are you getting worried now?