you'd be right (and I don't discount the concerns about surveillance), but frankly most people in the US government (and contractors) with security clearances aren't doing surveillance
you need a security clearance for a lot of other non-intel-related stuff, too