It depends on the weapon's range, if it changes the hitting area/precision of the gun I think it's a good idea. A more precise/long range gun usually has a tiny crosshair, whereas a short-range gun (shotgun) tends to be bigger
I think it's a good idea to have different crosshairs if that's the case.