You aren't going crazy! Apple says: "To help ensure that your AirPods microphones and speakers are operating at their best (for example, to help provide high-quality hearing test results), your AirPods may periodically play a quiet chime when they're in their charging case."
